Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Parquet Open Source Projects

Open source projects categorized as Parquet
Categories > Data Processing > Parquet
Iceberg ⭐ 4,805
Apache Iceberg
dependent packages 2total releases 16most recent commit 6 hours agopypi pyiceberg} Downloads
Dsq ⭐ 3,401
Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more.
total releases 2most recent commit a day ago
Roapi ⭐ 2,922
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
total releases 17most recent commit 12 hours ago
Parquet Mr ⭐ 2,166
Apache Parquet
dependent packages 170total releases 15most recent commit 7 hours ago
Drill ⭐ 1,837
Apache Drill is a distributed MPP query layer for self describing data
dependent packages 11total releases 23most recent commit a month ago
Influxdb_iox ⭐ 1,805
Pronounced (influxdb eye-ox), short for iron oxide. This is the new core of InfluxDB written in Rust on top of Apache Arrow.
total releases 4most recent commit 4 days ago
Gaffer ⭐ 1,713
A large-scale entity and relation database supporting aggregation of properties
dependent packages 21total releases 100most recent commit 17 days ago
Petastorm ⭐ 1,614
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
dependent packages 8total releases 86most recent commit 5 months agopypi petastorm} Downloads
Parquet Format ⭐ 1,467
Apache Parquet
dependent packages 12total releases 8most recent commit 10 days ago
Quilt ⭐ 1,285
Quilt is a data mesh for connecting people with actionable data
dependent packages 25total releases 59most recent commit a day agopypi quilt3} Downloads
Parquet Go ⭐ 1,082
pure golang library for reading/writing parquet file
dependent packages 96total releases 40most recent commit 12 days ago
Rill ⭐ 1,006
Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.
total releases 71most recent commit 21 hours ago
Adam ⭐ 955
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
dependent packages 17total releases 14most recent commit a month ago
Qsv ⭐ 804
CSVs sliced, diced & analyzed.
total releases 90most recent commit 14 hours ago
Choetl ⭐ 693
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
dependent packages 7total releases 181most recent commit 10 days agonuget ChoETL} Downloads
Devops Python Tools ⭐ 675
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
most recent commit 2 months ago
Cryo ⭐ 639
cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes
most recent commit 7 days ago
Tech.ml.dataset ⭐ 578
A Clojure high performance data processing system
total releases 251most recent commit a day ago
Parquetviewer ⭐ 533
Simple windows desktop application for viewing & querying Apache Parquet files
most recent commit a day ago
Pigpen ⭐ 513
Map-Reduce for Clojure
dependent packages 6total releases 34most recent commit 6 years ago
Kglab ⭐ 509
Graph Data Science: an abstraction layer in Python for building knowledge graphs, integrated with popular graph libraries – atop Pandas, NetworkX, RAPIDS, RDFlib, pySHACL, PyVis, morph-kgc, pslpython, pyarrow, etc.
total releases 22most recent commit 24 days ago
Vscode Data Preview ⭐ 447
Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files
most recent commit 5 months ago
Sparser ⭐ 411
Sparser: Raw Filtering for Faster Analytics over Raw Data
most recent commit 5 years ago
The 10 Most Depended On Parquet Open Source Projects
Parquet Mr ⭐ 2,166
Apache Parquet
dependent packages 170total releases 15latest release May 12, 2023most recent commit 7 hours ago
Parquet Go ⭐ 1,082
pure golang library for reading/writing parquet file
dependent packages 96total releases 40latest release March 15, 2022most recent commit 12 days ago
Parquet Go Source ⭐ 84
source provider for parquet-go
dependent packages 57total releases 10latest release August 06, 2020most recent commit 12 days ago
Quilt ⭐ 1,285
Quilt is a data mesh for connecting people with actionable data
dependent packages 25total releases 59latest release March 14, 2022most recent commit a day agopypi quilt3} Downloads
Gaffer ⭐ 1,713
A large-scale entity and relation database supporting aggregation of properties
dependent packages 21total releases 100latest release May 23, 2023most recent commit 17 days ago
Parquet Dotnet ⭐ 398
Fully managed Apache Parquet implementation
dependent packages 20total releases 217latest release December 21, 2022most recent commit 19 days agonuget Parquet.Net} Downloads
Eel Sdk ⭐ 140
Big Data Toolkit for the JVM
dependent packages 17total releases 103latest release October 05, 2017most recent commit 3 years ago
Grai Core ⭐ 234
dependent packages 14total releases 12latest release April 30, 2023most recent commit 2 days agopypi grai-schemas} Downloads
The 10 Latest Releases In Parquet Open Source Projects
Gaffer ⭐ 1,713
A large-scale entity and relation database supporting aggregation of properties
dependent packages 21total releases 100latest release May 23, 2023most recent commit 17 days ago
Parquet Mr ⭐ 2,166
Apache Parquet
dependent packages 170total releases 15latest release May 12, 2023most recent commit 7 hours ago
Grai Core ⭐ 234
dependent packages 14total releases 12latest release April 30, 2023most recent commit 2 days agopypi grai-schemas} Downloads
Drill ⭐ 1,837
Apache Drill is a distributed MPP query layer for self describing data
dependent packages 11total releases 23latest release April 19, 2023most recent commit a month ago
Parquetsharp ⭐ 127
ParquetSharp is a .NET library for reading and writing Apache Parquet files.
dependent packages 2total releases 59latest release February 12, 2023most recent commit 14 days agonuget ParquetSharp} Downloads
Parquet Dotnet ⭐ 398
Fully managed Apache Parquet implementation
dependent packages 20total releases 217latest release December 21, 2022most recent commit 19 days agonuget Parquet.Net} Downloads
Parquet4s ⭐ 251
Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.
dependent packages 2total releases 47latest release December 15, 2022most recent commit 9 days ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Classification
Data Science
Scraper
Transaction
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2023 Awesome Open Source.  All rights reserved.