Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Iceberg	5,179			3 months ago	3	October 29, 2022	1,485	apache-2.0	Java
Apache Iceberg
Gaffer	1,724	4	31	3 months ago	101	November 14, 2023	142	apache-2.0	Java
A large-scale entity and relation database supporting aggregation of properties
Petastorm	1,693		8	5 months ago	86	February 03, 2023	174	apache-2.0	Python
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
Adam	966	20	17	3 months ago	14	December 16, 2020	35	apache-2.0	Scala
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Devops Python Tools	709			3 months ago			37	mit	Python
80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.
Iceberg	409			3 years ago			27	apache-2.0	Java
Iceberg is a table format for large, slow-moving tabular data
Spindle	333			9 years ago			2	apache-2.0	JavaScript
Next-generation web analytics processing with Scala, Spark, and Parquet.
Rumble	194			a year ago	4	December 03, 2019	134	other	Java
⛈️ RumbleDB 1.21.0 "Hawthorn blossom" 🌳 for Apache Spark \| Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) \| No install required (just a jar to download) \| Declarative Machine Learning and more
Spark Programming Guide Zh Cn	188			a year ago				other
Spark 编程指南简体中文版
Parquet Index	113			3 years ago			16	apache-2.0	Scala
Spark SQL index for Parquet tables

Alternatives To Adam

Select To Compare

Iceberg ⭐ 5,179

Apache Iceberg

total releases 3most recent commit 3 months ago

Gaffer ⭐ 1,724

A large-scale entity and relation database supporting aggregation of properties

dependent packages 31total releases 101most recent commit 3 months ago

Petastorm ⭐ 1,693

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

dependent packages 8total releases 86most recent commit 5 months ago

Adam ⭐ 966

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

dependent packages 17total releases 14most recent commit 3 months ago

Devops Python Tools ⭐ 709

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

most recent commit 3 months ago

Iceberg ⭐ 409

Iceberg is a table format for large, slow-moving tabular data

most recent commit 3 years ago

Spindle ⭐ 333

Next-generation web analytics processing with Scala, Spark, and Parquet.

most recent commit 9 years ago

Rumble ⭐ 194

⛈️ RumbleDB 1.21.0 "Hawthorn blossom" 🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

total releases 4most recent commit a year ago

Spark Programming Guide Zh Cn ⭐ 188

Spark 编程指南简体中文版

most recent commit a year ago

Parquet Index ⭐ 113

Spark SQL index for Parquet tables

most recent commit 3 years ago

Suggest An Alternative To adam

Alternative Project Comparisons

Adam vs Iceberg

Adam vs Gaffer

Adam vs Petastorm

Adam vs Devops Python Tools

Adam vs Iceberg

Adam vs Spindle

Adam vs Rumble

Adam vs Spark Programming Guide Zh Cn

Adam vs Parquet Index

Popular Parquet Projects

Dsq ⭐ 3,401

Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more.

total releases 2latest release October 20, 2022most recent commit 7 months ago

Roapi ⭐ 2,969

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

total releases 17latest release March 20, 2022most recent commit 4 months ago

Parquet Mr ⭐ 2,296

Apache Parquet

dependent packages 208total releases 17latest release May 12, 2023most recent commit 3 months ago

Qsv ⭐ 2,079

CSVs sliced, diced & analyzed.

total releases 148latest release November 20, 2023most recent commit 3 months ago

Drill ⭐ 1,856

Apache Drill is a distributed MPP query layer for self describing data

dependent packages 16total releases 24latest release April 19, 2023most recent commit 3 months ago

Popular Spark Projects

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46latest release May 09, 2021most recent commit 3 months ago

Data Science Ipython Notebooks ⭐ 25,668

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

most recent commit 6 months ago

Redash ⭐ 24,479

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

dependent packages 3total releases 2latest release May 05, 2020most recent commit 3 months ago

Docker_practice ⭐ 23,279

Learn and understand Docker&Container technologies, with real DevOps practice!

total releases 9latest release December 01, 2021most recent commit 4 months ago

Data Engineering Zoomcamp ⭐ 19,461

Free Data Engineering course!

most recent commit 3 months ago

Popular Data Processing Categories