Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Koalas | 3,291 | 1 | 16 | 7 months ago | 47 | October 19, 2021 | 112 | apache-2.0 | Python | |
Koalas: pandas API on Apache Spark | ||||||||||
Ballista | 2,244 | 13 | 3 years ago | 4 | May 10, 2020 | apache-2.0 | ||||
Distributed compute platform implemented in Rust, and powered by Apache Arrow. | ||||||||||
Graphframes | 944 | 2 | 8 | 7 months ago | 1 | December 05, 2018 | 165 | apache-2.0 | Scala | |
Mobius | 937 | 6 | 3 months ago | 22 | January 29, 2017 | 88 | mit | C# | ||
C# and F# language binding and extensions to Apache Spark | ||||||||||
Spark Redis | 926 | 3 | 6 months ago | 5 | June 14, 2022 | 133 | bsd-3-clause | Scala | ||
A connector for Spark that allows reading and writing to/from Redis cluster | ||||||||||
Spark Daria | 738 | 1 | 2 years ago | 7 | February 09, 2022 | 11 | mit | Scala | ||
Essential Spark extensions and helper methods ✨😲 | ||||||||||
Datafusion | 626 | 5 years ago | apache-2.0 | Rust | ||||||
DataFusion has now been donated to the Apache Arrow project | ||||||||||
Metorikku | 536 | a year ago | 126 | February 27, 2023 | 65 | mit | Scala | |||
A simplified, lightweight ETL Framework based on Apache Spark | ||||||||||
Spark Avro | 535 | 47 | 39 | 5 years ago | 8 | October 30, 2017 | 77 | apache-2.0 | Scala | |
Avro Data Source for Apache Spark | ||||||||||
Traceml | 490 | 45 | 12 | 2 months ago | 10 | November 25, 2021 | 6 | apache-2.0 | Python | |
Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon. |