K8s Bigdata
Apache Spark with HDFS cluster within Kubernetes
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Spark On K8s Operator | 2,526 | 28 | 5 months ago | 19 | April 04, 2023 | 533 | apache-2.0 | Go | ||
| Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes. | ||||||||||
| Ballista | 2,244 | 13 | 3 years ago | 4 | May 10, 2020 | apache-2.0 | ||||
| Distributed compute platform implemented in Rust, and powered by Apache Arrow. | ||||||||||
| Docker Spark | 1,783 | 2 years ago | 36 | Shell | ||||||
| Apache Spark docker image | ||||||||||
| Spark | 597 | 4 years ago | n,ull | apache-2.0 | Scala | |||||
| Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/ | ||||||||||
| Delight | 299 | a year ago | 5 | other | Scala | |||||
| A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source. | ||||||||||
| Awesome Ai Infrastructures | 171 | 5 years ago | ||||||||
| Infrastructures™ for Machine Learning Training/Inference in Production. | ||||||||||
| Spark Operator | 155 | 3 years ago | 6 | January 30, 2020 | 59 | apache-2.0 | Java | |||
| Operator for managing the Spark clusters on Kubernetes and OpenShift. | ||||||||||
| Bigdata Playground | 154 | 5 years ago | 4 | apache-2.0 | TypeScript | |||||
| A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL | ||||||||||
| Lighter | 72 | 5 months ago | 8 | mit | Java | |||||
| REST API for Apache Spark on K8S or YARN | ||||||||||
| Spark Kubernetes | 19 | 7 years ago | 4 | mit | Shell | |||||
| Apache Spark on Kubernetes | ||||||||||
Alternatives To K8s BigdataSelect To Compare
Alternative Project Comparisons
Popular Kubernetes Projects
Popular Apache Spark Projects
Popular Virtualization Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Docker
Kubernetes
Hadoop
Big Data
Apache Spark