Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Synapseml	4,967		6	25 days ago	12	November 27, 2023	335	mit	Scala
Simple and Distributed Machine Learning
Spark Nlp	3,578		30	4 months ago	134	December 08, 2023	43	apache-2.0	Scala
State of the Art Natural Language Processing
Ibis	3,404	24	29	4 months ago	68	December 10, 2023	157	apache-2.0	Python
The flexibility of Python with the scale and performance of modern SQL.
Linkis	3,224		38	a month ago	3	July 29, 2023	215	apache-2.0	Java
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
Petastorm	1,693		8	6 months ago	86	February 03, 2023	174	apache-2.0	Python
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
Spark Py Notebooks	1,515			a year ago			9	other	Jupyter Notebook
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
Mleap	1,479	15	12	6 months ago	26	May 07, 2021	109	apache-2.0	Scala
MLeap: Deploy ML Pipelines to Production
Awesome Spark	1,461			a year ago			20	cc0-1.0	Shell
A curated list of awesome Apache Spark packages and resources.
Optimus	1,446			a month ago	32	June 19, 2022	29	apache-2.0	Python
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Sparkmagic	1,272	25	6	4 months ago	54	September 13, 2023	156	other	Python
Jupyter magics and kernels for working with remote Spark clusters

Alternatives To Sparktraining

Select To Compare

Synapseml ⭐ 4,967

Simple and Distributed Machine Learning

dependent packages 6total releases 12most recent commit 25 days ago

Spark Nlp ⭐ 3,578

State of the Art Natural Language Processing

dependent packages 30total releases 134most recent commit 4 months ago

Ibis ⭐ 3,404

The flexibility of Python with the scale and performance of modern SQL.

dependent packages 29total releases 68most recent commit 4 months ago

Linkis ⭐ 3,224

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

dependent packages 38total releases 3most recent commit a month ago

Petastorm ⭐ 1,693

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

dependent packages 8total releases 86most recent commit 6 months ago

Spark Py Notebooks ⭐ 1,515

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

most recent commit a year ago

Mleap ⭐ 1,479

MLeap: Deploy ML Pipelines to Production

dependent packages 12total releases 26most recent commit 6 months ago

Awesome Spark ⭐ 1,461

A curated list of awesome Apache Spark packages and resources.

most recent commit a year ago

Optimus ⭐ 1,446

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

total releases 32most recent commit a month ago

Sparkmagic ⭐ 1,272

Jupyter magics and kernels for working with remote Spark clusters

dependent packages 6total releases 54most recent commit 4 months ago

Suggest An Alternative To SparkTraining

Alternative Project Comparisons

Sparktraining vs Synapseml

Sparktraining vs Spark Nlp

Sparktraining vs Ibis

Sparktraining vs Linkis

Sparktraining vs Petastorm

Sparktraining vs Spark Py Notebooks

Sparktraining vs Mleap

Sparktraining vs Awesome Spark

Sparktraining vs Optimus

Sparktraining vs Sparkmagic

Popular Spark Projects

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46latest release May 09, 2021most recent commit 4 months ago

Data Science Ipython Notebooks ⭐ 25,668

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

most recent commit 7 months ago

Redash ⭐ 24,479

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

dependent packages 3total releases 2latest release May 05, 2020most recent commit 4 months ago

Docker_practice ⭐ 23,279

Learn and understand Docker&Container technologies, with real DevOps practice!

total releases 9latest release December 01, 2021most recent commit 5 months ago

Data Engineering Zoomcamp ⭐ 19,461

Free Data Engineering course!

most recent commit 4 months ago

Popular Pyspark Projects

Cheatsheets Ai ⭐ 13,281

Essential Cheat Sheets for deep learning and machine learning researchers https://medium.com/@kailashahirwar/essential-cheat

most recent commit 5 years ago

Machine Learning ⭐ 2,607

:earth_americas: machine learning tutorials (mainly in Python3)

most recent commit 4 months ago

Bigflow ⭐ 1,122

Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.

most recent commit 2 years ago

Sparkit Learn ⭐ 1,054

PySpark + Scikit-learn = Sparkit-learn

total releases 13latest release June 24, 2015most recent commit 3 years ago

Hopsworks ⭐ 1,041

Hopsworks - Data-Intensive AI platform with a Feature Store

total releases 1latest release September 11, 2019most recent commit 4 months ago

Popular Data Processing Categories