Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Synapseml	4,967		6	3 days ago	12	November 27, 2023	335	mit	Scala
Simple and Distributed Machine Learning
Spark Nlp	3,578		30	3 months ago	134	December 08, 2023	43	apache-2.0	Scala
State of the Art Natural Language Processing
Awesome Spark	1,461			a year ago			20	cc0-1.0	Shell
A curated list of awesome Apache Spark packages and resources.
Sparkit Learn	1,054	5		3 years ago	13	June 24, 2015	35	apache-2.0	Python
PySpark + Scikit-learn = Sparkit-learn
Quinn	572	3	3	a month ago	13	February 17, 2023	32		Python
pyspark methods to enhance developer productivity 📣 👯 🎉
Spark Gotchas	276			7 years ago			5	other
Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks
Spark Jupyter Aws	255			6 years ago			2		Jupyter Notebook
A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
Pysparkling	253	7	1	a year ago	69	November 13, 2022	9	other	Python
A pure Python implementation of Apache Spark's RDD and DStream interfaces.
Sql Data Analysis And Visualization Projects	200			2 years ago				mit	Jupyter Notebook
SQL data analysis & visualization projects using MySQL, PostgreSQL, SQLite, Tableau, Apache Spark and pySpark.
Azure Cosmosdb Spark	194		1	a year ago	45	August 11, 2021	102	mit	Scala
Apache Spark Connector for Azure Cosmos DB

Alternatives To Amazon Emr Vscode Toolkit

Select To Compare

Synapseml ⭐ 4,967

Simple and Distributed Machine Learning

dependent packages 6total releases 12most recent commit 3 days ago

Spark Nlp ⭐ 3,578

State of the Art Natural Language Processing

dependent packages 30total releases 134most recent commit 3 months ago

Awesome Spark ⭐ 1,461

A curated list of awesome Apache Spark packages and resources.

most recent commit a year ago

Sparkit Learn ⭐ 1,054

PySpark + Scikit-learn = Sparkit-learn

total releases 13most recent commit 3 years ago

Quinn ⭐ 572

pyspark methods to enhance developer productivity 📣 👯 🎉

dependent packages 3total releases 13most recent commit a month ago

Spark Gotchas ⭐ 276

Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks

most recent commit 7 years ago

Spark Jupyter Aws ⭐ 255

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

most recent commit 6 years ago

Pysparkling ⭐ 253

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

dependent packages 1total releases 69most recent commit a year ago

Sql Data Analysis And Visualization Projects ⭐ 200

SQL data analysis & visualization projects using MySQL, PostgreSQL, SQLite, Tableau, Apache Spark and pySpark.

most recent commit 2 years ago

Azure Cosmosdb Spark ⭐ 194

Apache Spark Connector for Azure Cosmos DB

dependent packages 1total releases 45most recent commit a year ago

Suggest An Alternative To amazon-emr-vscode-toolkit

Alternative Project Comparisons

Amazon Emr Vscode Toolkit vs Synapseml

Amazon Emr Vscode Toolkit vs Spark Nlp

Amazon Emr Vscode Toolkit vs Awesome Spark

Amazon Emr Vscode Toolkit vs Sparkit Learn

Amazon Emr Vscode Toolkit vs Quinn

Amazon Emr Vscode Toolkit vs Spark Gotchas

Amazon Emr Vscode Toolkit vs Spark Jupyter Aws

Amazon Emr Vscode Toolkit vs Pysparkling

Amazon Emr Vscode Toolkit vs Sql Data Analysis And Visualization Projects

Amazon Emr Vscode Toolkit vs Azure Cosmosdb Spark

Popular Apache Spark Projects

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46latest release May 09, 2021most recent commit 3 months ago

Mlflow ⭐ 16,343

Open source platform for the machine learning lifecycle

dependent packages 440total releases 86latest release December 07, 2023most recent commit 3 months ago

Data Engineer Handbook ⭐ 5,650

This is a repo with links to everything you'd ever want to learn about data engineering

most recent commit 3 months ago

Hudi ⭐ 4,901

Upserts, Deletes And Incremental Processing on Big Data.

dependent packages 58total releases 21latest release November 11, 2023most recent commit 3 months ago

Bigdl ⭐ 4,728

Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm

dependent packages 10total releases 16latest release April 19, 2021most recent commit 3 months ago

Popular Pyspark Projects

Cheatsheets Ai ⭐ 13,281

Essential Cheat Sheets for deep learning and machine learning researchers https://medium.com/@kailashahirwar/essential-cheat

most recent commit 5 years ago

Ibis ⭐ 3,404

The flexibility of Python with the scale and performance of modern SQL.

dependent packages 29total releases 68latest release December 10, 2023most recent commit 3 months ago

Linkis ⭐ 3,224

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

dependent packages 38total releases 3latest release July 29, 2023most recent commit 17 days ago

Machine Learning ⭐ 2,607

:earth_americas: machine learning tutorials (mainly in Python3)

most recent commit 4 months ago

Petastorm ⭐ 1,693

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

dependent packages 8total releases 86latest release February 03, 2023most recent commit 5 months ago

Popular Data Processing Categories