Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Horovod	14,069	20	16	2 months ago	77	June 12, 2023	372	other	Python
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
Bigdl	4,728		10	8 months ago	16	April 19, 2021	958	apache-2.0	Jupyter Notebook
Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm
Pipeline	4,158			2 years ago	85	July 18, 2017	1	apache-2.0	Jsonnet
PipelineAI
Analytics Zoo	2,592		3	9 months ago	1	July 29, 2022	533	apache-2.0	Jupyter Notebook
Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray
.github	1,724			2 months ago					CSS
ApacheCN 开源组织：公告、介绍、成员、活动、交流方式
Cube Studio	1,710			8 months ago	1	October 13, 2022	74	other	Jupyter Notebook
cube studio开源云原生一站式机器学习/深度学习AI平台，支持sso登录，多租户/多项目组，数据资产对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式算法训练，超参搜索，推理服务VGPU，多集群调度，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型一键微调，llmops，私有知识库，AI应用商店，支持模型一键开发/推理/微调，私有化部署，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式
Complete Life Cycle Of A Data Science Project	499			8 months ago			4	mit
Complete-Life-Cycle-of-a-Data-Science-Project
Traceml	493	45	12	4 months ago	10	November 25, 2021	6	apache-2.0	Python
Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
Sparktorch	297			a year ago	11	December 07, 2019	12	mit	Python
Train and run Pytorch models on Apache Spark.
Pytorch On Angel	155			2 years ago	1	August 21, 2019	19		Scala
PyTorch On Angel, arming PyTorch with a powerful Parameter Server, which enable PyTorch to train very big models.

Alternatives To Sparktorch

Select To Compare

Horovod ⭐ 14,069

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

dependent packages 16total releases 77most recent commit 2 months ago

Bigdl ⭐ 4,728

Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm

dependent packages 10total releases 16most recent commit 8 months ago

Pipeline ⭐ 4,158

PipelineAI

total releases 85most recent commit 2 years ago

Analytics Zoo ⭐ 2,592

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

dependent packages 3total releases 1most recent commit 9 months ago

.github ⭐ 1,724

ApacheCN 开源组织：公告、介绍、成员、活动、交流方式

most recent commit 2 months ago

Cube Studio ⭐ 1,710

cube studio开源云原生一站式机器学习/深度学习AI平台，支持sso登录，多租户/多项目组，数据资产对

total releases 1most recent commit 8 months ago

Complete Life Cycle Of A Data Science Project ⭐ 499

Complete-Life-Cycle-of-a-Data-Science-Project

most recent commit 8 months ago

Traceml ⭐ 493

Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

dependent packages 12total releases 10most recent commit 4 months ago

Sparktorch ⭐ 297

Train and run Pytorch models on Apache Spark.

total releases 11most recent commit a year ago

Pytorch On Angel ⭐ 155

PyTorch On Angel, arming PyTorch with a powerful Parameter Server, which enable PyTorch to train very big models.

total releases 1most recent commit 2 years ago

Suggest An Alternative To sparktorch

Alternative Project Comparisons

Sparktorch vs Horovod

Sparktorch vs Bigdl

Sparktorch vs Pipeline

Sparktorch vs Analytics Zoo

Sparktorch vs .github

Sparktorch vs Cube Studio

Sparktorch vs Complete Life Cycle Of A Data Science Project

Sparktorch vs Traceml

Sparktorch vs Pytorch On Angel

Popular Spark Projects

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46latest release May 09, 2021most recent commit 8 months ago

Data Science Ipython Notebooks ⭐ 25,668

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

most recent commit a year ago

Redash ⭐ 24,479

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

dependent packages 3total releases 2latest release May 05, 2020most recent commit 8 months ago

Docker_practice ⭐ 23,279

Learn and understand Docker&Container technologies, with real DevOps practice!

total releases 9latest release December 01, 2021most recent commit 8 months ago

Data Engineering Zoomcamp ⭐ 19,461

Free Data Engineering course!

most recent commit 8 months ago

Popular Pytorch Projects

Transformers ⭐ 129,496

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

dependent packages 2,484total releases 125latest release November 15, 2023most recent commit 2 months ago

Stable Diffusion Webui ⭐ 118,856

Stable Diffusion web UI

total releases 2latest release January 17, 2022most recent commit 8 months ago

Pytorch ⭐ 74,794

Tensors and Dynamic neural networks in Python with strong GPU acceleration

dependent packages 8,272total releases 39latest release November 15, 2023most recent commit 8 months ago

Keras ⭐ 61,558

Deep Learning for humans

dependent packages 697total releases 87latest release December 06, 2023most recent commit 7 days ago

Annotated_deep_learning_paper_implementations ⭐ 53,666

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

dependent packages 2total releases 79latest release November 05, 2023most recent commit 19 days ago

Popular Data Processing Categories