Sona
Spark On Angel, arming Spark with a powerful Parameter Server, which enable Spark to train very big models
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Data Science Ipython Notebooks | 25,668 | 6 months ago | 34 | other | Python | |||||
| Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines. | ||||||||||
| Horovod | 13,921 |  | 20 | 16 | a month ago | 77 | June 12, 2023 | 372 | other | Python |
| Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. | ||||||||||
| Deeplearning4j | 13,397 | 175 | 119 | a month ago | 54 | August 10, 2022 | 624 | apache-2.0 | Java | |
| Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation. | ||||||||||
| H2o 3 | 6,618 | 62 | 33 | 3 months ago | 49 | August 09, 2023 | 2,746 | apache-2.0 | Jupyter Notebook | |
| H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc. | ||||||||||
| Synapseml | 4,967 | 6 | 3 days ago | 12 | November 27, 2023 | 335 | mit | Scala | ||
| Simple and Distributed Machine Learning | ||||||||||
| Bigdl | 4,728 | 10 | 3 months ago | 16 | April 19, 2021 | 958 | apache-2.0 | Jupyter Notebook | ||
| Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm | ||||||||||
| Tensorflowonspark | 3,851 | 5 | 9 months ago | 32 | April 21, 2022 | 13 | apache-2.0 | Python | ||
| TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters. | ||||||||||
| Benchm Ml | 1,839 | 2 years ago | 11 | mit | R | |||||
| A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.). | ||||||||||
| Petastorm | 1,693 |  | 8 | 5 months ago | 86 | February 03, 2023 | 174 | apache-2.0 | Python | |
| Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code. | ||||||||||
| Elephas | 1,548 | 2 years ago | 2 | June 02, 2021 | 17 | mit | Python | |||
| Distributed Deep learning with Keras & Spark | ||||||||||
Alternatives To SonaSelect To Compare
Alternative Project Comparisons
Popular Spark Projects
Popular Deep Learning Projects
Popular Data Processing Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Deep Learning
Algorithms
Scala
Spark