Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Deep Learning Spark Open Source Projects

Open source projects categorized as Deep Learning Spark
Categories > Machine Learning > Deep Learning
Data Science Ipython Notebooks ⭐ 25,668
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
most recent commit 6 months ago
Horovod ⭐ 13,921
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
dependent packages 16total releases 77most recent commit 23 days agopypi horovod} Downloads
Deeplearning4j ⭐ 13,397
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.
dependent packages 119total releases 54most recent commit 25 days ago
H2o 3 ⭐ 6,618
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
dependent packages 33total releases 49most recent commit 3 months ago
Synapseml ⭐ 4,960
Simple and Distributed Machine Learning
dependent packages 6total releases 12most recent commit 11 days ago
Bigdl ⭐ 4,728
Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm
dependent packages 10total releases 16most recent commit 3 months ago
Tensorflowonspark ⭐ 3,851
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
total releases 32most recent commit 9 months ago
Benchm Ml ⭐ 1,839
A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).
most recent commit 2 years ago
Petastorm ⭐ 1,693
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
dependent packages 8total releases 86most recent commit 5 months agopypi petastorm} Downloads
Elephas ⭐ 1,548
Distributed Deep learning with Keras & Spark
total releases 2most recent commit 2 years ago
Seldon Server ⭐ 1,420
Machine Learning Platform and Recommendation Engine built on Kubernetes
total releases 44most recent commit 4 years ago
Caffeonspark ⭐ 1,272
Distributed deep learning on Hadoop and Spark clusters.
most recent commit 4 years ago
Dist Keras ⭐ 611
Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.
total releases 2most recent commit 6 years ago
Complete Life Cycle Of A Data Science Project ⭐ 499
Complete-Life-Cycle-of-a-Data-Science-Project
most recent commit 3 months ago
Dl4j Tutorials ⭐ 429
dl4j 基础教程 配套视频：https://space.bilibili.com/327018681/#/
most recent commit 3 years ago
Sparkflow ⭐ 301
Easy to use library to bring Tensorflow on Apache Spark
total releases 13most recent commit 6 months ago
Sparktorch ⭐ 297
Train and run Pytorch models on Apache Spark.
total releases 11most recent commit a year ago
Opendl ⭐ 219
The Deep Learning training framework on Spark
most recent commit 9 years ago
Rikai ⭐ 127
Parquet-based ML data format optimized for working with unstructured data
dependent packages 6total releases 38most recent commit a year agopypi rikai} Downloads
Ml Resource ⭐ 110
A concise resource repository for machine learning
most recent commit 4 months ago
Spark Nlp Models ⭐ 100
Models and Pipelines for the Spark NLP library
most recent commit 3 years ago
Mloperator ⭐ 89
Machine Learning Operator & Controller for Kubernetes
most recent commit 3 months ago
Dlflow ⭐ 84
DLFlow is a deep learning framework.
most recent commit 4 years ago
The 8 Most Depended On Deep Learning Spark Open Source Projects
Horovod ⭐ 13,921
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
dependent packages 16total releases 77latest release June 12, 2023most recent commit 23 days agopypi horovod} Downloads
Bigdl ⭐ 4,728
Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm
dependent packages 10total releases 16latest release April 19, 2021most recent commit 3 months ago
Rikai ⭐ 127
Parquet-based ML data format optimized for working with unstructured data
dependent packages 6total releases 38latest release June 23, 2022most recent commit a year agopypi rikai} Downloads
Synapseml ⭐ 4,960
Simple and Distributed Machine Learning
dependent packages 6total releases 12latest release November 27, 2023most recent commit 11 days ago
Sona ⭐ 67
Spark On Angel, arming Spark with a powerful Parameter Server, which enable Spark to train very big models
dependent packages 1total releases 1latest release September 20, 2019most recent commit 4 years ago
The 10 Latest Releases In Deep Learning Spark Open Source Projects
Synapseml ⭐ 4,960
Simple and Distributed Machine Learning
dependent packages 6total releases 12latest release November 27, 2023most recent commit 11 days ago
Horovod ⭐ 13,921
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
dependent packages 16total releases 77latest release June 12, 2023most recent commit 23 days agopypi horovod} Downloads
Rikai ⭐ 127
Parquet-based ML data format optimized for working with unstructured data
dependent packages 6total releases 38latest release June 23, 2022most recent commit a year agopypi rikai} Downloads
Tensorflowonspark ⭐ 3,851
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
total releases 32latest release April 21, 2022most recent commit 9 months ago
Elephas ⭐ 1,548
Distributed Deep learning with Keras & Spark
total releases 2latest release June 02, 2021most recent commit 2 years ago
Bigdl ⭐ 4,728
Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm
dependent packages 10total releases 16latest release April 19, 2021most recent commit 3 months ago
Sparktorch ⭐ 297
Train and run Pytorch models on Apache Spark.
total releases 11latest release December 07, 2019most recent commit a year ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.