Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Machine Learning Spark Open Source Projects

Open source projects categorized as Machine Learning Spark
Categories > Machine Learning > Machine Learning
Data Science Ipython Notebooks ⭐ 25,668
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
most recent commit 7 months ago
Horovod ⭐ 13,950
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
dependent packages 16total releases 77most recent commit a month agopypi horovod} Downloads
Angel ⭐ 6,690
A Flexible and Powerful Parameter Server for large-scale machine learning
dependent packages 7total releases 23most recent commit 3 months ago
H2o 3 ⭐ 6,618
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
dependent packages 33total releases 49most recent commit 3 months ago
Mage Ai ⭐ 6,324
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
total releases 314most recent commit 3 months ago
Synapseml ⭐ 4,967
Simple and Distributed Machine Learning
dependent packages 6total releases 12most recent commit 4 days ago
Pipeline ⭐ 4,158
PipelineAI
total releases 85most recent commit 2 years ago
Tensorflowonspark ⭐ 3,851
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
total releases 32most recent commit 10 months ago
Spark Nlp ⭐ 3,578
State of the Art Natural Language Processing
dependent packages 30total releases 134most recent commit 3 months agopypi spark-nlp} Downloads
Scio ⭐ 2,505
A Scala API for Apache Beam and Google Cloud Dataflow.
dependent packages 37total releases 96most recent commit 3 months ago
Transmogrifai ⭐ 2,099
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
dependent packages 3total releases 9most recent commit 2 years ago
Easyml ⭐ 1,966
Easy Machine Learning is a general-purpose dataflow-based system for easing the process of applying machine learning algorithms to real world tasks.
most recent commit 4 months ago
Spark ⭐ 1,963
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
dependent packages 18total releases 20most recent commit 5 months agonuget Microsoft.Spark} Downloads
Benchm Ml ⭐ 1,839
A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).
most recent commit 2 years ago
Fugue ⭐ 1,821
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
dependent packages 23total releases 125most recent commit 3 months agopypi fugue} Downloads
.github ⭐ 1,722
ApacheCN 开源组织：公告、介绍、成员、活动、交流方式
most recent commit 4 months ago
Spark Ml Source Analysis ⭐ 1,710
spark ml 算法原理剖析以及具体的源码实现分析
most recent commit 5 years ago
Petastorm ⭐ 1,693
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
dependent packages 8total releases 86most recent commit 5 months agopypi petastorm} Downloads
Spark Py Notebooks ⭐ 1,515
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
most recent commit a year ago
Optimus ⭐ 1,446
🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
total releases 32most recent commit 11 days ago
Seldon Server ⭐ 1,420
Machine Learning Platform and Recommendation Engine built on Kubernetes
total releases 44most recent commit 4 years ago
Spark Sklearn ⭐ 1,039
(Deprecated) Scikit-learn integration package for Apache Spark
total releases 8most recent commit 4 years ago
Sparkling Water ⭐ 957
Sparkling Water provides H2O functionality inside Spark cluster
dependent packages 6total releases 195most recent commit 4 months ago
The 10 Most Depended On Machine Learning Spark Open Source Projects
Scio ⭐ 2,505
A Scala API for Apache Beam and Google Cloud Dataflow.
dependent packages 37total releases 96latest release November 21, 2023most recent commit 3 months ago
Spark Nlp ⭐ 3,578
State of the Art Natural Language Processing
dependent packages 30total releases 134latest release December 08, 2023most recent commit 3 months agopypi spark-nlp} Downloads
Sparklyr ⭐ 922
R interface for Apache Spark
dependent packages 30total releases 56latest release October 30, 2023most recent commit 18 days ago
Spark ⭐ 1,963
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
dependent packages 18total releases 20latest release June 01, 2022most recent commit 5 months agonuget Microsoft.Spark} Downloads
Horovod ⭐ 13,950
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
dependent packages 16total releases 77latest release June 12, 2023most recent commit a month agopypi horovod} Downloads
Featran ⭐ 465
A Scala feature transformation library for data science and machine learning
dependent packages 11total releases 34latest release December 04, 2019most recent commit a year ago
Angel ⭐ 6,690
A Flexible and Powerful Parameter Server for large-scale machine learning
dependent packages 7total releases 23latest release August 25, 2021most recent commit 3 months ago
The 10 Latest Releases In Machine Learning Spark Open Source Projects
Spark Nlp ⭐ 3,578
State of the Art Natural Language Processing
dependent packages 30total releases 134latest release December 08, 2023most recent commit 3 months agopypi spark-nlp} Downloads
Sageworks ⭐ 36
SageWorks: An easy to use Python API for creating and deploying SageMaker Models
total releases 60latest release November 29, 2023most recent commit 3 months ago
Synapseml ⭐ 4,967
Simple and Distributed Machine Learning
dependent packages 6total releases 12latest release November 27, 2023most recent commit 4 days ago
Yaetos ⭐ 32
Write data & AI pipelines in (SQL, Spark, Pandas) and deploy to the cloud, simplified
total releases 32latest release November 27, 2023most recent commit 3 months ago
Scio ⭐ 2,505
A Scala API for Apache Beam and Google Cloud Dataflow.
dependent packages 37total releases 96latest release November 21, 2023most recent commit 3 months ago
Epitweetr ⭐ 54
ECDC Early warning tool using Twitter data
total releases 6latest release November 15, 2023most recent commit 5 months ago
Sparklyr ⭐ 922
R interface for Apache Spark
dependent packages 30total releases 56latest release October 30, 2023most recent commit 18 days ago
Sparkling Water ⭐ 957
Sparkling Water provides H2O functionality inside Spark cluster
dependent packages 6total releases 195latest release October 26, 2023most recent commit 4 months ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.