Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Machine Learning Apache Spark Open Source Projects

Open source projects categorized as Machine Learning Apache Spark
Categories > Data Processing > Apache Spark
Categories > Machine Learning > Machine Learning
Mlflow ⭐ 16,343
Open source platform for the machine learning lifecycle
dependent packages 440total releases 86most recent commit 3 months agopypi mlflow} Downloads
Synapseml ⭐ 4,967
Simple and Distributed Machine Learning
dependent packages 6total releases 12most recent commit 3 days ago
Spark Nlp ⭐ 3,578
State of the Art Natural Language Processing
dependent packages 30total releases 134most recent commit 3 months agopypi spark-nlp} Downloads
Transmogrifai ⭐ 2,099
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
dependent packages 3total releases 9most recent commit 2 years ago
Spark ⭐ 1,963
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
dependent packages 18total releases 20most recent commit 5 months agonuget Microsoft.Spark} Downloads
Feathr ⭐ 1,886
Feathr – A scalable, unified data and AI engineering platform for enterprise
dependent packages 4total releases 48most recent commit 3 months ago
Oryx ⭐ 1,793
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
dependent packages 2total releases 14most recent commit 3 years ago
Sparkit Learn ⭐ 1,054
PySpark + Scikit-learn = Sparkit-learn
total releases 13most recent commit 3 years ago
Spark Sklearn ⭐ 1,039
(Deprecated) Scikit-learn integration package for Apache Spark
total releases 8most recent commit 4 years ago
Sparklyr ⭐ 922
R interface for Apache Spark
dependent packages 30total releases 56most recent commit 16 days ago
Dist Keras ⭐ 611
Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.
total releases 2most recent commit 6 years ago
Sparklearning ⭐ 573
Learning Apache spark,including code and data .Most part can run local.
most recent commit 2 years ago
Agile_data_code_2 ⭐ 435
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
most recent commit a year ago
Machinelearning ⭐ 406
Machine Learning
most recent commit 7 years ago
Rumble ⭐ 194
⛈️ RumbleDB 1.21.0 "Hawthorn blossom" 🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more
total releases 4most recent commit a year ago
Whylogs Java ⭐ 179
Profile and monitor your ML data pipeline end-to-end
dependent packages 2total releases 5most recent commit 3 years ago
Awesome Ai Infrastructures ⭐ 171
Infrastructures™ for Machine Learning Training/Inference in Production.
most recent commit 5 years ago
Bigdata Playground ⭐ 154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
most recent commit 5 years ago
Spark Ext ⭐ 147
Spark Extension : ML transformers, SQL aggregations, etc that are missing in Apache Spark
most recent commit 8 years ago
Albedo ⭐ 142
A recommender system for discovering GitHub repos, built with Apache Spark
most recent commit 4 years ago
Spark With Python ⭐ 98
Fundamentals of Spark with Python (using PySpark), code examples
most recent commit 4 years ago
Fasttrackml ⭐ 77
Experiment tracking server focused on speed and scalability
total releases 13most recent commit 3 months ago
Mmtf Pyspark ⭐ 64
Methods for the parallel and distributed analysis and mining of the Protein Data Bank using MMTF and Apache Spark.
total releases 14most recent commit a year ago
The 10 Most Depended On Machine Learning Apache Spark Open Source Projects
Mlflow ⭐ 16,343
Open source platform for the machine learning lifecycle
dependent packages 440total releases 86latest release December 07, 2023most recent commit 3 months agopypi mlflow} Downloads
Spark Nlp ⭐ 3,578
State of the Art Natural Language Processing
dependent packages 30total releases 134latest release December 08, 2023most recent commit 3 months agopypi spark-nlp} Downloads
Sparklyr ⭐ 922
R interface for Apache Spark
dependent packages 30total releases 56latest release October 30, 2023most recent commit 16 days ago
Spark ⭐ 1,963
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
dependent packages 18total releases 20latest release June 01, 2022most recent commit 5 months agonuget Microsoft.Spark} Downloads
Synapseml ⭐ 4,967
Simple and Distributed Machine Learning
dependent packages 6total releases 12latest release November 27, 2023most recent commit 3 days ago
Feathr ⭐ 1,886
Feathr – A scalable, unified data and AI engineering platform for enterprise
dependent packages 4total releases 48latest release June 30, 2023most recent commit 3 months ago
Oryx ⭐ 1,793
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
dependent packages 2total releases 14latest release November 25, 2018most recent commit 3 years ago
Whylogs Java ⭐ 179
Profile and monitor your ML data pipeline end-to-end
dependent packages 2total releases 5latest release November 01, 2020most recent commit 3 years ago
The 10 Latest Releases In Machine Learning Apache Spark Open Source Projects
Spark Nlp ⭐ 3,578
State of the Art Natural Language Processing
dependent packages 30total releases 134latest release December 08, 2023most recent commit 3 months agopypi spark-nlp} Downloads
Mlflow ⭐ 16,343
Open source platform for the machine learning lifecycle
dependent packages 440total releases 86latest release December 07, 2023most recent commit 3 months agopypi mlflow} Downloads
Synapseml ⭐ 4,967
Simple and Distributed Machine Learning
dependent packages 6total releases 12latest release November 27, 2023most recent commit 3 days ago
Fasttrackml ⭐ 77
Experiment tracking server focused on speed and scalability
total releases 13latest release November 15, 2023most recent commit 3 months ago
Sparklyr ⭐ 922
R interface for Apache Spark
dependent packages 30total releases 56latest release October 30, 2023most recent commit 16 days ago
Feathr ⭐ 1,886
Feathr – A scalable, unified data and AI engineering platform for enterprise
dependent packages 4total releases 48latest release June 30, 2023most recent commit 3 months ago
Chopin2 ⭐ 6
Domain-Agnostic Supervised Learning with Hyperdimensional Computing
total releases 8latest release January 27, 2023most recent commit 7 months ago
Spark ⭐ 1,963
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
dependent packages 18total releases 20latest release June 01, 2022most recent commit 5 months agonuget Microsoft.Spark} Downloads
Whylogs Java ⭐ 179
Profile and monitor your ML data pipeline end-to-end
dependent packages 2total releases 5latest release November 01, 2020most recent commit 3 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.