Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 14 Machine Learning Spark Data Engineering Open Source Projects

Open source projects categorized as Machine Learning Spark Data Engineering
Categories > Data Processing > Data Engineering
Categories > Machine Learning > Machine Learning
Mage Ai ⭐ 6,324
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
total releases 314most recent commit 3 months ago
Around Dataengineering ⭐ 926
A Data Engineering & Machine Learning Knowledge Hub
most recent commit 2 years ago
Zingg ⭐ 828
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
total releases 1most recent commit 3 months ago
Geni ⭐ 268
A Clojure dataframe library that runs on Spark
total releases 33most recent commit 5 months ago
Setl ⭐ 173
A simple Spark-powered ETL framework that just works 🍺
total releases 4most recent commit 5 months ago
Scalable Data Science Platform ⭐ 153
Content for architecting a data science platform for products using Luigi, Spark & Flask.
most recent commit 4 years ago
Sageworks ⭐ 36
SageWorks: An easy to use Python API for creating and deploying SageMaker Models
total releases 60most recent commit 3 months ago
Yaetos ⭐ 32
Write data & AI pipelines in (SQL, Spark, Pandas) and deploy to the cloud, simplified
total releases 32most recent commit 3 months ago
Spark Ai ⭐ 31
Toolbox for building Generative AI applications on top of Apache Spark.
total releases 6most recent commit 3 months ago
Akka Lift Ml ⭐ 12
akka http service for serving spark machine learning models
most recent commit 7 years ago
Airflowjob ⭐ 11
Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE
most recent commit a year ago
Sparkitecture ⭐ 9
A collection of “cookbook-style” scripts for simplifying data engineering and machine learning in Apache Spark.
most recent commit 2 years ago
Analysis ⭐ 8
Repo for practical data science problems approaches, including notebook demo and working scripts | #DS | #analysis
most recent commit 4 years ago
Data Engineer Portfolio ⭐ 6
This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science topics.
most recent commit 4 months ago
The 7 Latest Releases In Machine Learning Spark Data Engineering Open Source Projects
Sageworks ⭐ 36
SageWorks: An easy to use Python API for creating and deploying SageMaker Models
total releases 60latest release November 29, 2023most recent commit 3 months ago
Yaetos ⭐ 32
Write data & AI pipelines in (SQL, Spark, Pandas) and deploy to the cloud, simplified
total releases 32latest release November 27, 2023most recent commit 3 months ago
Spark Ai ⭐ 31
Toolbox for building Generative AI applications on top of Apache Spark.
total releases 6latest release October 17, 2023most recent commit 3 months ago
Zingg ⭐ 828
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
total releases 1latest release June 01, 2022most recent commit 3 months ago
Geni ⭐ 268
A Clojure dataframe library that runs on Spark
total releases 33latest release October 14, 2020most recent commit 5 months ago
Setl ⭐ 173
A simple Spark-powered ETL framework that just works 🍺
total releases 4latest release August 21, 2020most recent commit 5 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.