Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Machine Learning Data Engineering Open Source Projects

Open source projects categorized as Machine Learning Data Engineering
Categories > Data Processing > Data Engineering
Categories > Machine Learning > Machine Learning
Made With Ml ⭐ 35,496
Learn how to design, develop, deploy and iterate on production-grade ML applications.
total releases 5most recent commit 4 months ago
Airflow ⭐ 34,299
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
dependent packages 320total releases 169most recent commit 7 days agopypi apache-airflow} Downloads
Applied Ml ⭐ 24,828
📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
most recent commit 6 months ago
Argo Workflows ⭐ 14,227
Workflow Engine for Kubernetes
dependent packages 51total releases 449most recent commit 7 days ago
Mage Ai ⭐ 6,324
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
total releases 314most recent commit 3 months ago
Feast ⭐ 5,053
Feature Store for Machine Learning
dependent packages 28total releases 116most recent commit 3 months agopypi feast} Downloads
God Level Data Science Ml Full Stack ⭐ 3,384
A collection of scientific methods, processes, algorithms, and systems to build stories & models. Whether you are a fresher in the field or an experienced professional who wants to transition into Data Science & AI
most recent commit 4 months ago
Ploomber ⭐ 3,318
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
dependent packages 7total releases 115most recent commit 3 months agopypi ploomber} Downloads
Data Science Roadmap ⭐ 2,445
Data Science Roadmap from A to Z
most recent commit 4 months ago
Mlops Course ⭐ 2,427
Learn how to design, develop, deploy and iterate on production-grade ML applications.
most recent commit 9 months ago
Metarank ⭐ 1,949
A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine
most recent commit 3 months ago
Feathr ⭐ 1,886
Feathr – A scalable, unified data and AI engineering platform for enterprise
dependent packages 4total releases 48most recent commit 3 months ago
Hamilton ⭐ 1,272
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
dependent packages 2total releases 116most recent commit 22 days agopypi sf-hamilton} Downloads
Data Science On Gcp ⭐ 1,249
Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017
most recent commit 8 months ago
Mlrun ⭐ 1,177
Machine Learning automation and tracking
total releases 486most recent commit 3 months ago
Yt Channels Ds Ai Ml Cs ⭐ 1,084
A comprehensive list of 180+ YouTube Channels for Data Science, Data Engineering, Machine Learning, Deep learning, Computer Science, programming, software engineering, etc.
most recent commit 2 years ago
Daft ⭐ 1,012
Distributed DataFrame for Python designed for the cloud, powered by Rust
dependent packages 3total releases 53most recent commit 3 months agopypi getdaft} Downloads
Bytewax ⭐ 957
Python Stream Processing
dependent packages 3total releases 34most recent commit 3 months agopypi bytewax} Downloads
Around Dataengineering ⭐ 926
A Data Engineering & Machine Learning Knowledge Hub
most recent commit a year ago
Data Centric Ai ⭐ 892
A curated, but incomplete, list of data-centric AI resources.
most recent commit 4 months ago
Hamilton ⭐ 877
A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton
total releases 10most recent commit 9 months ago
Zingg ⭐ 828
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
total releases 1most recent commit 3 months ago
Failed Ml ⭐ 585
Compilation of high-profile real-world examples of failed machine learning projects
most recent commit 6 months ago
The 10 Most Depended On Machine Learning Data Engineering Open Source Projects
Airflow ⭐ 34,299
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
dependent packages 320total releases 169latest release November 27, 2023most recent commit 7 days agopypi apache-airflow} Downloads
Argo Workflows ⭐ 14,227
Workflow Engine for Kubernetes
dependent packages 51total releases 449latest release November 27, 2023most recent commit 7 days ago
Feast ⭐ 5,053
Feature Store for Machine Learning
dependent packages 28total releases 116latest release September 07, 2023most recent commit 3 months agopypi feast} Downloads
Ploomber ⭐ 3,318
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
dependent packages 7total releases 115latest release November 29, 2023most recent commit 3 months agopypi ploomber} Downloads
Feathr ⭐ 1,886
Feathr – A scalable, unified data and AI engineering platform for enterprise
dependent packages 4total releases 48latest release June 30, 2023most recent commit 3 months ago
Bytewax ⭐ 957
Python Stream Processing
dependent packages 3total releases 34latest release October 05, 2023most recent commit 3 months agopypi bytewax} Downloads
Daft ⭐ 1,012
Distributed DataFrame for Python designed for the cloud, powered by Rust
dependent packages 3total releases 53latest release December 05, 2023most recent commit 3 months agopypi getdaft} Downloads
Redun ⭐ 464
Yet another redundant workflow engine
dependent packages 1total releases 18latest release November 12, 2023most recent commit 5 months agopypi redun} Downloads
Stepist ⭐ 16
Framework for data processing
dependent packages 1total releases 9latest release November 10, 2019most recent commit 4 years agopypi stepist} Downloads
The 10 Latest Releases In Machine Learning Data Engineering Open Source Projects
Feathub ⭐ 255
FeatHub - A stream-batch unified feature store for real-time machine learning
total releases 371latest release December 12, 2023most recent commit 7 months ago
Mlrun ⭐ 1,177
Machine Learning automation and tracking
total releases 486latest release December 07, 2023most recent commit 3 months ago
Daft ⭐ 1,012
Distributed DataFrame for Python designed for the cloud, powered by Rust
dependent packages 3total releases 53latest release December 05, 2023most recent commit 3 months agopypi getdaft} Downloads
Sageworks ⭐ 36
SageWorks: An easy to use Python API for creating and deploying SageMaker Models
total releases 60latest release November 29, 2023most recent commit 3 months ago
Ploomber ⭐ 3,318
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
dependent packages 7total releases 115latest release November 29, 2023most recent commit 3 months agopypi ploomber} Downloads
Pipelinex ⭐ 212
PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more
total releases 48latest release November 28, 2023most recent commit 5 months ago
Pureml ⭐ 174
Developer platform for production ML.
dependent packages 1total releases 29latest release November 27, 2023most recent commit 10 months agopypi pureml} Downloads
Argo Workflows ⭐ 14,227
Workflow Engine for Kubernetes
dependent packages 51total releases 449latest release November 27, 2023most recent commit 7 days ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.