Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Pipeline Data Science Open Source Projects

Open source projects categorized as Pipeline Data Science
Categories > Data Processing > Data Science
Categories > Data Processing > Pipeline
Prefect ⭐ 14,603
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249most recent commit 4 days agopypi prefect} Downloads
Dagster ⭐ 9,467
An orchestration platform for the development, production, and observation of data assets.
dependent packages 133total releases 585most recent commit 3 months agopypi dagster} Downloads
Great_expectations ⭐ 9,179
Always know what to expect from your data.
dependent packages 53total releases 256most recent commit 3 months agopypi great-expectations} Downloads
Mage Ai ⭐ 6,324
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
total releases 314most recent commit 3 months ago
Pachyderm ⭐ 6,035
Data-Centric Pipelines and Data Versioning
dependent packages 1total releases 613most recent commit 3 months ago
Taipy ⭐ 4,311
Turns Data and AI algorithms into production-ready web applications in no time.
total releases 26most recent commit 3 months ago
Orchest ⭐ 3,876
Build data pipelines, the easy way 🛠️
total releases 19most recent commit a year ago
Datascienceresources ⭐ 3,826
Open Source Data Science Resources.
most recent commit 8 months ago
Zenml ⭐ 3,626
ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
dependent packages 2total releases 116most recent commit 17 days agopypi zenml} Downloads
Polyaxon ⭐ 3,438
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
dependent packages 12total releases 418most recent commit 3 months agopypi polyaxon} Downloads
Pipelines ⭐ 3,368
Machine Learning Pipelines for Kubeflow
dependent packages 77total releases 129most recent commit 3 months agopypi kfp} Downloads
Ploomber ⭐ 3,318
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
dependent packages 7total releases 115most recent commit 3 months agopypi ploomber} Downloads
Marimo ⭐ 3,037
A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.
total releases 66most recent commit 3 months ago
Pyfunctional ⭐ 2,232
Python library for creating data pipelines with chain functional programming
dependent packages 22total releases 14most recent commit 7 months agopypi pyfunctional} Downloads
Mlj.jl ⭐ 1,690
A Julia machine learning framework
most recent commit 3 months ago
Mlbox ⭐ 1,403
MLBox is a powerful Automated Machine Learning python library.
total releases 21most recent commit a year ago
Drake ⭐ 1,332
An R-focused pipeline toolkit for reproducibility and high-performance computing
dependent packages 1total releases 47most recent commit 6 months ago
Mlrun ⭐ 1,177
Machine Learning automation and tracking
total releases 486most recent commit 3 months ago
Sematic ⭐ 913
An open-source ML pipeline development platform
total releases 70most recent commit 4 months ago
Targets ⭐ 860
Function-oriented Make-like declarative workflows for R
most recent commit 21 days ago
Dataflowjavasdk ⭐ 853
Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
dependent packages 14total releases 38most recent commit 3 years ago
Lightautoml ⭐ 769
LAMA - automatic model creation framework
total releases 2most recent commit 2 years ago
Pdpipe ⭐ 710
Easy pipelines for pandas DataFrames.
dependent packages 6total releases 86most recent commit a year agopypi pdpipe} Downloads
The 10 Most Depended On Pipeline Data Science Open Source Projects
Prefect ⭐ 14,603
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249latest release December 08, 2023most recent commit 4 days agopypi prefect} Downloads
Dagster ⭐ 9,467
An orchestration platform for the development, production, and observation of data assets.
dependent packages 133total releases 585latest release December 07, 2023most recent commit 3 months agopypi dagster} Downloads
Pipelines ⭐ 3,368
Machine Learning Pipelines for Kubeflow
dependent packages 77total releases 129latest release October 27, 2023most recent commit 3 months agopypi kfp} Downloads
Great_expectations ⭐ 9,179
Always know what to expect from your data.
dependent packages 53total releases 256latest release December 08, 2023most recent commit 3 months agopypi great-expectations} Downloads
Versatile Data Kit ⭐ 389
One framework to develop, deploy and operate data workflows with Python and SQL.
dependent packages 25total releases 181latest release November 28, 2023most recent commit 3 months agopypi vdk-core} Downloads
Pyfunctional ⭐ 2,232
Python library for creating data pipelines with chain functional programming
dependent packages 22total releases 14latest release January 12, 2021most recent commit 7 months agopypi pyfunctional} Downloads
Polyaxon ⭐ 3,438
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
dependent packages 12total releases 418latest release December 09, 2023most recent commit 3 months agopypi polyaxon} Downloads
Ploomber ⭐ 3,318
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
dependent packages 7total releases 115latest release November 29, 2023most recent commit 3 months agopypi ploomber} Downloads
Toloka Kit ⭐ 195
Toloka-Kit is a Python library for working with Toloka API.
dependent packages 6total releases 39latest release October 26, 2023most recent commit 3 months agopypi toloka-kit} Downloads
The 10 Latest Releases In Pipeline Data Science Open Source Projects
Polyaxon ⭐ 3,438
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
dependent packages 12total releases 418latest release December 09, 2023most recent commit 3 months agopypi polyaxon} Downloads
Great_expectations ⭐ 9,179
Always know what to expect from your data.
dependent packages 53total releases 256latest release December 08, 2023most recent commit 3 months agopypi great-expectations} Downloads
Prefect ⭐ 14,603
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249latest release December 08, 2023most recent commit 4 days agopypi prefect} Downloads
Dagster ⭐ 9,467
An orchestration platform for the development, production, and observation of data assets.
dependent packages 133total releases 585latest release December 07, 2023most recent commit 3 months agopypi dagster} Downloads
Mlrun ⭐ 1,177
Machine Learning automation and tracking
total releases 486latest release December 07, 2023most recent commit 3 months ago
Pachyderm ⭐ 6,035
Data-Centric Pipelines and Data Versioning
dependent packages 1total releases 613latest release December 04, 2023most recent commit 3 months ago
Covalent ⭐ 608
Pythonic tool for running machine-learning/high performance/quantum-computing workflows in heterogeneous environments.
dependent packages 2total releases 118latest release December 01, 2023most recent commit 3 months agopypi covalent} Downloads
Ploomber ⭐ 3,318
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
dependent packages 7total releases 115latest release November 29, 2023most recent commit 3 months agopypi ploomber} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.