Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Workflow Data Science Open Source Projects

Open source projects categorized as Workflow Data Science
Categories > Data Processing > Data Science
Airflow ⭐ 34,299
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
dependent packages 320total releases 169most recent commit 15 days agopypi apache-airflow} Downloads
Prefect ⭐ 14,603
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249most recent commit 2 days agopypi prefect} Downloads
Dagster ⭐ 9,467
An orchestration platform for the development, production, and observation of data assets.
dependent packages 133total releases 585most recent commit 3 months agopypi dagster} Downloads
Flyte ⭐ 4,380
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
dependent packages 35total releases 266most recent commit 3 months agopypi flyteidl} Downloads
Taipy ⭐ 4,311
Turns Data and AI algorithms into production-ready web applications in no time.
total releases 26most recent commit 3 months ago
Cml ⭐ 3,848
♾️ CML - Continuous Machine Learning | CI/CD for ML
dependent packages 2total releases 149most recent commit 5 months agonpm @dvcorg/cml} Downloads
Zenml ⭐ 3,626
ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
dependent packages 2total releases 116most recent commit 15 days agopypi zenml} Downloads
Polyaxon ⭐ 3,438
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
dependent packages 12total releases 418most recent commit 3 months agopypi polyaxon} Downloads
Ploomber ⭐ 3,318
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
dependent packages 7total releases 115most recent commit 3 months agopypi ploomber} Downloads
Wooey ⭐ 2,061
A Django app that creates automatic web UIs for Python scripts.
total releases 40most recent commit 2 months ago
Doit ⭐ 1,590
task management & automation tool
dependent packages 62total releases 48most recent commit a year agopypi doit} Downloads
Azureml Examples ⭐ 1,442
Official community-driven Azure Machine Learning examples, tested with GitHub Actions.
dependent packages 4total releases 17most recent commit 3 months agopypi mldesigner} Downloads
Drake ⭐ 1,332
An R-focused pipeline toolkit for reproducibility and high-performance computing
dependent packages 1total releases 47most recent commit 6 months ago
Mlrun ⭐ 1,177
Machine Learning automation and tracking
total releases 486most recent commit 3 months ago
Hopsworks ⭐ 1,041
Hopsworks - Data-Intensive AI platform with a Feature Store
total releases 1most recent commit 3 months ago
Targets ⭐ 860
Function-oriented Make-like declarative workflows for R
most recent commit 19 days ago
Nipype ⭐ 707
Workflows and interfaces for neuroimaging packages
total releases 11most recent commit 4 months ago
Covalent ⭐ 608
Pythonic tool for running machine-learning/high performance/quantum-computing workflows in heterogeneous environments.
dependent packages 2total releases 118most recent commit 3 months agopypi covalent} Downloads
Production Data Science ⭐ 394
Production Data Science: a workflow for collaborative data science aimed at production
most recent commit 4 years ago
Astro Sdk ⭐ 303
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
dependent packages 2total releases 49most recent commit 3 months agopypi astro-sdk-python} Downloads
Plynx ⭐ 288
PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.
total releases 57most recent commit 3 months ago
Codeflare ⭐ 199
Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.
total releases 4most recent commit 7 months ago
Batchflow ⭐ 195
BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
total releases 15most recent commit 3 months ago
The 10 Most Depended On Workflow Data Science Open Source Projects
Airflow ⭐ 34,299
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
dependent packages 320total releases 169latest release November 27, 2023most recent commit 15 days agopypi apache-airflow} Downloads
Prefect ⭐ 14,603
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249latest release December 08, 2023most recent commit 2 days agopypi prefect} Downloads
Dagster ⭐ 9,467
An orchestration platform for the development, production, and observation of data assets.
dependent packages 133total releases 585latest release December 07, 2023most recent commit 3 months agopypi dagster} Downloads
Doit ⭐ 1,590
task management & automation tool
dependent packages 62total releases 48latest release April 22, 2022most recent commit a year agopypi doit} Downloads
Flytekit ⭐ 175
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
dependent packages 55total releases 350latest release December 06, 2023most recent commit 3 months agopypi flytekit} Downloads
Flyte ⭐ 4,380
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
dependent packages 35total releases 266latest release December 06, 2023most recent commit 3 months agopypi flyteidl} Downloads
Zarr.js ⭐ 113
Javascript implementation of Zarr
dependent packages 19total releases 27latest release October 09, 2023most recent commit 5 months agonpm zarr} Downloads
Polyaxon ⭐ 3,438
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
dependent packages 12total releases 418latest release December 09, 2023most recent commit 3 months agopypi polyaxon} Downloads
Ploomber ⭐ 3,318
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
dependent packages 7total releases 115latest release November 29, 2023most recent commit 3 months agopypi ploomber} Downloads
Pyradigm ⭐ 24
Research data management in biomedical and machine learning applications
dependent packages 4total releases 21latest release July 22, 2020most recent commit a year agopypi pyradigm} Downloads
The 10 Latest Releases In Workflow Data Science Open Source Projects
Polyaxon ⭐ 3,438
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
dependent packages 12total releases 418latest release December 09, 2023most recent commit 3 months agopypi polyaxon} Downloads
Prefect ⭐ 14,603
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249latest release December 08, 2023most recent commit 2 days agopypi prefect} Downloads
Dagster ⭐ 9,467
An orchestration platform for the development, production, and observation of data assets.
dependent packages 133total releases 585latest release December 07, 2023most recent commit 3 months agopypi dagster} Downloads
Mlrun ⭐ 1,177
Machine Learning automation and tracking
total releases 486latest release December 07, 2023most recent commit 3 months ago
Flytekit ⭐ 175
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
dependent packages 55total releases 350latest release December 06, 2023most recent commit 3 months agopypi flytekit} Downloads
Flyte ⭐ 4,380
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
dependent packages 35total releases 266latest release December 06, 2023most recent commit 3 months agopypi flyteidl} Downloads
Covalent ⭐ 608
Pythonic tool for running machine-learning/high performance/quantum-computing workflows in heterogeneous environments.
dependent packages 2total releases 118latest release December 01, 2023most recent commit 3 months agopypi covalent} Downloads
Ploomber ⭐ 3,318
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
dependent packages 7total releases 115latest release November 29, 2023most recent commit 3 months agopypi ploomber} Downloads
Zenml ⭐ 3,626
ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
dependent packages 2total releases 116latest release November 28, 2023most recent commit 15 days agopypi zenml} Downloads
Airflow ⭐ 34,299
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
dependent packages 320total releases 169latest release November 27, 2023most recent commit 15 days agopypi apache-airflow} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.