Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Pipeline Dag Open Source Projects

Open source projects categorized as Pipeline Dag
Argo Workflows ⭐ 14,264
Workflow Engine for Kubernetes
dependent packages 51total releases 449most recent commit 8 days ago
Orchest ⭐ 3,876
Build data pipelines, the easy way 🛠️
total releases 19most recent commit a year ago
Polyaxon ⭐ 3,438
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
dependent packages 12total releases 418most recent commit 3 months agopypi polyaxon} Downloads
Awesome Etl ⭐ 3,041
A curated list of awesome ETL frameworks, libraries, and software.
most recent commit 3 months ago
Cyclone ⭐ 1,042
Powerful workflow engine and end-to-end pipeline solutions implemented with native Kubernetes resources. https://cyclone.dev
total releases 85most recent commit 2 years ago
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21most recent commit 7 months agopypi paddle-serving-client} Downloads
Goodreads_etl_pipeline ⭐ 593
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
most recent commit 4 years ago
Dagli ⭐ 351
Framework for defining machine learning models, including feature generation and transformations, as directed acyclic graphs (DAGs).
dependent packages 19total releases 8most recent commit 3 years ago
Dffml ⭐ 235
The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
dependent packages 22total releases 17most recent commit 3 months agopypi dffml} Downloads
Data Testing With Airflow ⭐ 190
most recent commit 7 months ago
Whirl ⭐ 183
Fast iterative local development and testing of Apache Airflow workflows
most recent commit 3 months ago
Factotum ⭐ 155
A system to programmatically run data pipelines
most recent commit 3 years ago
Kedro Airflow ⭐ 120
Kedro-Airflow makes it easy to deploy Kedro projects to Airflow.
most recent commit 2 years ago
Aws Concurrent Data Orchestration Pipeline Emr Livy ⭐ 66
This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concurrent data pipeline by using Amazon EMR and Apache Livy. This pipeline is orchestrated by Apache Airflow.
most recent commit 5 years ago
Dag ⭐ 62
Simple DSL for executing functions in Go
total releases 1most recent commit 3 years ago
Mlinspect ⭐ 57
Inspect ML Pipelines in Python in the form of a DAG
most recent commit a year ago
Airflow Tutorial ⭐ 51
🐍💨 Airflow tutorial for PyCon 2019
most recent commit 3 years ago
Hlatyping ⭐ 34
Precision HLA typing from next-generation sequencing data
most recent commit 2 years ago
Hadron ⭐ 25
The Kubernetes native and CloudEvents native distributed event streaming, event orchestration & messaging platform
total releases 3most recent commit a year ago
Nomad Pipeline ⭐ 24
Run pipeline-style workloads in Nomad
total releases 4most recent commit a year ago
Glide ⭐ 19
Easy ETL
total releases 45most recent commit 2 years ago
Composable Logs ⭐ 16
Python library to run ML/data pipelines on stateless compute infrastructure (that may be ephemeral or serverless). Please see the documentation site with more details and demo:
most recent commit a year ago
Phila Airflow ⭐ 16
most recent commit 7 years ago
The 7 Most Depended On Pipeline Dag Open Source Projects
Argo Workflows ⭐ 14,264
Workflow Engine for Kubernetes
dependent packages 51total releases 449latest release November 27, 2023most recent commit 8 days ago
Dagli ⭐ 351
Framework for defining machine learning models, including feature generation and transformations, as directed acyclic graphs (DAGs).
dependent packages 19total releases 8latest release October 05, 2021most recent commit 3 years ago
Polyaxon ⭐ 3,438
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
dependent packages 12total releases 418latest release December 09, 2023most recent commit 3 months agopypi polyaxon} Downloads
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21latest release May 24, 2022most recent commit 7 months agopypi paddle-serving-client} Downloads
Buildkite Graph ⭐ 9
A graph-based generator for Buildkite pipelines
dependent packages 2total releases 46latest release October 07, 2021most recent commit 3 years agonpm buildkite-graph} Downloads
Lineage ⭐ 14
Generate beautiful documentation for your data pipelines in markdown format
dependent packages 2total releases 11latest release January 26, 2022most recent commit 2 years agonpm @datayoga-io/lineage} Downloads
The 10 Latest Releases In Pipeline Dag Open Source Projects
Polyaxon ⭐ 3,438
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
dependent packages 12total releases 418latest release December 09, 2023most recent commit 3 months agopypi polyaxon} Downloads
Argo Workflows ⭐ 14,264
Workflow Engine for Kubernetes
dependent packages 51total releases 449latest release November 27, 2023most recent commit 8 days ago
Orchest ⭐ 3,876
Build data pipelines, the easy way 🛠️
total releases 19latest release December 13, 2022most recent commit a year ago
Nomad Pipeline ⭐ 24
Run pipeline-style workloads in Nomad
total releases 4latest release June 19, 2022most recent commit a year ago
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21latest release May 24, 2022most recent commit 7 months agopypi paddle-serving-client} Downloads
Glide ⭐ 19
Easy ETL
total releases 45latest release April 29, 2022most recent commit 2 years ago
Lineage ⭐ 14
Generate beautiful documentation for your data pipelines in markdown format
dependent packages 2total releases 11latest release January 26, 2022most recent commit 2 years agonpm @datayoga-io/lineage} Downloads
Buildkite Graph ⭐ 9
A graph-based generator for Buildkite pipelines
dependent packages 2total releases 46latest release October 07, 2021most recent commit 3 years agonpm buildkite-graph} Downloads
Dagli ⭐ 351
Framework for defining machine learning models, including feature generation and transformations, as directed acyclic graphs (DAGs).
dependent packages 19total releases 8latest release October 05, 2021most recent commit 3 years ago
Popular Computer Science Categories
Algorithms
Search
Graph
Stack
Hash
Vector
Data Structure
Matrix
Struct
Sort
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.