Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Pipeline Workflow Engine Open Source Projects

Open source projects categorized as Pipeline Workflow Engine
Categories > Data Processing > Pipeline
Categories > Control Flow > Workflow Engine
Prefect ⭐ 14,603
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249most recent commit 4 days agopypi prefect} Downloads
Argo Workflows ⭐ 14,264
Workflow Engine for Kubernetes
dependent packages 51total releases 449most recent commit 8 days ago
Kestra ⭐ 5,257
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
dependent packages 4total releases 58most recent commit 3 months ago
Awesome Workflow Engines ⭐ 5,140
A curated list of awesome open source workflow engines
most recent commit 4 months ago
Nextflow ⭐ 2,447
A DSL for data-driven computational pipelines
dependent packages 16total releases 250most recent commit 3 months ago
Galaxy ⭐ 1,211
Data intensive science for everyone.
dependent packages 23total releases 30most recent commit 3 months agopypi galaxy-util} Downloads
Cyclone ⭐ 1,042
Powerful workflow engine and end-to-end pipeline solutions implemented with native Kubernetes resources. https://cyclone.dev
total releases 85most recent commit 2 years ago
Bk Sops ⭐ 1,012
蓝鲸智云标准运维(SOPS)
most recent commit 3 months ago
Scipipe ⭐ 1,010
Robust, flexible and resource-efficient pipelines using Go and the commandline
total releases 47most recent commit 9 months ago
Toil ⭐ 860
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
dependent packages 12total releases 528most recent commit 3 months agopypi toil} Downloads
Couler ⭐ 847
Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
most recent commit 6 months ago
Piper ⭐ 480
piper - a distributed workflow engine
most recent commit 9 months ago
Faas Flow ⭐ 253
Function Composition for OpenFaaS
dependent packages 1total releases 8most recent commit a year ago
Batchflow ⭐ 195
BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
total releases 15most recent commit 3 months ago
Machine ⭐ 140
Machine is a workflow/pipeline library for processing data
dependent packages 13total releases 198most recent commit 4 months ago
Powerpipe ⭐ 136
A library for .NET that uses a fluent interface to construct advanced workflows with ease.
dependent packages 1total releases 29most recent commit 4 months agonuget PowerPipe} Downloads
Pipen ⭐ 99
A pipeline framework for python
dependent packages 19total releases 86most recent commit 14 days agopypi pipen} Downloads
Floe ⭐ 92
floe - code over convention workflow engine - think gocd but actually in go - oh and no xml
most recent commit 5 years ago
Automaticanalysis ⭐ 70
Automatic Analysis (aa)
most recent commit 4 months ago
Docs ⭐ 59
most recent commit 3 months ago
Geoweaver ⭐ 43
a web system to allow users to automatically record history and manage complicated scientific workflows in web browsers involving the online spatial data facilities, high-performance computation platforms, and open-source libraries.
most recent commit 3 months ago
Didact Engine ⭐ 34
The REST API and execution engine for the Didact Platform.
most recent commit 4 months ago
Bionode Watermill ⭐ 34
💧Bionode-Watermill: A (Not Yet Streaming) Workflow Engine
dependent packages 2total releases 5most recent commit 6 years agonpm bionode-waterwheel} Downloads
The 10 Most Depended On Pipeline Workflow Engine Open Source Projects
Prefect ⭐ 14,603
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249latest release December 08, 2023most recent commit 4 days agopypi prefect} Downloads
Argo Workflows ⭐ 14,264
Workflow Engine for Kubernetes
dependent packages 51total releases 449latest release November 27, 2023most recent commit 8 days ago
Galaxy ⭐ 1,211
Data intensive science for everyone.
dependent packages 23total releases 30latest release December 08, 2023most recent commit 3 months agopypi galaxy-util} Downloads
Pipen ⭐ 99
A pipeline framework for python
dependent packages 19total releases 86latest release October 20, 2023most recent commit 14 days agopypi pipen} Downloads
Nextflow ⭐ 2,447
A DSL for data-driven computational pipelines
dependent packages 16total releases 250latest release November 24, 2023most recent commit 3 months ago
Machine ⭐ 140
Machine is a workflow/pipeline library for processing data
dependent packages 13total releases 198latest release November 16, 2023most recent commit 4 months ago
Toil ⭐ 860
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
dependent packages 12total releases 528latest release July 27, 2023most recent commit 3 months agopypi toil} Downloads
Oi ⭐ 12
Compile your pipeline once, run anywhere
dependent packages 9total releases 94latest release December 03, 2021most recent commit 2 years ago
Bionode Watermill ⭐ 34
💧Bionode-Watermill: A (Not Yet Streaming) Workflow Engine
dependent packages 2total releases 5latest release October 26, 2016most recent commit 6 years agonpm bionode-waterwheel} Downloads
The 10 Latest Releases In Pipeline Workflow Engine Open Source Projects
Galaxy ⭐ 1,211
Data intensive science for everyone.
dependent packages 23total releases 30latest release December 08, 2023most recent commit 3 months agopypi galaxy-util} Downloads
Prefect ⭐ 14,603
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249latest release December 08, 2023most recent commit 4 days agopypi prefect} Downloads
Argo Workflows ⭐ 14,264
Workflow Engine for Kubernetes
dependent packages 51total releases 449latest release November 27, 2023most recent commit 8 days ago
Nextflow ⭐ 2,447
A DSL for data-driven computational pipelines
dependent packages 16total releases 250latest release November 24, 2023most recent commit 3 months ago
Machine ⭐ 140
Machine is a workflow/pipeline library for processing data
dependent packages 13total releases 198latest release November 16, 2023most recent commit 4 months ago
Powerpipe ⭐ 136
A library for .NET that uses a fluent interface to construct advanced workflows with ease.
dependent packages 1total releases 29latest release November 13, 2023most recent commit 4 months agonuget PowerPipe} Downloads
Pipen ⭐ 99
A pipeline framework for python
dependent packages 19total releases 86latest release October 20, 2023most recent commit 14 days agopypi pipen} Downloads
Toil ⭐ 860
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
dependent packages 12total releases 528latest release July 27, 2023most recent commit 3 months agopypi toil} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.