Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Prefect	14,603	1	152	2 days ago	249	December 08, 2023	632	apache-2.0	Python
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
Argo Workflows	14,264	24	51	6 days ago	449	November 27, 2023	993	apache-2.0	Go
Workflow Engine for Kubernetes
Kestra	5,257		4	3 months ago	58	November 28, 2023	464	apache-2.0	Java
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Awesome Workflow Engines	5,140			4 months ago			9	apache-2.0
A curated list of awesome open source workflow engines
Nextflow	2,447		16	3 months ago	250	November 24, 2023	336	apache-2.0	Groovy
A DSL for data-driven computational pipelines
Galaxy	1,211	2	23	3 months ago	30	December 08, 2023	2,169	other	Python
Data intensive science for everyone.
Cyclone	1,042			2 years ago	85	March 02, 2021	40	apache-2.0	Go
Powerful workflow engine and end-to-end pipeline solutions implemented with native Kubernetes resources. https://cyclone.dev
Bk Sops	1,012			3 months ago			169	other	Python
蓝鲸智云标准运维(SOPS)
Scipipe	1,010			9 months ago	47	October 14, 2021	51	mit	Go
Robust, flexible and resource-efficient pipelines using Go and the commandline
Toil	860	19	12	3 months ago	528	July 27, 2023	407	apache-2.0	Python
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.

Alternatives To Compi

Select To Compare

Prefect ⭐ 14,603

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

dependent packages 152total releases 249most recent commit 2 days ago

Argo Workflows ⭐ 14,264

Workflow Engine for Kubernetes

dependent packages 51total releases 449most recent commit 6 days ago

Kestra ⭐ 5,257

Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

dependent packages 4total releases 58most recent commit 3 months ago

Awesome Workflow Engines ⭐ 5,140

A curated list of awesome open source workflow engines

most recent commit 4 months ago

Nextflow ⭐ 2,447

A DSL for data-driven computational pipelines

dependent packages 16total releases 250most recent commit 3 months ago

Galaxy ⭐ 1,211

Data intensive science for everyone.

dependent packages 23total releases 30most recent commit 3 months ago

Cyclone ⭐ 1,042

Powerful workflow engine and end-to-end pipeline solutions implemented with native Kubernetes resources. https://cyclone.dev

total releases 85most recent commit 2 years ago

Bk Sops ⭐ 1,012

蓝鲸智云标准运维(SOPS)

most recent commit 3 months ago

Scipipe ⭐ 1,010

Robust, flexible and resource-efficient pipelines using Go and the commandline

total releases 47most recent commit 9 months ago

Toil ⭐ 860

A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.

dependent packages 12total releases 528most recent commit 3 months ago

Suggest An Alternative To compi

Alternative Project Comparisons

Compi vs Prefect

Compi vs Argo Workflows

Compi vs Kestra

Compi vs Awesome Workflow Engines

Popular Pipeline Projects

Nushell ⭐ 28,304

A new type of shell

dependent packages 82total releases 77latest release November 20, 2023most recent commit 3 months ago

Jina ⭐ 19,573

☁️ Build multimodal AI applications with cloud-native stack

dependent packages 16total releases 2,453latest release December 01, 2023most recent commit 3 months ago

Luigi ⭐ 17,046

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

dependent packages 76total releases 80latest release October 05, 2023most recent commit 3 months ago

Vector ⭐ 16,326

A high-performance observability data pipeline.

total releases 3latest release March 13, 2021most recent commit 16 days ago

Argo Cd ⭐ 15,229

Declarative Continuous Deployment for Kubernetes

dependent packages 65total releases 359latest release December 01, 2023most recent commit 3 months ago

Popular Workflow Engine Projects

Airflow ⭐ 34,299

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

dependent packages 320total releases 169latest release November 27, 2023most recent commit 16 days ago

Conductor ⭐ 13,010

Conductor is a microservices orchestration engine.

dependent packages 34total releases 338latest release November 26, 2023most recent commit 4 months ago

Dtm ⭐ 9,686

A distributed transaction framework, supports workflow, saga, tcc, xa, 2-phase message, outbox patterns, supports many languages.

dependent packages 5total releases 82latest release November 05, 2023most recent commit 22 days ago

Temporal ⭐ 9,016

Temporal service

dependent packages 26total releases 531latest release December 08, 2023most recent commit 3 months ago

Flowable Engine ⭐ 7,135

A compact and highly efficient workflow and Business Process Management (BPM) platform for developers, system admins and business users.

dependent packages 16total releases 14latest release September 21, 2023most recent commit 3 months ago

Popular Data Processing Categories