Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Prefect | 14,339 | 1 | 152 | 3 days ago | 249 | December 08, 2023 | 632 | apache-2.0 | Python | |
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines | ||||||||||
Argo Workflows | 14,146 | 24 | 51 | 9 days ago | 449 | November 27, 2023 | 993 | apache-2.0 | Go | |
Workflow Engine for Kubernetes | ||||||||||
Airbyte | 12,918 | 11 | 2 months ago | 311 | December 08, 2023 | 5,111 | other | Python | ||
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted. | ||||||||||
Dagster | 9,467 | 2 | 133 | 2 months ago | 585 | December 07, 2023 | 2,343 | apache-2.0 | Python | |
An orchestration platform for the development, production, and observation of data assets. | ||||||||||
Great_expectations | 9,179 | 53 | 2 months ago | 256 | December 08, 2023 | 182 | apache-2.0 | Python | ||
Always know what to expect from your data. | ||||||||||
Mage Ai | 6,324 | 2 months ago | 314 | December 06, 2023 | 189 | apache-2.0 | Python | |||
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data. | ||||||||||
Kestra | 5,257 | 4 | 2 months ago | 58 | November 28, 2023 | 464 | apache-2.0 | Java | ||
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code. | ||||||||||
Taipy | 4,311 | 2 months ago | 26 | October 27, 2023 | 181 | apache-2.0 | Python | |||
Turns Data and AI algorithms into production-ready web applications in no time. | ||||||||||
Ploomber | 3,318 | 7 | 2 months ago | 115 | November 29, 2023 | 99 | apache-2.0 | Python | ||
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️ | ||||||||||
Meltano | 1,460 | 1 | 2 months ago | 263 | December 05, 2023 | 448 | mit | Python | ||
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations. |