Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Airflow | 34,468 | 320 | 2 days ago | 169 | November 27, 2023 | 890 | apache-2.0 | Python | ||
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows | ||||||||||
Argo Workflows | 14,264 | 24 | 51 | 9 days ago | 449 | November 27, 2023 | 993 | apache-2.0 | Go | |
Workflow Engine for Kubernetes | ||||||||||
Pipeline | 4,158 | 2 years ago | 85 | July 18, 2017 | 1 | apache-2.0 | Jsonnet | |||
PipelineAI | ||||||||||
Orchest | 3,876 | a year ago | 19 | December 13, 2022 | 125 | apache-2.0 | TypeScript | |||
Build data pipelines, the easy way 🛠️ | ||||||||||
Ploomber | 3,318 | 7 | 3 months ago | 115 | November 29, 2023 | 99 | apache-2.0 | Python | ||
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️ | ||||||||||
Elyra | 1,721 | 14 | 3 months ago | 111 | March 29, 2023 | 274 | apache-2.0 | Python | ||
Elyra extends JupyterLab with an AI centric approach. | ||||||||||
Around Dataengineering | 926 | 2 years ago | 2 | Python | ||||||
A Data Engineering & Machine Learning Knowledge Hub | ||||||||||
Couler | 847 | 6 months ago | 33 | apache-2.0 | Python | |||||
Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow. | ||||||||||
Agile_data_code_2 | 435 | a year ago | 7 | mit | Jupyter Notebook | |||||
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition | ||||||||||
Torchx | 275 | 4 | 3 months ago | 728 | December 12, 2023 | 75 | other | Python | ||
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready. |