Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Airflow | 33,219 | 320 | 2 months ago | 169 | November 27, 2023 | 890 | apache-2.0 | Python | ||
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows | ||||||||||
Mage Ai | 6,324 | 2 months ago | 314 | December 06, 2023 | 189 | apache-2.0 | Python | |||
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data. | ||||||||||
Orchest | 3,876 | 9 months ago | 19 | December 13, 2022 | 125 | apache-2.0 | TypeScript | |||
Build data pipelines, the easy way 🛠️ | ||||||||||
Hamilton | 1,247 | 2 | 2 days ago | 116 | December 05, 2023 | 136 | bsd-3-clause-clear | Jupyter Notebook | ||
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does. | ||||||||||
Hamilton | 877 | 9 months ago | 10 | October 23, 2022 | 12 | bsd-3-clause-clear | Python | |||
A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton | ||||||||||
Zingg | 828 | 2 months ago | 1 | June 01, 2022 | 76 | agpl-3.0 | Java | |||
Scalable identity resolution, entity resolution, data mastering and deduplication using ML | ||||||||||
Onepanel | 699 | 1 | a year ago | 64 | November 15, 2021 | 85 | apache-2.0 | Go | ||
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises. | ||||||||||
Eland | 588 | 3 | 2 months ago | 30 | November 22, 2023 | 88 | apache-2.0 | Python | ||
Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch | ||||||||||
Bigslice | 525 | 10 months ago | 13 | April 05, 2021 | 23 | apache-2.0 | Go | |||
A serverless cluster computing system for the Go programming language | ||||||||||
Redun | 464 | 1 | 4 months ago | 18 | November 12, 2023 | 28 | apache-2.0 | Python | ||
Yet another redundant workflow engine |