Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Airflow | 34,299 | 320 | 10 days ago | 169 | November 27, 2023 | 890 | apache-2.0 | Python | ||
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows | ||||||||||
Orchest | 3,876 | 10 months ago | 19 | December 13, 2022 | 125 | apache-2.0 | TypeScript | |||
Build data pipelines, the easy way 🛠️ | ||||||||||
Ploomber | 3,318 | 7 | 3 months ago | 115 | November 29, 2023 | 99 | apache-2.0 | Python | ||
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️ | ||||||||||
Around Dataengineering | 926 | 2 years ago | 2 | Python | ||||||
A Data Engineering & Machine Learning Knowledge Hub | ||||||||||
Agile_data_code_2 | 435 | a year ago | 7 | mit | Jupyter Notebook | |||||
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition | ||||||||||
Astro Sdk | 303 | 2 | 3 months ago | 49 | August 30, 2023 | 153 | apache-2.0 | Python | ||
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow. | ||||||||||
Dataplane | 171 | 4 months ago | 30 | October 12, 2023 | 35 | other | JavaScript | |||
Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end. | ||||||||||
Starthinker | 156 | 9 months ago | 15 | April 07, 2022 | 18 | apache-2.0 | Python | |||
Reference framework for building data workflows provided by Google. Accelerates authentication, logging, scheduling, and deployment of solutions using GCP. To borrow a tagline.. "The framework for professionals with deadlines." | ||||||||||
Airflow Provider Great Expectations | 147 | 3 | 3 months ago | 23 | October 11, 2023 | 14 | apache-2.0 | Python | ||
Great Expectations Airflow operator | ||||||||||
Incubator Liminal | 131 | 7 months ago | 28 | January 25, 2023 | 9 | apache-2.0 | Python | |||
Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow. |