Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Airflow | 34,299 | 320 | 11 days ago | 169 | November 27, 2023 | 890 | apache-2.0 | Python | ||
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows | ||||||||||
Orchest | 3,876 | 10 months ago | 19 | December 13, 2022 | 125 | apache-2.0 | TypeScript | |||
Build data pipelines, the easy way 🛠️ | ||||||||||
Awesome Etl | 3,041 | 3 months ago | 12 | |||||||
A curated list of awesome ETL frameworks, libraries, and software. | ||||||||||
Etl With Airflow | 1,053 | 2 years ago | 9 | Shell | ||||||
ETL best practices with airflow, with examples | ||||||||||
Optimus | 707 | 3 | 9 months ago | 120 | July 25, 2023 | 53 | apache-2.0 | Go | ||
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management. | ||||||||||
Goodreads_etl_pipeline | 593 | 4 years ago | mit | Python | ||||||
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform. | ||||||||||
Ethereum Etl Airflow | 378 | 3 months ago | 27 | mit | Python | |||||
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee | ||||||||||
Data Engineering Projects | 322 | a year ago | 5 | Jupyter Notebook | ||||||
Personal Data Engineering Projects | ||||||||||
Astro Sdk | 303 | 2 | 3 months ago | 49 | August 30, 2023 | 153 | apache-2.0 | Python | ||
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow. | ||||||||||
Beginner_de_project | 276 | a year ago | 1 | mit | HCL | |||||
Beginner data engineering project - batch edition |