Awesome Open Source
Awesome Open Source
Combined Topics
airflow
x
Advertising
π¦10
All Projects
Application Programming Interfaces
π¦124
Applications
π¦192
Artificial Intelligence
π¦78
Blockchain
π¦73
Build Tools
π¦113
Cloud Computing
π¦80
Code Quality
π¦28
Collaboration
π¦32
Command Line Interface
π¦49
Community
π¦83
Companies
π¦60
Compilers
π¦63
Computer Science
π¦80
Configuration Management
π¦42
Content Management
π¦175
Control Flow
π¦213
Data Formats
π¦78
Data Processing
π¦276
Data Storage
π¦135
Economics
π¦64
Frameworks
π¦215
Games
π¦129
Graphics
π¦110
Hardware
π¦152
Integrated Development Environments
π¦49
Learning Resources
π¦166
Legal
π¦29
Libraries
π¦129
Lists Of Projects
π¦22
Machine Learning
π¦347
Mapping
π¦64
Marketing
π¦15
Mathematics
π¦55
Media
π¦239
Messaging
π¦98
Networking
π¦315
Operating Systems
π¦89
Operations
π¦121
Package Managers
π¦55
Programming Languages
π¦245
Runtime Environments
π¦100
Science
π¦42
Security
π¦396
Social Media
π¦27
Software Architecture
π¦72
Software Development
π¦72
Software Performance
π¦58
Software Quality
π¦133
Text Editors
π¦49
Text Processing
π¦136
User Interface
π¦330
User Interface Components
π¦514
Version Control
π¦30
Virtualization
π¦71
Web Browsers
π¦42
Web Servers
π¦26
Web User Interface
π¦210
The Top 32 Airflow Open Source Projects
Categories
Β >Β
Control Flow
Β >Β
Airflow
Airflow
β
16,899
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Become A Software Engineer At Top Companies
β
Sponsored
Identify your strengths with a free online coding quiz, and skip resume and recruiter screens at multiple companies at once. It's free, confidential, includes a free flight and hotel, along with help to study to pass interviews and negotiate a high salary!
Argo
β
5,644
Argo Workflows: Get stuff done with Kubernetes.
Pipeline
β
3,989
PipelineAI Kubeflow Distribution
Incubator Dolphinscheduler
β
3,926
Dolphin Scheduler is a distributed and easy-to-extend visual workflow scheduling platform, dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing.(εεΈεΌζζ©ε±ηε―θ§εε·₯δ½ζ΅δ»»ε‘θ°εΊ¦)
Docker Airflow
β
2,475
Docker Apache Airflow
Awesome Apache Airflow
β
1,676
Curated list of resources about Apache Airflow
Dataspherestudio
β
669
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
Airflow Maintenance Dags
β
647
A series of DAGs/Workflows to help maintain the operation of Airflow
Goodreads_etl_pipeline
β
619
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Agile_data_code_2
β
393
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Aws Airflow Stack
β
301
Turbine: the bare metals that gets you Airflow
Airflow Tutorial
β
255
Airflow basics tutorial
Airflow Operator
β
249
Kubernetes custom controller and CRDs to managing Airflow
Airflow Rest Api Plugin
β
227
A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
Udacity Data Engineering Projects
β
226
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
Dag Factory
β
216
Dynamically generate Apache Airflow DAGs from YAML configuration files
Example Airflow Dags
β
204
Example DAGs using hooks and operators from Airflow Plugins
Paperboy
β
194
A web frontend for scheduling Jupyter notebook reports
Airflow Scheduler Failover Controller
β
173
A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
Airflow Doc Zh
β
136
π [θ―] Airflow δΈζζζ‘£
Airflow Exporter
β
131
Airflow plugin to export dag and task based metrics to Prometheus.
Beyond Jupyter
β
126
ππ»π All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)
Data Science Stack Cookiecutter
β
118
π³ππ€Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & API Star)
Airflow Pipeline
β
117
An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
Telemetry Airflow
β
106
Airflow configuration for Telemetry
Afctl
β
106
afctl helps to manage and deploy Apache Airflow projects faster and smoother.
Whirl
β
87
Fast iterative local development and testing of Apache Airflow workflows
Bitnami Docker Airflow
β
52
Bitnami Docker Image for Apache Airflow
Discreetly
β
50
ETLy is an add-on dashboard service on top of Apache Airflow.
Docker Airflow
β
28
Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/
Databook
β
26
A facebook for data
Phila Airflow
β
16
1-32 of 32 projects
