Airflow Dag Dependencies
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Airflow | 29,642 | 69 | 4 hours ago | 18 | September 23, 2022 | 869 | apache-2.0 | Python | ||
| Apache Airflow - A platform to programmatically author, schedule, and monitor workflows | ||||||||||
| Argo Workflows | 12,706 | 24 | 31 | 6 hours ago | 423 | June 23, 2022 | 782 | apache-2.0 | Go | |
| Workflow engine for Kubernetes | ||||||||||
| Orchest | 3,783 | 2 days ago | 14 | April 06, 2022 | 124 | agpl-3.0 | Python | |||
| Build data pipelines, the easy way 🛠️ | ||||||||||
| Awesome Etl | 2,832 | 11 days ago | 11 | |||||||
| A curated list of awesome ETL frameworks, libraries, and software. | ||||||||||
| Airflow Maintenance Dags | 1,321 | 5 months ago | 16 | apache-2.0 | Python | |||||
| A series of DAGs/Workflows to help maintain the operation of Airflow | ||||||||||
| Dag Factory | 881 |  | 1 | 4 days ago | 26 | May 27, 2022 | 39 | mit | Python | |
| Dynamically generate Apache Airflow DAGs from YAML configuration files | ||||||||||
| Goodreads_etl_pipeline | 593 | 3 years ago | mit | Python | ||||||
| An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform. | ||||||||||
| Kube Airflow | 556 | 4 years ago | 30 | apache-2.0 | Python | |||||
| A docker image and kubernetes config files to run Airflow on Kubernetes | ||||||||||
| Aws Airflow Stack | 370 | a year ago | 26 | mit | Python | |||||
| Turbine: the bare metals that gets you Airflow | ||||||||||
| Airflow Tutorial | 345 | 2 years ago | 2 | mit | ||||||
| Airflow basics tutorial | ||||||||||
Alternatives To Airflow Dag DependenciesSelect To Compare
Alternative Project Comparisons
Readme
Airflow DAG Dependencies
⚠️ Deprecation notice ⚠️
The functionality of this plugin is now part of Airflow - https://github.com/apache/airflow/pull/13199
If you find any critical issues affecting Airflow 1.10.x, feel free to sumbit a PR, but no new features will be added here.
Functionality
- Visualize dependencies between your Airflow DAGs
- 3 types of dependencies supported:
- Trigger -
TriggerDagRunOperatorin DAG A triggers DAG B - Sensor -
ExternalTaskSensorin DAG A waits for (task in) DAG B - Implicit - provide the ids of DAGs the DAGs depends on as an attribute named
implicit_dependencies. For exampledag.implicit_dependencies = ['dag_1', 'dag_2']
- Trigger -
- Be careful if you have 1000s of DAGs, might not scale.
Installation
Copy dag-dependencies-plugin to Airflow plugin folder and you're ready to go
Only RBAC UI is supported.
Popular Dag Projects
Popular Airflow Projects
Popular Computer Science Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Html
Dependencies
Rbac
Dag
Airflow