Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for apache airflow
apache-airflow
x
105 search results found
Airflow
⭐
34,468
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Awesome Apache Airflow
⭐
3,468
Curated list of resources about Apache Airflow
Tfx
⭐
2,051
TFX is an end-to-end platform for deploying production ML pipelines
Elyra
⭐
1,721
Elyra extends JupyterLab with an AI centric approach.
Airflow Maintenance Dags
⭐
1,567
A series of DAGs/Workflows to help maintain the operation of Airflow
Etl With Airflow
⭐
1,053
ETL best practices with airflow, with examples
Dag Factory
⭐
1,001
Dynamically generate Apache Airflow DAGs from YAML configuration files
Couler
⭐
847
Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
Airflow Tutorial
⭐
669
Apache Airflow tutorial
Goodreads_etl_pipeline
⭐
593
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Data Pipelines With Apache Airflow
⭐
587
Code for Data Pipelines with Apache Airflow
Astronomer
⭐
454
Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes
Ethereum Etl Airflow
⭐
378
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethe
Astronomer Cosmos
⭐
368
Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code
Airflow Code Editor
⭐
347
A plugin for Apache Airflow that allows you to edit DAGs in browser
Astro Cli
⭐
321
CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer
Astro Sdk
⭐
303
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
Airflow Client Python
⭐
289
Apache Airflow - OpenApi Client for Python
Airflow Chart
⭐
261
A Helm chart to install Apache Airflow on Kubernetes
Airflow Rest Api Plugin
⭐
243
A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
Airflow Operator
⭐
241
Kubernetes custom controller and CRDs to managing Airflow
Goflow
⭐
234
Simple but powerful DAG scheduler and dashboard
Paperboy
⭐
231
A web frontend for scheduling Jupyter notebook reports
Airflow Scheduler Failover Controller
⭐
220
A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
Kyle School
⭐
204
쏘카 데이터 그룹 사내 신입/인턴을 대상으로 한 카일스쿨
Example Airflow Dags
⭐
204
Example DAGs using hooks and operators from Airflow Plugins
Airflow_in_docker_compose
⭐
182
Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)
Airflow_for_beginners
⭐
166
Airflowctl
⭐
128
A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
Astronomer Providers
⭐
123
Airflow Providers containing Deferrable Operators & Sensors from Astronomer
Kedro Airflow
⭐
120
Kedro-Airflow makes it easy to deploy Kedro projects to Airflow.
Airflow On Kubernetes
⭐
119
A guide to running Airflow on Kubernetes
Airflow Extended Api Plugin
⭐
108
Yet another Airflow plugin using CLI command as RESTful api, supports Airflow v2.X.
Airflow Client Go
⭐
104
Apache Airflow - OpenApi Client for Go
Viewflow
⭐
84
Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.
Terraform Aws Airflow
⭐
72
Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker with CeleryExecutor
Airflow Role
⭐
72
Ansible role to install Apache Airflow
Ro Dou
⭐
54
Gerador de DAGs no Airflow para fazer clipping do Diário Oficial da União.
Ambari Airflow Mpack
⭐
45
Ambari stack service for installing and managing Apache Airflow on HDP cluster
Airflow_api_plugin
⭐
41
REST-like API exposing Airflow data and operations
Airflow Boilerplate
⭐
40
A complete development environment setup for working with Airflow
Ml In Production
⭐
39
The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.
Pyjaws
⭐
36
PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
Uber Expenses Tracking
⭐
35
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
Aws Airflow Demo
⭐
31
Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for Apache Airflow (MWAA) on AWS.
Fairflow
⭐
29
Functional Airflow DAG definitions.
Ada
⭐
28
ADA is a microservice created to retrieve analytics metrics from an Airflow database instance.
Airflow Provider Datarobot
⭐
28
DataRobot provider for Apache Airflow
Airflowscan
⭐
26
Checklist and tools for increasing security of Apache Airflow
Airflow Prometheus Exporter
⭐
25
Export Airflow metrics (from mysql) in prometheus format
Microflow
⭐
24
Microservice orchestration inspired by AWS Step functions and Apache Airflow
Airflow Jupyter Docker Compose
⭐
24
Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition
Terraform Aws Mwaa
⭐
23
Terraform module for Amazon MWAA(Apache Airflow)
Data Pipeline
⭐
23
Airflow On K8s Operator
⭐
22
Airflow on Kubernetes Operator
Dataops Platform Airflow Dbt
⭐
21
Build DataOps platform with Apache Airflow and dbt on AWS
Spark Movies Etl
⭐
21
Spark data pipeline that ingests and transforms movie ratings data.
Docker_datalake
⭐
21
Datalake
Airflow Chart
⭐
20
Helm chart for deploying Apache Airflow in kubernetes
Terraform Aws Airflow
⭐
20
Terraform module for a PostgreSQL-backed Apache Airflow instance
Doit Composer Airflow Training
⭐
20
Getting started with Apache Airflow on Cloud Composer
Covid 19 Data Engineering Pipeline
⭐
19
A Covid-19 data pipeline on AWS featuring PySpark/Glue, Docker, Great Expectations, Airflow, and Redshift, templated in CloudFormation and CDK, deployable via Github Actions.
Pipeline Editor
⭐
19
Common pipeline-editor components used in different clients (e.g. Elyra application, Web browser extensions, etc)
Ansible Airflow
⭐
18
Ansible role for the installation of Apache Airflow
Data
⭐
18
🎲 Repositório para armazenar todos os componentes referentes a Data Science / Data Engineering do projeto
Airflow Studyclub
⭐
16
Grupo de estudio Apache Airflow organizado por la comunidad Data Engineering Latam
Airflowetl
⭐
16
Blog post on ETL pipelines with Airflow
Airflow Docker
⭐
16
Apache Airflow Docker Image.
Airflow Provider Fivetran Async
⭐
15
A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran
Queenbee
⭐
15
👑 Queenbee is a workflow language for creating workflows
Airflow Ci
⭐
15
Apache Airflow CI pipeline
Data Pipelines With Airflow
⭐
14
Skooldio: Data Pipelines with Airflow
Heroku_airflow
⭐
14
Build for Apache Airflow running on Heroku
Apache Airflow Cloudera Parcel
⭐
14
Parcel for Apache Airflow
Facebook_ads_plugin
⭐
14
Airflow Helm
⭐
14
A Helm Chart for Apache Airflow
Airflow User Management Plugin
⭐
13
A plugin for Apache Airflow that allows you to manage the users that can login
Dbt Airflow Macros
⭐
13
Dbt package for Apache Airflow inspired macros
Dbt On Airflow
⭐
12
Salesforce_plugin
⭐
12
Move Data From Salesforce -> S3 -> Redshift
Astro Provider Databricks
⭐
12
Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows
Social Media Analysis
⭐
11
Social Media Analysis, scalable solution, flexible deployment that analyses social media contents
Apache Airflow Providers Transfers
⭐
10
Airflow Fs
⭐
10
Composable filesystem hooks and operators for Apache Airflow.
Github_plugin
⭐
10
Astronomer Fab Securitymanager
⭐
10
Security Manager for the Astronomer Airflow distribution
Airflow Ubuntu Ansible Terraform
⭐
9
Demo deployment of Apache Airflow on EC2/Ubuntu with Docker-compose, Terraform, and Ansible
Miniflow
⭐
9
This repository aims to help you have an Airflow installation running in Kubernetes minikube.
Google Airflow Premier League
⭐
9
Data Warehousing Made Easy with Google BigQuery and Apache Airflow
Cve 2022 40127
⭐
8
Apache Airflow < 2.4.0 DAG example_bash_operator RCE POC
Airflow_examples
⭐
8
Airflow Examples: code samples for Medium articles
Airflow Dag Status Manager Plugin
⭐
8
A plugin for Apache Airflow that manage 'is_active' and 'is_pause' for your DAG with web UI.
Redb Workflows
⭐
8
DAGs, Python Scripts, and SQL scripts for creating and updating the Saint Louis Regional Entity Database
30daysofairflow
⭐
7
30 Days of Airflow
Airflow Docker
⭐
6
Run Apache Airflow using Docker containers
Osm Wikidata Map Framework
⭐
6
Merge data from OpenStreetMap and Wikidata to map information about entities and points of interest (mirror of https://gitlab.com/openetymologymap/osm-wikidata-m )
Airflow
⭐
6
Dockerhub repo for Apache Airflow
Corrent
⭐
6
Corrent: Experimental Airflow functional DAG API
Airflow4ds
⭐
6
Using Apache Airflow to author, run and monitor complex data pipelines.
Airflow Elasticsearch Toolkit
⭐
5
In-house ElasticSearch toolkit for Airbnb/Apache Airflow
1-100 of 105 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.