Awesome Open Source

Programming Languages

Search results for python apache airflow

apache-airflow x

73 search results found

Airflow ⭐ 34,468

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

TFX is an end-to-end platform for deploying production ML pipelines

Elyra ⭐ 1,721

Elyra extends JupyterLab with an AI centric approach.

Airflow Maintenance Dags ⭐ 1,567

A series of DAGs/Workflows to help maintain the operation of Airflow

Dag Factory ⭐ 1,001

Dynamically generate Apache Airflow DAGs from YAML configuration files

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

Airflow Tutorial ⭐ 669

Apache Airflow tutorial

Goodreads_etl_pipeline ⭐ 593

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Data Pipelines With Apache Airflow ⭐ 587

Code for Data Pipelines with Apache Airflow

Astronomer ⭐ 454

Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes

Ethereum Etl Airflow ⭐ 378

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethe

Astronomer Cosmos ⭐ 368

Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

Airflow Code Editor ⭐ 347

A plugin for Apache Airflow that allows you to edit DAGs in browser

Astro Sdk ⭐ 303

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Airflow Client Python ⭐ 289

Apache Airflow - OpenApi Client for Python

Airflow Chart ⭐ 261

A Helm chart to install Apache Airflow on Kubernetes

Airflow Rest Api Plugin ⭐ 243

A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces

Paperboy ⭐ 231

A web frontend for scheduling Jupyter notebook reports

Airflow Scheduler Failover Controller ⭐ 220

A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability

Example Airflow Dags ⭐ 204

Example DAGs using hooks and operators from Airflow Plugins

Airflow_in_docker_compose ⭐ 182

Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)

Airflow_for_beginners ⭐ 166

Airflowctl ⭐ 128

A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

Astronomer Providers ⭐ 123

Airflow Providers containing Deferrable Operators & Sensors from Astronomer

Kedro Airflow ⭐ 120

Kedro-Airflow makes it easy to deploy Kedro projects to Airflow.

Airflow Extended Api Plugin ⭐ 108

Yet another Airflow plugin using CLI command as RESTful api, supports Airflow v2.X.

Viewflow ⭐ 84

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

Gerador de DAGs no Airflow para fazer clipping do Diário Oficial da União.

Ambari Airflow Mpack ⭐ 45

Ambari stack service for installing and managing Apache Airflow on HDP cluster

Airflow_api_plugin ⭐ 41

REST-like API exposing Airflow data and operations

Airflow Boilerplate ⭐ 40

A complete development environment setup for working with Airflow

Ml In Production ⭐ 39

The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.

PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows

Uber Expenses Tracking ⭐ 35

The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.

Aws Airflow Demo ⭐ 31

Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for Apache Airflow (MWAA) on AWS.

Fairflow ⭐ 29

Functional Airflow DAG definitions.

Airflow Provider Datarobot ⭐ 28

DataRobot provider for Apache Airflow

ADA is a microservice created to retrieve analytics metrics from an Airflow database instance.

Airflowscan ⭐ 26

Checklist and tools for increasing security of Apache Airflow

Airflow Jupyter Docker Compose ⭐ 24

Orchestration of data science and earth observation models in Apache Airflow, scale-up with Celery Executor, experiment with jupyter notebook using a docker containers composition

Data Pipeline ⭐ 23

Dataops Platform Airflow Dbt ⭐ 21

Build DataOps platform with Apache Airflow and dbt on AWS

Spark Movies Etl ⭐ 21

Spark data pipeline that ingests and transforms movie ratings data.

Doit Composer Airflow Training ⭐ 20

Getting started with Apache Airflow on Cloud Composer

Covid 19 Data Engineering Pipeline ⭐ 19

A Covid-19 data pipeline on AWS featuring PySpark/Glue, Docker, Great Expectations, Airflow, and Redshift, templated in CloudFormation and CDK, deployable via Github Actions.

Ansible Airflow ⭐ 18

Ansible role for the installation of Apache Airflow

Airflowetl ⭐ 16

Blog post on ETL pipelines with Airflow

Airflow Docker ⭐ 16

Apache Airflow Docker Image.

Airflow Studyclub ⭐ 16

Grupo de estudio Apache Airflow organizado por la comunidad Data Engineering Latam

Airflow Provider Fivetran Async ⭐ 15

A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran

Queenbee ⭐ 15

👑 Queenbee is a workflow language for creating workflows

Heroku_airflow ⭐ 14

Build for Apache Airflow running on Heroku

Data Pipelines With Airflow ⭐ 14

Skooldio: Data Pipelines with Airflow

Facebook_ads_plugin ⭐ 14

Airflow User Management Plugin ⭐ 13

A plugin for Apache Airflow that allows you to manage the users that can login

Astro Provider Databricks ⭐ 12

Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows

Salesforce_plugin ⭐ 12

Move Data From Salesforce -> S3 -> Redshift

Dbt On Airflow ⭐ 12

Social Media Analysis ⭐ 11

Social Media Analysis, scalable solution, flexible deployment that analyses social media contents

Github_plugin ⭐ 10

Apache Airflow Providers Transfers ⭐ 10

Airflow Fs ⭐ 10

Composable filesystem hooks and operators for Apache Airflow.

Astronomer Fab Securitymanager ⭐ 10

Security Manager for the Astronomer Airflow distribution

Airflow Dag Status Manager Plugin ⭐ 8

A plugin for Apache Airflow that manage 'is_active' and 'is_pause' for your DAG with web UI.

Airflow_examples ⭐ 8

Airflow Examples: code samples for Medium articles

30daysofairflow ⭐ 7

30 Days of Airflow

Corrent: Experimental Airflow functional DAG API

Osm Wikidata Map Framework ⭐ 6

Merge data from OpenStreetMap and Wikidata to map information about entities and points of interest (mirror of https://gitlab.com/openetymologymap/osm-wikidata-m )

Airflow Docker ⭐ 6

Run Apache Airflow using Docker containers

Airflow4ds ⭐ 6

Using Apache Airflow to author, run and monitor complex data pipelines.

Lyric_wave_architecture ⭐ 5

🎵 LyricWave - Your AI Music Composer 🎶 Compose Unique MP4 Songs Effortlessly! LyricWave uses AI to create personalized music by harmonizing lyrics with captivating melodies and synthetic vocals. Unleash your musical creativity today! 🚀🎶

Airflow Plus ⭐ 5

Facade over Apache Airflow with simple typed interface

Gcp Airflow Foundations ⭐ 5

Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

Related Searches

Python Machine Learning (20,195)

Python Dataset (14,792)

Python Docker (14,113)

Python Tensorflow (13,736)

Python Command Line (13,351)

Python Jupyter Notebook (12,976)

Python Plugin (9,225)

Python Amazon Web Services (7,953)

Python Pandas (6,193)

Python Twitter (5,263)

1-73 of 73 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.