Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for airflow data pipeline
airflow
x
data-pipeline
x
11 search results found
Airflow
⭐
34,299
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Dolphinscheduler
⭐
11,613
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
Orchest
⭐
3,876
Build data pipelines, the easy way 🛠️
Data Engineering Howto
⭐
2,949
A list of useful resources to learn Data Engineering from scratch
Optimus
⭐
707
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Dataengineeringproject
⭐
644
Example end to end data engineering project.
Gusty
⭐
202
Making DAG construction easier
Dataplane
⭐
171
Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
Public Datasets Pipelines
⭐
131
Cloud-native, data onboarding architecture for Google Cloud Datasets
Udacity Data Eng Proj 1
⭐
81
Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation, validation and loading of data from S3 -> Redshift -> S3
Ml In Production
⭐
39
The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.
Debussy_concert
⭐
29
Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and pipelines.
Jobanalytics_and_search
⭐
22
JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.
Airflowetl
⭐
16
Blog post on ETL pipelines with Airflow
Airflowdatapipeline
⭐
15
Example of an ETL Pipeline using Airflow
Opentrials Airflow
⭐
15
Configuration and definitions of Airflow for OpenTrials
Greatex
⭐
10
A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in Airflow.
Twitter Pipeline
⭐
9
In this project, you will be building a Twitter Scheduler using Apache Airflow on Docker.
Airflow Kubernetes
⭐
9
Simple Airflow on Kubernetes (GKE)
Airflow4ds
⭐
6
Using Apache Airflow to author, run and monitor complex data pipelines.
Analytics_data_where_house
⭐
5
An analytics engineering sandbox focusing on real estates prices in Cook County, IL
Udacity Data Engineering Nanodegree
⭐
5
This is a repository to hold the files and notebooks produced throughout my Udacity's Nanodegree Data Engineering program.
Gcp Airflow Foundations
⭐
5
Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse
Providence
⭐
5
Apply Data Engineering to Personal Finance
1-11 of 11 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.