Airflow Tutorial

Alternatives To Airflow Tutorial
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Airflow Tutorial669
a year ago18mitJupyter Notebook
Apache Airflow tutorial
Airflow Tutorial345
2 years ago2mit
Airflow basics tutorial
Airflow Tutorial86
3 years ago1apache-2.0PLpgSQL
Use Airflow to move data from multiple MySQL databases to BigQuery
Airflow Tutorial51
2 years ago3cc-by-4.0Python
🐍💨 Airflow tutorial for PyCon 2019
Airflow Docker49
7 months agoPython
Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (
Airflow Tutorial19
3 years agoPython
Tutorial like code for how to deploy airflow using docker and how to use the DockerOperator.
Opendata Airflow Tutorial9
4 years agobsd-3-clauseJupyter Notebook
Tutorials on airflow pipelines with open data sets
4 years agoPython
30 Days of Airflow
Airflow Tutorial5
2 years agoPython
Awesome Data Science And Engineering4
4 years agomit
A curated list of Data Science and Engineering frameworks, tools, libraries and related list of tutorials.
Alternatives To Airflow Tutorial
Select To Compare

Alternative Project Comparisons

Airflow tutorial

This is the code for Apache Airflow Tutorials playlist by Tuan Vu on Youtube


Part Title Git Tag
1 Introduction to Apache Airflow (blog post) v0.1
2 Set up airflow environment with docker (blog post) v0.2
3 Set up airflow environment using Google Cloud Composer (blog post) N/A
4 Writing your first pipeline (blog post) N/A
5 Airflow concept (blog post) N/A
6 Build a data pipeline using Google Cloud Bigquery (blog post) v0.6
7 Airflow variables (blog post) v0.7

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.



Run the web service with docker

docker-compose up -d

# Build the image
# docker-compose up -d --build

Check http://localhost:8080/

  • docker-compose logs - Displays log output
  • docker-compose ps - List containers
  • docker-compose down - Stop containers

Other commands

If you want to run airflow sub-commands, you can do so like this:

  • docker-compose run --rm webserver airflow list_dags - List dags
  • docker-compose run --rm webserver airflow test [DAG_ID] [TASK_ID] [EXECUTION_DATE] - Test specific task

If you want to run/test python script, you can do so like this:

  • docker-compose run --rm webserver python /usr/local/airflow/dags/[PYTHON-FILE].py - Test python script

Connect to database

If you want to use Ad hoc query, make sure you've configured connections: Go to Admin -> Connections and Edit "postgres_default" set this values:

  • Host : postgres
  • Schema : airflow
  • Login : airflow
  • Password : airflow


Popular Tutorials Projects
Popular Airflow Projects
Popular Learning Resources Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Jupyter Notebook