Airflow Tutorial
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Airflow Tutorial | 669 | 2 years ago | 18 | mit | Jupyter Notebook | |||||
| Apache Airflow tutorial | ||||||||||
| Airflow Tutorial | 345 | 2 years ago | 2 | mit | ||||||
| Airflow basics tutorial | ||||||||||
| Airflow Docker | 120 | 4 months ago | 2 | Python | ||||||
| Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j) | ||||||||||
| Airflow Tutorial | 86 | 3 years ago | 1 | apache-2.0 | PLpgSQL | |||||
| Use Airflow to move data from multiple MySQL databases to BigQuery | ||||||||||
| Airflow Tutorial | 51 | 3 years ago | 3 | cc-by-4.0 | Python | |||||
| 🐍💨 Airflow tutorial for PyCon 2019 | ||||||||||
| Airflow Tutorial | 19 | 4 years ago | Python | |||||||
| Tutorial like code for how to deploy airflow using docker and how to use the DockerOperator. | ||||||||||
| Opendata Airflow Tutorial | 9 | 4 years ago | bsd-3-clause | Jupyter Notebook | ||||||
| Tutorials on airflow pipelines with open data sets | ||||||||||
| 30daysofairflow | 7 | 4 years ago | Python | |||||||
| 30 Days of Airflow | ||||||||||
| Airflow Tutorial | 5 | 3 years ago | Python | |||||||
| Awesome Data Science And Engineering | 4 | 4 years ago | mit | |||||||
| A curated list of Data Science and Engineering frameworks, tools, libraries and related list of tutorials. | ||||||||||
Alternatives To Airflow TutorialSelect To Compare
Alternative Project Comparisons
Readme
Airflow Tutorial
This repo contains the materials for the pipelines tutorial on Pycon -> from scripts soups to Airflow.
The tutorial covers:
- Setting up local databases
- Creating basic ETL pipelines in Python: query APIs, load data to databases, perform data cleaning and filtering and persist the consumption ready data
- How to set a local instance of Airflow and get it running
- Creating basic DAGS in Airflow
- Transform script soups ETLS into Airflow dags
- Set up an Airflow instance in Azure
To add:
- Setting a Kubernetes powered instance on Azure AKS
- Adding CI/CD to using Azure pipelines
If you are interested in following along visit: https://airflow-tutorial.readthedocs.io/en/latest/
The setup instructions can be found at: https://airflow-tutorial.readthedocs.io/en/latest/setup.html
If you would like to experiment with Azure follow this link to get a free trial subscription with 150 dollars.
🚀 PRs and Issues are welcome
License
This repo is licensed using a CC-BY so you are free to use, remix, and share so long attribution is provided to the original author.
Popular Tutorials Projects
Popular Airflow Projects
Popular Learning Resources Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Databases
Tutorial
Azure
Pipeline
Dag
Airflow