Airflow Tutorial
Tutorial like code for how to deploy airflow using docker and how to use the DockerOperator.
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Pipeline | 4,159 | a year ago | 85 | July 18, 2017 | 1 | apache-2.0 | Jsonnet | |||
| PipelineAI Kubeflow Distribution | ||||||||||
| Orchest | 3,876 | 4 months ago | 19 | December 13, 2022 | 125 | apache-2.0 | TypeScript | |||
| Build data pipelines, the easy way 🛠️ | ||||||||||
| Docker Airflow | 3,589 | 8 months ago | 269 | apache-2.0 | Shell | |||||
| Docker Apache Airflow | ||||||||||
| Awesome Apache Airflow | 3,060 | a year ago | 2 | Shell | ||||||
| Curated list of resources about Apache Airflow | ||||||||||
| Elyra | 1,652 |  | 14 | a month ago | 111 | March 29, 2023 | 268 | apache-2.0 | Python | |
| Elyra extends JupyterLab with an AI centric approach. | ||||||||||
| Airflow Tutorial | 669 | 2 years ago | 18 | mit | Jupyter Notebook | |||||
| Apache Airflow tutorial | ||||||||||
| Kube Airflow | 556 | 4 years ago | 30 | apache-2.0 | Python | |||||
| A docker image and kubernetes config files to run Airflow on Kubernetes | ||||||||||
| Data Pipelines With Apache Airflow | 503 | 4 months ago | 35 | other | Python | |||||
| Code for Data Pipelines with Apache Airflow | ||||||||||
| Energy Forecasting | 490 | 13 days ago | mit | Python | ||||||
| 🌀 𝗧𝗵𝗲 𝗙𝘂𝗹𝗹 𝗦𝘁𝗮𝗰𝗸 𝟳-𝗦𝘁𝗲𝗽𝘀 𝗠𝗟𝗢𝗽𝘀 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 | Learn MLE & MLOps for free by designing, building and deploying an end-to-end ML batch system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 2.5 𝘩𝘰𝘶𝘳𝘴 𝘰𝘧 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 & 𝘷𝘪𝘥𝘦𝘰 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴 | ||||||||||
| Astronomer | 449 | 2 days ago | 21 | other | Python | |||||
| Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes | ||||||||||
Alternatives To Airflow TutorialSelect To Compare
Alternative Project Comparisons
Readme
airflow-tutorial
Tutorial code for how to deploy airflow using docker and how to use the DockerOperator.
To run the example, you first have to build the image in etl-dummy. Just do
docker build -t etl-dummy ./etl-dummy
Now, you can start the Airflow instance using
docker-compose up
This should build the airflow image when you execute it the first time and also starts the airflow server. Now you should be ready to go a play around with it.
For further details, refer to my medium article.
Popular Docker Projects
Popular Airflow Projects
Popular Virtualization Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Docker
Deploy
Tutorial
Etl
Airflow