Awesome Open Source

Programming Languages

Search results for kubernetes airflow

49 search results found

Argo Workflows ⭐ 14,264

Workflow Engine for Kubernetes

Pipeline ⭐ 4,158

Orchest ⭐ 3,876

Build data pipelines, the easy way 🛠️

Awesome Apache Airflow ⭐ 3,468

Curated list of resources about Apache Airflow

Ploomber ⭐ 3,318

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

The User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, it has since helped thousands of companies create production-ready deployments of Airflow on Kubernetes.

Kube Airflow ⭐ 556

A docker image and kubernetes config files to run Airflow on Kubernetes

Astronomer ⭐ 454

Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

Airflow Chart ⭐ 261

A Helm chart to install Apache Airflow on Kubernetes

Airflow Operator ⭐ 241

Kubernetes custom controller and CRDs to managing Airflow

Paperboy ⭐ 231

A web frontend for scheduling Jupyter notebook reports

Dataplane ⭐ 171

Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.

Airflow Kube Helm ⭐ 120

Airflow On Kubernetes ⭐ 119

A guide to running Airflow on Kubernetes

Airflow Toolkit ⭐ 101

Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) 🖥️ >> [ 🚀, 🚢 ]

Ap Airflow ⭐ 100

Astronomer Core Docker Images

Airflow Gcp K8s ⭐ 56

Kubernetesjoboperator ⭐ 54

An airflow operator that executes a task in a kubernetes cluster, given a kubernetes yaml configuration or an image refrence.

A distributed workflow runner focusing on performance and simplicity.

User friendly and open source platform for workflow creation and monitoring

Soopervisor ⭐ 42

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.

A Python package for building helm charts and Kubernetes templates in an object oriented fashion

Blockchain Etl Architecture ⭐ 36

Blockchain ETL Architecture

Airflow Kube Setup ⭐ 35

How to deploy airflow on Kubernetes

Airflow Gke K8sexecutor Helm ⭐ 33

Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are instructions for docker-for-mac.

Stellar Etl Airflow ⭐ 31

Airflow DAGs for the Stellar ETL project

Kedro Airflow K8s ⭐ 29

Kedro Plugin to support running pipelines on Kubernetes using Airflow.

Scalable Airflow Template ⭐ 28

fast and scalable Airflow on Kubernetes Setup.

Data Pipeline ⭐ 23

Airflow On K8s Operator ⭐ 22

Airflow on Kubernetes Operator

Clean Pods ⭐ 22

Kubernetes: Clean pods older than X days

Airflow Gke ⭐ 20

Setting up Apache Airflow on GKE

Airflow Chart ⭐ 20

Helm chart for deploying Apache Airflow in kubernetes

Airflow On Kubernetes ⭐ 18

Bare minimal Airflow on Kubernetes (Local, EKS, AKS)

A scalable, declarative, low-code framework for real-time and batch feature calculation/management (quant finance, anomaly/fraud detection, etc.), predictive ML training/inference and simulation. Built on top of Ray

Minikube for big data with Scala and Spark

Community ⭐ 13

README for Rekcurd projects

Security Token Analytics ⭐ 12

Blockchain data pipeline using Airflow, Kubernetes, Redshift, and Grafana

Labtools K8s ⭐ 10

Complete data engineering pipeline running on Minikube Kubernetes, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, Airflow, Kafka Strimzi, Datahub, Zeppelin, Jupyter

This repository aims to help you have an Airflow installation running in Kubernetes minikube.

Airflow Kubernetes ⭐ 9

Simple Airflow on Kubernetes (GKE)

Cassandra.lunch ⭐ 9

Resources from weekly Zoom lunches revolving around Apache Cassandra and Apache Cassandra-related topics. Hosted by Anant Corporation.

Devops Mlops ⭐ 8

Tools for DevOps and MLOps. Materials and projects. New technologies and infrastructure review.

Airflow On K8s ⭐ 7

Operates Apache airflow on k8s

This is an ETL application on AWS with general open sales and customer data that you can find here: https://github.com/camposvinicius/data/blob/main/A it's a zipped file with some .csvs inside that we will apply transformations.

My personal notes on different topics I'm studying

Kubernetes Airflow ⭐ 6

Setup Apache Airflow on Kubernetes

Airflow On Openshift ⭐ 5

Deploy Airflow onto OpenShift with Helm

Airflow Dags ⭐ 5

Example_kubernetes_pod ⭐ 5

Running the KubernetesPodOperator on Airflow 1.9

Airflow Aws ⭐ 5

Run Airflow locally or on AWS in Kubernetes

Related Searches

Golang Kubernetes (7,229)

Python Kubernetes (2,479)

Docker Kubernetes (2,389)

Deployment Kubernetes (2,265)

Cloud Computing Kubernetes (1,664)

Amazon Web Services Kubernetes (1,645)

Kubernetes Kubectl (1,587)

Shell Kubernetes (1,485)

Javascript Kubernetes (1,455)

Java Kubernetes (1,320)

1-49 of 49 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.