Awesome Open Source

Programming Languages

Search results for google cloud platform airflow

google-cloud-platform x

3 search results found

Diagrams ⭐ 33,556

🎨 Diagram as Code for prototyping cloud system architectures

Energy Forecasting ⭐ 663

🌀 𝗧𝗵𝗲 𝗙𝘂𝗹𝗹 𝗦𝘁𝗮𝗰𝗸 𝟳-𝗦𝘁𝗲𝗽𝘀 𝗠𝗟𝗢𝗽𝘀 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 | 𝗟𝗲𝗮𝗿𝗻 𝗠𝗟𝗘 & 𝗠𝗟𝗢𝗽𝘀 for free by designing, building and deploying an end-to-end ML batch system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 2.5 𝘩𝘰𝘶𝘳𝘴 𝘰𝘧 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 & 𝘷𝘪𝘥𝘦𝘰 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴

Ethereum Etl Airflow ⭐ 378

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethe

Starthinker ⭐ 156

Reference framework for building data workflows provided by Google. Accelerates authentication, logging, scheduling, and deployment of solutions using GCP. To borrow a tagline.. "The framework for professionals with deadlines."

Public Datasets Pipelines ⭐ 131

Cloud-native, data onboarding architecture for Google Cloud Datasets

Airflow Gcp Examples ⭐ 129

Repository with examples and smoke tests for the GCP Airflow operators and hooks

Cortex Data Foundation ⭐ 129

Data Foundation - Google Cloud Cortex Framework

Airflow Toolkit ⭐ 101

Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested data pipelines(DAGs) 🖥️ >> [ 🚀, 🚢 ]

Streamify ⭐ 97

A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!

Polygon Etl ⭐ 93

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Final Project Level3 Recsys 01 ⭐ 81

🍁 AI를 활용한 메이플스토리 코디 추천 서비스👚👕

Airflow Gcp K8s ⭐ 56

Orchestra ⭐ 36

Advertising Data Lakes and Workflow Automation

Cloud Data Lake ⭐ 34

Data lake, data warehouse on GCP

End-to-end DataOps platform deployed by Terraform.

Debussy_concert ⭐ 29

Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and pipelines.

Final Project Level3 Recsys 06 ⭐ 18

🔥 당신을 추천하는 가장 좋은 방법 RecommendU @boostcampaitech4

Airflow Rbac Roles Cli ⭐ 12

A tool to create Airflow RBAC roles with dag-level permissions from cli.

ShopME: An E2E fashion recommendation System

Big Data Systems Intelligence Analytics Labs Summer 2022 ⭐ 10

Labs for Big Data and Intelligent Analytics

Apache Airflow Providers Transfers ⭐ 10

Airflow Kubernetes ⭐ 9

Simple Airflow on Kubernetes (GKE)

Custom business logic for Search Ads 360

Airflow Gcp Spy ⭐ 7

An Airflow demo DAG that fetches lists of running instances from different GCP services and sends them to a Slack channel and via e-mail.

Reddit Data Engineering ⭐ 7

An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit

Composer_gcf ⭐ 6

Calling Cloud Composer > GCF > Composer securely

Tfl Bikes Data Pipeline ⭐ 6

Processing TFL data for bike usage with Google Cloud Platform.

Gcp_cloudsql_airflow_bigquery ⭐ 6

Example on how to export from cloud sql into bigquery, using airflow

Steam Data Engineering ⭐ 5

A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!

Glowing Octo Enigma ⭐ 5

Everything you need to get started with developing on Airflow. This means sample Airflow DAGs and operators plus Terraform code to deploy a Cloud Composer environment on GCP, a deploy script you could hook into a CD pipeline, bundled documentation and sample tests.

Global Data Pipeline ⭐ 5

Code Repository for my 3rd Data Project.

Related Searches

Python Google Cloud Platform (1,267)

Python Airflow (646)

1-3 of 3 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.