Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for bigquery airflow
airflow
x
bigquery
x
31 search results found
Optimus
⭐
707
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Ethereum Etl Airflow
⭐
378
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethe
Astro Sdk
⭐
303
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
Starthinker
⭐
156
Reference framework for building data workflows provided by Google. Accelerates authentication, logging, scheduling, and deployment of solutions using GCP. To borrow a tagline.. "The framework for professionals with deadlines."
Tensorflow Lifetime Value
⭐
140
Predict customer lifetime value using AutoML Tables, or ML Engine with a TensorFlow neural network and the Lifetimes Python library.
Public Datasets Pipelines
⭐
131
Cloud-native, data onboarding architecture for Google Cloud Datasets
Cortex Data Foundation
⭐
129
Data Foundation - Google Cloud Cortex Framework
Tensorflow Recommendation Wals
⭐
126
An end-to-end solution for website article recommendations based on Google Analytics data. Uses WALS matrix-factorization in TensorFlow, trained on Cloud ML Engine. Recommendations served with App Engine Flex and Cloud Endpoints. Orchestration is performed using Airflow on Cloud Composer. See the solution tutorials at:
Polygon Etl
⭐
93
ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub
Airflow Tutorial
⭐
86
Use Airflow to move data from multiple MySQL databases to BigQuery
Final Project Level3 Recsys 01
⭐
81
🍁 AI를 활용한 메이플스토리 코디 추천 서비스👚👕
Alphasql
⭐
39
AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery
Blockchain Etl Architecture
⭐
36
Blockchain ETL Architecture
Grizzly
⭐
34
End-to-end DataOps platform deployed by Terraform.
Cloud Data Lake
⭐
34
Data lake, data warehouse on GCP
Debussy_concert
⭐
29
Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and pipelines.
Data Pipeline
⭐
23
Driblet
⭐
20
Health Equity Tracker
⭐
15
Health Equity Tracker is a free-to-use data visualization platform that is enabling new insights into the impact of COVID-19 and other social and political determinants of health on historically underrepresented groups in the United States.
Ghcn D
⭐
14
Data Pipeline from the Global Historical Climatology Network DataSet
Dbt On Airflow
⭐
12
Data Pipeline With Dbt Using Airflow On Gcp
⭐
10
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
Google Airflow Premier League
⭐
9
Data Warehousing Made Easy with Google BigQuery and Apache Airflow
Data Rivers
⭐
9
Apache Airflow and Beam ETL scripts for the City of Pittsburgh's data analysis pipelines
Burnham
⭐
8
Automated end-to-end testing for Mozilla's Glean telemetry. 👩🚀
Reddit Data Engineering
⭐
7
An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit
Airflow Salesforce
⭐
7
Airflow-Salesforce connector
Fastcampus Machine Learning Project
⭐
6
Gcp_cloudsql_airflow_bigquery
⭐
6
Example on how to export from cloud sql into bigquery, using airflow
Steam Data Engineering
⭐
5
A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!
Gcp Airflow Foundations
⭐
5
Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse
1-31 of 31 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.