Awesome Open Source

Programming Languages

Search results for etl bigquery

37 search results found

Airbyte ⭐ 12,918

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Doris ⭐ 11,243

Apache Doris is an easy-to-use, high performance and unified analytics database.

Cloudquery ⭐ 5,380

The open source high performance data integration platform built for developers.

Rudder Server ⭐ 3,841

Privacy and Security focused Segment-alternative, in Golang and React

Peerdb ⭐ 1,315

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

Dataform ⭐ 757

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

Optimus ⭐ 707

Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.

Awesome Bigquery Views ⭐ 322

Useful SQL queries for Blockchain ETL datasets in BigQuery.

Astro Sdk ⭐ 303

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Bigquery Etl ⭐ 216

Dbt Coves ⭐ 193

CLI tool for dbt users to simplify creation of staging models (yml and sql) files

Mara Example Project 2 ⭐ 174

An example mini data warehouse for python project stats, template for new projects

Airbyte_serverless ⭐ 83

Airbyte made simple (no UI, no database, no cluster)

Rocket Bi ⭐ 79

A free, open-source, web-based self-service BI tailor-made for clickhouse, google bigquery, mysql, postgresql, vertica

Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.

Bigquery Etl Dataflow Sample ⭐ 62

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Google Cloud Platform, AWS, Kubernetes, Databases, SFTP servers, On-Prem Systems and more.

Blockchain Etl Architecture ⭐ 36

Blockchain ETL Architecture

Blast is a data orchestration tool that can run SQL and Python against Google BigQuery and Snowflake. It supports templating with Jinja, data quality tests, query validation, environment management and more.

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

Starlake ⭐ 29

Starlake is an On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

Go Bqloader ⭐ 21

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

M-Lab ingestion pipeline

Bigquery Kafka Connect ⭐ 17

☁️ nodejs kafka connect connector for Google BigQuery

Automated_etl_google_cloud Social_dashboard ⭐ 15

A dashboard is worth a thousand words => https://datastudio.google.com/reporting/755f3183-d

Data Pipeline from the Global Historical Climatology Network DataSet

Dbt_datawaves ⭐ 13

Datawaves data models for Ethereum built using dbt

Bigquery To Pubsub ⭐ 13

A tool for streaming time series data from a BigQuery table to a Pub/Sub topic

Tezos Etl ⭐ 12

Python scripts for ETL (extract, transform and load) jobs for Tezos blocks, balance updates, and operations

Social Media Analysis ⭐ 11

Social Media Analysis, scalable solution, flexible deployment that analyses social media contents

Data Pipeline With Dbt Using Airflow On Gcp ⭐ 10

This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.

Hedera Etl ⭐ 8

ETL scripts for Hedera Hashgraph

Bigquery Sqlalchemy Tutorial ⭐ 7

📊 ➡️ 💾 ETL script to migrate data from BigQuery to SQL.

Datapipeline ⭐ 6

Analysing_world_news_with_gdelt ⭐ 5

I'm a curious person and analysing world news is fun. Here you can find all my Gdelt-related projects. It is worth mentioning the automated Google Cloud ETL with Python and BigQuery SQL

Doris Sdk ⭐ 5

SDK for Apache Doris

Code for ETL data pipelines

Related Searches

Python Etl (814)

1-37 of 37 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.