Awesome Open Source
Awesome Open Source
Combined Topics
bigquery
x
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
The Top 366 Bigquery Open Source Projects on Github
Categories
>
Data Processing
>
Bigquery
Graphql Engine
⭐
24,227
Blazing fast, instant realtime GraphQL APIs on your DB with fine grained access control, also trigger webhooks on database events.
Redash
⭐
19,724
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
Cube.js
⭐
11,276
📊 Cube.js — Open-Source Analytics API for Building Data Apps
Sqlpad
⭐
3,982
Web-based SQL editor run in your own private cloud. Supports MySQL, Postgres, SQL Server, Vertica, Crate, ClickHouse, Trino, Presto, SAP HANA, Cassandra, Snowflake, BigQuery, SQLite, and more with ODBC
Franchise
⭐
3,797
🍟 a notebook sql client. what you get when have a lot of sequels.
Scio
⭐
2,212
A Scala API for Apache Beam and Google Cloud Dataflow.
Professional Services
⭐
1,870
Common solutions and tools developed by Google Cloud's Professional Services team
Growthbook
⭐
1,634
The Open Source A/B Testing Platform
Jitsu
⭐
1,461
Jitsu is an open-source data collection platform
Logica
⭐
1,312
Logica is a logic programming language that compiles to StandardSQL and runs on Google BigQuery.
Ethereum Etl
⭐
1,215
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Tbls
⭐
1,159
tbls is a CI-Friendly tool for document a database, written in Go.
Dataflowtemplates
⭐
742
Google-provided Cloud Dataflow template pipelines for solving simple in-Cloud data tasks
Githut
⭐
580
Github Language Statistics
Optimus
⭐
548
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Bigquery Utils
⭐
474
Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.
Bigrquery
⭐
453
An interface to Google's BigQuery from R.
Almanac.httparchive.org
⭐
385
HTTP Archive's annual "State of the Web" report made by the web community
Bigquery Python
⭐
380
Simple Python client for interacting with Google BigQuery.
Nodejs Bigquery
⭐
326
Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.
Pypinfo
⭐
310
Easily view PyPI download statistics via Google's BigQuery.
Issue Label Bot
⭐
299
Code For The Issue Label Bot, an App that automatically labels issues using machine learning, available on the GitHub Marketplace. This is also code for the blog article: "How to automate tasks on GitHub with machine learning for fun and profit"
Ratatool
⭐
296
A tool for data sampling, data generation, and data diffing
Python Bigquery Pandas
⭐
275
Pandas Google BigQuery
Mlcraft
⭐
275
Low-code metrics store, modern open-source alternative to Looker
Mais
⭐
239
Código de tratamento e infraestrutura do datalake público BD+ | 📖 Docs: https://basedosdados.github.io/mais/
Hadoop Connectors
⭐
235
Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
Quix
⭐
232
Quix Notebook Manager
Mprove
⭐
222
Open Source Business Intelligence 🎉
Bigquery Grafana
⭐
219
Google BigQuery Datasource Plugin for Grafana.
Bitcoin Etl
⭐
212
ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
Geomancer
⭐
194
Automated feature engineering for geospatial data
Tellery
⭐
191
Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.
Spark Bigquery Connector
⭐
169
BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
Mara Example Project 2
⭐
157
An example mini data warehouse for python project stats, template for new projects
Gpt2 Bert Reddit Bot
⭐
149
a bot that generates realistic replies using a combination of pretrained GPT-2 and BERT models
Beast
⭐
147
[Deprecated] Load data from Kafka to any data warehouse. BQ sink is being supported in Firehose now.
Ethereum Etl Airflow
⭐
145
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee
Bigquery Schema Generator
⭐
142
Generates the BigQuery schema from newline-delimited JSON or CSV data records.
Go Bqstreamer
⭐
133
Stream data into Google BigQuery concurrently using InsertAll()
Elementary Lineage
⭐
121
Elementary is an open-source data observability framework for modern data teams, starting with data lineage.
Cueobserve
⭐
120
Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases
Sql Scripts
⭐
115
100+ SQL Scripts - PostgreSQL, MySQL, Google BigQuery, MariaDB, AWS Athena. DevOps / DBA / Analytics / performance engineering. Google BigQuery ML machine learning classification.
Magnolify
⭐
112
A collection of Magnolia add-on modules
Gcp Variant Transforms
⭐
110
GCP Variant Transforms
Gcp Essentials
⭐
109
Example gcloud statements for GCP services
Carto Spatial Extension
⭐
109
A set of UDFs and Procedures to extend BigQuery and Snowflake with Spatial Analytics capabilities
Embulk Output Bigquery
⭐
108
Embulk output plugin to load/insert data into Google BigQuery
Pre Commit Dbt
⭐
104
🎣 List of `pre-commit` hooks to ensure the quality of your `dbt` projects.
Airflow Tutorial
⭐
86
Use Airflow to move data from multiple MySQL databases to BigQuery
Dekart
⭐
84
Write BigQuery SQL and get beautiful, shareable Maps based on Kepler.gl
Bigflow
⭐
76
A Python framework for data processing on GCP.
Circus Train
⭐
75
Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.
Sql Runner
⭐
68
Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake
Linq To Bigquery
⭐
67
LINQ to BigQuery is C# LINQ Provider for Google BigQuery. It also enables Desktop GUI Client with LINQPad and plug-in driver.
Bigquery View Analyzer
⭐
66
CLI tool for managing + visualising BigQuery authorised views
Shapeless Datatype
⭐
65
Shapeless utilities for common data types
Spark Bigquery
⭐
65
Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
Vscode Bigquery
⭐
64
A Visual Studio Code plugin for running BigQuery queries.
Public Datasets Pipelines
⭐
61
Cloud-native, data onboarding architecture for Google Cloud Datasets
Dbt Ml Preprocessing
⭐
61
A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.
Ddlparse
⭐
58
DDL parase and Convert to BigQuery JSON schema and DDL statements
Datashare Toolkit
⭐
57
DIY commercial datasets on Google Cloud Platform
Bigquery Data Lineage
⭐
54
Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.
Bigquery
⭐
54
BigQuery import and processing pipelines
Bigquery_fdw
⭐
50
BigQuery Foreign Data Wrapper for PostgreSQL
Dlp Dataflow Deidentification
⭐
50
Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP
Bigquery To Datastore
⭐
47
Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow
Bigtsquery
⭐
44
Search Engine for TypeScript Code using AST Queries
Gcp Census
⭐
41
GAE python based app which regularly collects information about GCP resources and stores them in BigQuery
Weather Station Gcp Mongoose Os
⭐
40
A Weather station made with an ESP32, sending data through Google Cloud IoT Core and storing in BigQuery
Github Activity Counter
⭐
37
Cloud Run service for GitHub event Webhook to monitor repo or org activity in real-time in Stackdriver and analyze activity through ad-hoc SQL queries in BigQuery
Coolretailer
⭐
35
Microservices with Istio, gRPC, Redis, BigQuery, Spring Boot, Spring Cloud and Stackdriver
Bigquery Geo Viz
⭐
35
Visualize Google BigQuery geospatial data using Google Maps Platform APIs
Awesome Bigquery Views
⭐
35
Useful SQL queries for Blockchain ETL datasets in BigQuery.
Bigqueryr
⭐
35
R Interface with Google BigQuery
Etlflow
⭐
34
Functional, Composable library in Scala based on ZIO for writing ETL jobs in AWS and GCP
Dune Snippets
⭐
34
dune snippets is a collection of sql queries for duneanalytics.com / Google BigQuery
Ob_google Bigquery
⭐
34
This service is meant to simplify running Google Cloud operations, especially BigQuery tasks. This means you do not have to worry about installation, configuration or ongoing maintenance related to an SDK environment. This can be helpful to those who would prefer to not to be responsible for those activities.
Megalista
⭐
33
First Party data integration solution built for marketing teams to enable audience and conversion onboarding into Google Marketing products (Google Ads, Campaign Manager, Google Analytics).
Bbq
⭐
33
Create backups of BigQuery datasets/tables
Managed_ml_systems_and_iot
⭐
32
Managed Machine Learning Systems and Internet of Things Live Lesson
Alphasql
⭐
30
AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery
Pg2bq
⭐
30
Export PostgreSQL tables to Google BigQuery
Pgsink
⭐
30
Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)
Flight2bq
⭐
28
RTLSDR ADS-B dump1090 to Google BigQuery
Gcp Ml
⭐
27
Google Cloud Platform Machine Learning Samples
Google Cloud
⭐
25
A collection of Google Cloud Platform (GCP) plugins
Data Models
⭐
25
Snowplow offically-supported SQL data models for working with Snowplow web and mobile behavioral data. Supports Redshift, Snowflake and BigQuery.
Spark On K8s Gcp Examples
⭐
24
Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub
Ostelco Core
⭐
24
Cloud-native Telco BSS hosted in GCP K8s with standalone Diameter to gRPC gateway. Rule Engine using Neo4j graphs. Analytics Events sent to GCP BigData (Dataflow+BigQuery) via PubSub. It's awesome!
Gsc Logger
⭐
24
Google Search Console Logger for Google App Engine
Team Timesheets
⭐
24
Time tracking web app built as a replacement for old school timesheets.
Bqv
⭐
23
The simplest tool to manage views of BigQuery.
Public Datasets
⭐
21
The list of public blockchain datasets in BigQuery
Amplitude Bigquery
⭐
21
Export your events from Amplitude to Google BigQuery/Google Cloud Storage
Firestore To Bigquery Export
⭐
20
NPM package for copying and converting Cloud Firestore data to BigQuery.
Datastore Mapper
⭐
20
Appengine Datastore Mapper in Go
Datastore2bigquery
⭐
20
Export Google Datastore to BigQuery
Prometheus Bigquery Exporter
⭐
20
An exporter for converting BigQuery results into Prometheus metrics
1-100 of 366 projects
Next >
Related Projects
Python Bigquery Projects (116)
Sql Bigquery Projects (57)
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.
