Awesome Open Source

Programming Languages

Search results for bigquery

721 search results found

WebGL-powered map visualizations for modern Data Platform. Self-hosted alternative to CARTO and Foursquare Studio.

Dbt Ml Preprocessing ⭐ 162

A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

Velocity ⭐ 160

🚅Track development velocity

Encrypted Bigquery Client ⭐ 156

An experimental version of the BQ client which adds client-side encryption

Starthinker ⭐ 156

Reference framework for building data workflows provided by Google. Accelerates authentication, logging, scheduling, and deployment of solutions using GCP. To borrow a tagline.. "The framework for professionals with deadlines."

Terraform Google Bigquery ⭐ 155

Creates opinionated BigQuery datasets and tables

Magnolify ⭐ 155

A collection of Magnolia add-on modules

Kafka Connect Bigquery ⭐ 151

DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigq A Kafka Connect BigQuery sink connector

Spark Bigquery ⭐ 149

Google BigQuery support for Spark, SQL, and DataFrames

Gpt2 Bert Reddit Bot ⭐ 149

a bot that generates realistic replies using a combination of pretrained GPT-2 and BERT models

Keras Serving ⭐ 147

bring keras-models to production with tensorflow-serving and nodejs + docker 🍕

Simple Ddl Parser ⭐ 147

Simple DDL Parser to parse SQL (HQL, TSQL, AWS Redshift, BigQuery, Snowflake and other dialects) ddl files to json/python dict with full information about columns: types, defaults, primary keys, etc. & table properties, types, domains, etc.

[Deprecated] Load data from Kafka to any data warehouse. BQ sink is being supported in Firehose now. https://github.com/odpf/firehose

Cueobserve ⭐ 144

Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases

Analytics Componentized Patterns ⭐ 142

Tensorflow Lifetime Value ⭐ 140

Predict customer lifetime value using AutoML Tables, or ML Engine with a TensorFlow neural network and the Lifetimes Python library.

Benchmark ⭐ 139

Benchmark data warehouses under Fivetran-like conditions

A collection of tools for mining government data

Go Bqstreamer ⭐ 133

Stream data into Google BigQuery concurrently using InsertAll()

Readthedocs ⭐ 133

Documentation for the Google Genomics cookbook.

Bigquery Data Lineage ⭐ 132

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

Public Datasets Pipelines ⭐ 131

Cloud-native, data onboarding architecture for Google Cloud Datasets

Twitter For Bigquery ⭐ 130

Simplest way to get Tweets into BigQuery. Uses Google Cloud & App Engine, as well as Python and D3.

Cortex Data Foundation ⭐ 129

Data Foundation - Google Cloud Cortex Framework

Tensorflow Recommendation Wals ⭐ 126

An end-to-end solution for website article recommendations based on Google Analytics data. Uses WALS matrix-factorization in TensorFlow, trained on Cloud ML Engine. Recommendations served with App Engine Flex and Cloud Endpoints. Orchestration is performed using Airflow on Cloud Composer. See the solution tutorials at:

Cloud Build Notifiers ⭐ 123

Notifier images for Cloud Build, complete with build status filtering and Google Secret Manager integration

Embulk Output Bigquery ⭐ 122

Embulk output plugin to load/insert data into Google BigQuery

Tinyquery ⭐ 119

A Python in-memory test stub for BigQuery

Bigquery Ml Templates ⭐ 116

BigQuery ML SQL templates for common marketing use cases

Gcp Variant Transforms ⭐ 114

GCP Variant Transforms

Dune Snippets ⭐ 112

dune snippets is a collection of sql queries for duneanalytics.com / Google BigQuery

Python Bigquery Dataframes ⭐ 112

BigQuery DataFrames

Megalista ⭐ 109

First Party data integration solution built for marketing teams to enable audience and conversion onboarding into Google Marketing products (Google Ads, Campaign Manager, Google Analytics).

Bigflow ⭐ 108

A Python framework for data processing on GCP.

Kubernetes Bigquery Python ⭐ 106

Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub

Bigbroda ⭐ 105

GoogleBig Query ActiveRecord Adapter & API client

Datavault4dbt ⭐ 104

Scalefree's dbt package for a Data Vault 2.0 implementation congruent to the original Data Vault 2.0 definition by Dan Linstedt including the Staging Area, DV2.0 main entities, PITs and Snapshot Tables.

Dataproc Templates ⭐ 103

Dataproc templates and pipelines for solving simple in-cloud data tasks

Event Gateway Example ⭐ 103

Java Bigquery ⭐ 102

Bigquery Tutorial ⭐ 101

Google BigQuery Tutorial for Data Analyst

Get All Hacker News Submissions Comments ⭐ 99

Simple Python scripts to download all Hacker News submissions and comments and store them in a PostgreSQL database.

Analyzing_github ⭐ 96

Analyzing GitHub with BigQuery and other tools

Bigquery Geo Viz ⭐ 96

Visualize Google BigQuery geospatial data using Google Maps Platform APIs

Python Bigquery Storage ⭐ 95

Polygon Etl ⭐ 93

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Opensourcecontributors ⭐ 90

Find all contributions for a user through the GitHub Archive

Premier League ⭐ 88

A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.

Queryitsmart ⭐ 87

QueryIt Smart is the demonstration application for BigQuery & Cloud Machine Learning.

Circus Train ⭐ 86

Circus Train is a dataset replication tool that copies Hive tables between clusters and clouds.

Airflow Tutorial ⭐ 86

Use Airflow to move data from multiple MySQL databases to BigQuery

Bigquery Examples ⭐ 85

Advanced BigQuery examples on genomic data.

Python Bigquery Datatransfer ⭐ 85

This library has moved to https://github.com/googleapis/google-cloud-python/

Bigquery ⭐ 85

A BigQuery wrapper

Datashare Toolkit ⭐ 84

DIY commercial datasets on Google Cloud Platform

Dataflow Opinion Analysis ⭐ 83

Opinion Analysis of News, Threaded Conversations, and User Generated Content

Airbyte_serverless ⭐ 83

Airbyte made simple (no UI, no database, no cluster)

Bigquery_fdw ⭐ 81

BigQuery Foreign Data Wrapper for PostgreSQL

Final Project Level3 Recsys 01 ⭐ 81

🍁 AI를 활용한 메이플스토리 코디 추천 서비스👚👕

Cianalyzer ⭐ 80

A tool collecting multi CI services build data and export it for creating self-hosting build dashboard.

Dlp Dataflow Deidentification ⭐ 80

Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP

Stream raw hit-level Google Analytics data into BigQuery

Rocket Bi ⭐ 79

A free, open-source, web-based self-service BI tailor-made for clickhouse, google bigquery, mysql, postgresql, vertica

Data Pipeline ⭐ 79

Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs. Out of the box it will load files from a source, transform them and then output them (output might be writing to a file or loading them into a data analysis tool). It is designed to be modular and support various sources, transformation technologies and output types. The transformations can be chained together to form complex pipelines.

Gitmostwanted.com ⭐ 76

Advanced explorer of github.com

Cloudrun Tutorial ⭐ 76

A tutorial showing some of the features of Cloud Run

Bigquery_helper ⭐ 76

Helper class to simplify common read-only BigQuery tasks.

Terraform Google Log Export ⭐ 75

Creates log exports at the project, folder, or organization level

Sql Runner ⭐ 75

Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake

Fhir Examples ⭐ 74

Usage Examples for github.com/google/fhir

Dataflow Prediction Example ⭐ 73

Google Cloud Php Bigquery ⭐ 73

Dbt Dry Run ⭐ 72

Dry run capability for dbt projects using BigQuery

Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.

Spark Bigquery ⭐ 69

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

Java App Engine -> BigQuery log export framework

Uses BigQuery and GitHub Archive to create something like TimeHop for GitHub.

Python library for API access and data analysis in Product, BI, Revenue Operations (GAM, GA, Athena etc.)

Linq To Bigquery ⭐ 67

LINQ to BigQuery is C# LINQ Provider for Google BigQuery. It also enables Desktop GUI Client with LINQPad and plug-in driver.

Shapeless Datatype ⭐ 67

Shapeless utilities for common data types

Bigquery View Analyzer ⭐ 66

CLI tool for managing + visualising BigQuery authorised views

Making Patent Citations Uncool Again

Vscode Bigquery ⭐ 64

A Visual Studio Code plugin for running BigQuery queries.

Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)

Bigquery Export Ipython Notebooks ⭐ 64

Bigquery Etl Dataflow Sample ⭐ 62

Bigquery ⭐ 62

BigQuery import and processing pipelines

Bigshift ⭐ 62

A tool for moving tables from Redshift to BigQuery

An upgraded and improved version of the Iris automatic GCP-labeling project

Variant Qc ⭐ 61

Quality control methods for human genomic variants.

Retentioneering Framework ⭐ 60

Retentioneering tools to grow and optimize the app

Python utilities for working with FHIR, including libraries to build simple, flat FHIR views in BigQuery.

Awesome Data Analysis Slides ⭐ 59

현업 분석가가 추천하는 데이터 분석 슬라이드를 아카이브 합니다.

Ddlparse ⭐ 58

DDL parase and Convert to BigQuery JSON schema and DDL statements

Dbt Action ⭐ 57

Run and schedule dbt commands using Github Actions

Processing Logs Using Dataflow ⭐ 56

Processing Logs at Scale using Cloud Dataflow

Package for dbt that allows users to train, audit and use BigQuery ML models.

Java Bigquerystorage ⭐ 52

Bigtsquery ⭐ 51

Search Engine for TypeScript Code using AST Queries

Getting Started Bigquery ⭐ 51

Examples of how to get started with genomics data in BigQuery in many languages.

101-200 of 721 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.