Awesome Open Source

Programming Languages

Search results for bigquery

721 search results found

Connections ⭐ 51

https://rstudio.github.io/connections/

Tensorflow Kubernetes Art Classification ⭐ 50

Train a TensorFlow model on Kubernetes to recognize art culture based on the collection from the Metropolitan Museum of Art

Mysql To Google Bigquery ⭐ 49

MySQL to Google BigQuery Sync Tool

Bigquery Samples Java ⭐ 48

A sample Java application that accesses the BigQuery API using the Google Java API Client Libraries. Used in the Google BigQuery Java Codelab

Search Console Bq ⭐ 48

Python code to grab data from Google Search Console and send it to BigQuery.

Mozilla Pipeline Schemas ⭐ 47

Schemas for Mozilla's data ingestion pipeline and data lake outputs

Service for moving your FullStory export files to a data warehouse

Bigquery To Datastore ⭐ 47

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

BigQuery Google Storage Based Data Loader

Python Bigquery Test Kit ⭐ 46

BigQuery test kit is a framework written in python that allows you to be more confident in your SQL and check that they are ready to prod. Rendering SQL template is part of this framework as well if you rely, for instance, on Airflow to orchestrate your jobs and their macros.

Bigquery Integrations ⭐ 45

Import files (data) from Intercom, FTP(S), SFTP, MySQL, etc. servers into BigQuery.

Bigquery Visualiser ⭐ 45

A Shiny app to visualise BigQuery data in R. Open sourced so you can deploy on your own Shiny server.

Command Line Tool to import MongoDB collection into BigQuery

Testing_bi_engine ⭐ 45

Gcp Census ⭐ 45

[DEPRECATED] GAE python based app which regularly collects information about GCP resources and stores them in BigQuery

Ruby Bigquery Cl ⭐ 44

a Google's BigQuery interface for ruby

Coolretailer ⭐ 44

Microservices with Istio, gRPC, Redis, BigQuery, Spring Boot, Spring Cloud and Stackdriver

Bigquery Runner ⭐ 44

An extension to query BigQuery directly and view the results in VSCode.

Bigquery Bokeh Dashboard ⭐ 43

Datacatalog Tag Engine ⭐ 43

Tag Engine lets you automate the process of creating and populating metadata tags with Google Cloud's Data Catalog. Tag Engine is licensed under the Apache 2 license terms. Please make sure to read, understand and agree to the terms of the LICENSE and CONTRIBUTING files before proceeding.

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Google Cloud Platform, AWS, Kubernetes, Databases, SFTP servers, On-Prem Systems and more.

Cloud Jewels ⭐ 43

Estimate energy consumption using GCP Billing Data

Google Cloud ⭐ 42

A collection of Google Cloud Platform (GCP) plugins

Cloud Opensource Python ⭐ 42

Dependency Management Toolkit for Google Cloud Python Projects

Fhir Dbt Analytics ⭐ 42

Data quality analytics for FHIR exported to BigQuery.

Bigqueryr ⭐ 42

R Interface with Google BigQuery

A Google Cloud-based pipeline for tagging image and video ads based on their content, enabling advanced creative analysis.

dump raw log data from google analytics

Weather Station Gcp Mongoose Os ⭐ 40

A Weather station made with an ESP32, sending data through Google Cloud IoT Core and storing in BigQuery

Data Models ⭐ 40

⚠️ MAINTENANCE-ONLY MODE: Snowplow maintained SQL data models for working with Snowplow web and mobile behavioral data.

Google Cloud Platform Machine Learning Samples

Protobuf Bigquery Go ⭐ 40

Seamlessly save and load protocol buffers to and from BigQuery using Go.

A serverless real-time end-2-end ML pipeline built entirely on Google Cloud Platform services - AppEngine, PubSub, Dataflow, BigQuery and Cloud ML

Gameanalytics ⭐ 39

A fully-managed pipeline for game analytics

Create backups of BigQuery datasets/tables

Alphasql ⭐ 39

AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery

Prometheus Bigquery Exporter ⭐ 39

An exporter for converting BigQuery results into Prometheus metrics

Github Activity Counter ⭐ 37

Cloud Run service for GitHub event Webhook to monitor repo or org activity in real-time in Stackdriver and analyze activity through ad-hoc SQL queries in BigQuery

Lightweight configuration and access to multiple databases in a single project

Amora Data Build Tool ⭐ 37

Amora Data Build Tool enables analysts and engineers to transform data on the data warehouse (BigQuery) by writing Amora Models that describe the data schema using Python's "PEP484 - Type Hints" and select statements with SQLAlchemy. Amora is able to transform Python code into SQL data transformation jobs that run inside the warehouse.

Squashql ⭐ 37

Official repository of SquashQL, the SQL query engine specialized in multi-dimensional queries that empowers your SQL database

Daily Commonspeak2 ⭐ 37

commonspeak2 subdomains wordlist generated daily **DEPRECATED** The author(s) of commonspeak2 maintain an official repo with more lists. Please use it instead: https://github.com/assetnote/wordlists

Gh Comments Sentiment ⭐ 37

Analysis of Github Commits Comments

Prometheus_bigquery_remote_storage_adapter ⭐ 36

Prometheus remote storage adapter for Google's BigQuery

Blockchain Etl Architecture ⭐ 36

Blockchain ETL Architecture

Lambda Dashboard ⭐ 36

Campaign Manager 360 and Display & Video 360 Reports to BigQuery connector

Make_github_great_again ⭐ 35

See if people on github are influenced by Trump

A Scaleable and Asynchronous Framework for Testing Tools built on Kubernetes

Dataflow Contact Center Speech Analysis ⭐ 34

Speech Analysis Framework, a collection of components and code from Google Cloud that you can use to transcribe audio files to create analytics.

Cloud Data Lake ⭐ 34

Data lake, data warehouse on GCP

Ob_google Bigquery ⭐ 34

This service is meant to simplify running Google Cloud operations, especially BigQuery tasks. This means you do not have to worry about installation, configuration or ongoing maintenance related to an SDK environment. This can be helpful to those who would prefer to not to be responsible for those activities.

Google Analytics Bigquery Data Export ⭐ 34

Export Google Analytics data from BigQuery using Standard or Legacy SQL.

Bigquery Fluentd Docker Sample ⭐ 34

End-to-end DataOps platform deployed by Terraform.

Jsonschema Transpiler ⭐ 34

Compile JSON Schema into Avro and BigQuery schemas

Stackdriver Metrics Export ⭐ 33

Automatebot ⭐ 33

This bot will automate your reporting task by querying the data to bigquery, doing visualization, and automatically send the image through Telegram Chat.

Cloud Ai Analytics ⭐ 33

This Repo contain details related to Data Engineering tech stacks in GCP

Gh Emoji ⭐ 33

Dataform Ga4 Sessions ⭐ 32

dataform-ga4-sessions is a Dataform package to prepare session and event tables from Google Analytics 4 (GA4) BigQuery raw data

Oss Contributors ⭐ 32

How do tech companies rank amongst themselves when it comes to github.com activity?

Gke Logging Sinks Demo ⭐ 32

This project describes the steps required to deploy a sample application to Kubernetes Engine that forwards log events to Stackdriver Logging. As a part of the exercise, you will create a Cloud Storage bucket and a BigQuery dataset for exporting log data.

Odbc Scanner Duckdb Extension ⭐ 32

A DuckDB extension to read data directly from databases supporting the ODBC interface

Managed_ml_systems_and_iot ⭐ 32

Managed Machine Learning Systems and Internet of Things Live Lesson

Alligator2 ⭐ 32

A sample integration between the Google My Business API and the Cloud Natural Language API

Bigquery4s ⭐ 31

A handy Scala wrapper of Google BigQuery API 's Java Client Library.

Gcs Inventory Loader ⭐ 31

List or load your GCS bucket inventory into BigQuery fast with this tool.

Gdelt_intro ⭐ 31

Quick tutorial on getting started with GDELT

(pronounced BACK-wup) BigQuery backup scripts

Blast is a data orchestration tool that can run SQL and Python against Google BigQuery and Snowflake. It supports templating with Jinja, data quality tests, query validation, environment management and more.

Kettle Beam ⭐ 30

Kettle plugins for Apache Beam

Export PostgreSQL tables to Google BigQuery

BigQuery UDF to parse protobuf messages

Python Bigquery Connection ⭐ 30

This library has moved to https://github.com/googleapis/google-cloud-python/

Dataflow Video Analytics ⭐ 30

Video Clip Analytics By Using Dataflow and Video AI For Object Tracking

Scio Idea Plugin ⭐ 29

Scio IDEA plugin

글또의 요정 지니 프로젝트

End To End Machine Learning With Google Cloud ⭐ 29

End to End Machine Learning with Google Cloud Platform

Kube Django Ng ⭐ 29

This demo, showcases a dummy banking portal. It includes: Django Rest Framework, Dialogflow, Angular, Socket.io and Kubernetes Engine, Cloud Builder, Pub/Sub, DLP API, NLP API, Google Cloud Storage, Cloud Functions and BigQuery.

Debussy_concert ⭐ 29

Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and pipelines.

Laravel Bigquery ⭐ 29

A Laravel package to access Google BigQuery

Database Migration ⭐ 29

SQL scripts for automatically importing data from various data management systems into EXASOL.

Riot API and analytics goodies

Sql Recipes ⭐ 29

SQL Recipes for Web Analytics

Starlake ⭐ 29

Starlake is an On Premise and Cloud ELT/ETL Framework for Batch & Stream Processing

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

Almaren Framework ⭐ 28

The Almaren Framework provides a simplified consistent minimalistic layer over Apache Spark. While still allowing you to take advantage of native Apache Spark features. You can still combine it with standard Spark code.

Big_data_demystified ⭐ 28

Big Data Demystified meetup and blog examples

Nodejs Bigquery Storage ⭐ 28

BigQuery Storage Node.js client

Flight2bq ⭐ 28

RTLSDR ADS-B dump1090 to Google BigQuery

Gcp Token Broker ⭐ 27

Nyyellowtaxiproject ⭐ 27

Big Data project using Hadoop (MapReduce, spark, Hive)

Team Timesheets ⭐ 27

Time tracking web app built as a replacement for old school timesheets.

Target Bigquery ⭐ 26

A Singer (https://singer.io) target that writes data to Google BigQuery.

Ticket Tagger ⭐ 26

Machine learning driven issue classification bot.

Edx2bigquery ⭐ 26

Tool to convert & load data from edX platform into BigQuery

Open Source Monthly ⭐ 26

📊 A dashboard for org open source activity

Fetch Xrpl Transactions ⭐ 26

Fetch (and store) all XRPL transactions (to a custom datastore)

201-300 of 721 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.