Awesome Open Source

Programming Languages

Search results for google cloud platform bigquery

google-cloud-platform x

47 search results found

Snowplow ⭐ 6,677

The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP

Cloudquery ⭐ 5,380

The open source high performance data integration platform built for developers.

Awesome Gcp Certifications ⭐ 3,667

Google Cloud Platform Certification resources.

Ethereum Etl ⭐ 2,760

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

Professional Services ⭐ 2,635

Common solutions and tools developed by Google Cloud's Professional Services team. This repository and its contents are not an officially supported Google product.

A Scala API for Apache Beam and Google Cloud Dataflow.

Google Cloud Php ⭐ 1,057

Google Cloud Client Library for PHP

Bigquery Utils ⭐ 994

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

Awesome Google Cloud ⭐ 707

A curated list of awesome stuff for Google Cloud Platform.

Bigquery Emulator ⭐ 627

BigQuery emulator server implemented in Go

Ipython Soccer Predictions ⭐ 443

Sample iPython notebook with soccer predictions

Ethereum Etl Airflow ⭐ 378

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethe

Spark Bigquery Connector ⭐ 332

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

Awesome Bigquery Views ⭐ 322

Useful SQL queries for Blockchain ETL datasets in BigQuery.

Sql Scripts ⭐ 291

100+ SQL Scripts - PostgreSQL, MySQL, Google BigQuery, MariaDB, AWS Athena. DevOps / DBA / Analytics / performance engineering. Google BigQuery ML machine learning classification.

Security Analytics ⭐ 268

Community Security Analytics provides a set of community-driven audit & threat queries for Google Cloud

Bigquery Grafana ⭐ 240

Google BigQuery Datasource Plugin for Grafana. (NO LONGER MAINTAINED)

Gcp Essentials ⭐ 208

Sample code and notes for my GCP courses on LinkedIn Learning

Public Datasets ⭐ 187

The list of public blockchain datasets in BigQuery

Data Analytics Golden Demo ⭐ 169

An end to end demo of Google's Cloud data and analytic stack.

Fraudfinder ⭐ 164

Fraudfinder: A comprehensive lab series on how to build a real-time fraud detection system on Google Cloud

Starthinker ⭐ 156

Reference framework for building data workflows provided by Google. Accelerates authentication, logging, scheduling, and deployment of solutions using GCP. To borrow a tagline.. "The framework for professionals with deadlines."

Public Datasets Pipelines ⭐ 131

Cloud-native, data onboarding architecture for Google Cloud Datasets

Cortex Data Foundation ⭐ 129

Data Foundation - Google Cloud Cortex Framework

Cloud Build Notifiers ⭐ 123

Notifier images for Cloud Build, complete with build status filtering and Google Secret Manager integration

Gcp Variant Transforms ⭐ 114

GCP Variant Transforms

Bigflow ⭐ 108

A Python framework for data processing on GCP.

Dataproc Templates ⭐ 103

Dataproc templates and pipelines for solving simple in-cloud data tasks

Polygon Etl ⭐ 93

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

Premier League ⭐ 88

A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.

Datashare Toolkit ⭐ 84

DIY commercial datasets on Google Cloud Platform

Final Project Level3 Recsys 01 ⭐ 81

🍁 AI를 활용한 메이플스토리 코디 추천 서비스👚👕

Cloudrun Tutorial ⭐ 76

A tutorial showing some of the features of Cloud Run

Shapeless Datatype ⭐ 67

Shapeless utilities for common data types

Bigquery View Analyzer ⭐ 66

CLI tool for managing + visualising BigQuery authorised views

Bigshift ⭐ 62

A tool for moving tables from Redshift to BigQuery

An upgraded and improved version of the Iris automatic GCP-labeling project

Bigquery To Datastore ⭐ 47

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

Gcp Census ⭐ 45

[DEPRECATED] GAE python based app which regularly collects information about GCP resources and stores them in BigQuery

Coolretailer ⭐ 44

Microservices with Istio, gRPC, Redis, BigQuery, Spring Boot, Spring Cloud and Stackdriver

Bigquery Bokeh Dashboard ⭐ 43

Datacatalog Tag Engine ⭐ 43

Tag Engine lets you automate the process of creating and populating metadata tags with Google Cloud's Data Catalog. Tag Engine is licensed under the Apache 2 license terms. Please make sure to read, understand and agree to the terms of the LICENSE and CONTRIBUTING files before proceeding.

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Google Cloud Platform, AWS, Kubernetes, Databases, SFTP servers, On-Prem Systems and more.

Cloud Jewels ⭐ 43

Estimate energy consumption using GCP Billing Data

Weather Station Gcp Mongoose Os ⭐ 40

A Weather station made with an ESP32, sending data through Google Cloud IoT Core and storing in BigQuery

Protobuf Bigquery Go ⭐ 40

Seamlessly save and load protocol buffers to and from BigQuery using Go.

Google Cloud Platform Machine Learning Samples

Create backups of BigQuery datasets/tables

Daily Commonspeak2 ⭐ 37

commonspeak2 subdomains wordlist generated daily **DEPRECATED** The author(s) of commonspeak2 maintain an official repo with more lists. Please use it instead: https://github.com/assetnote/wordlists

Prometheus_bigquery_remote_storage_adapter ⭐ 36

Prometheus remote storage adapter for Google's BigQuery

Campaign Manager 360 and Display & Video 360 Reports to BigQuery connector

Ob_google Bigquery ⭐ 34

This service is meant to simplify running Google Cloud operations, especially BigQuery tasks. This means you do not have to worry about installation, configuration or ongoing maintenance related to an SDK environment. This can be helpful to those who would prefer to not to be responsible for those activities.

End-to-end DataOps platform deployed by Terraform.

Cloud Data Lake ⭐ 34

Data lake, data warehouse on GCP

Dataflow Contact Center Speech Analysis ⭐ 34

Speech Analysis Framework, a collection of components and code from Google Cloud that you can use to transcribe audio files to create analytics.

Cloud Ai Analytics ⭐ 33

This Repo contain details related to Data Engineering tech stacks in GCP

Gke Logging Sinks Demo ⭐ 32

This project describes the steps required to deploy a sample application to Kubernetes Engine that forwards log events to Stackdriver Logging. As a part of the exercise, you will create a Cloud Storage bucket and a BigQuery dataset for exporting log data.

Dataform Ga4 Sessions ⭐ 32

dataform-ga4-sessions is a Dataform package to prepare session and event tables from Google Analytics 4 (GA4) BigQuery raw data

End To End Machine Learning With Google Cloud ⭐ 29

End to End Machine Learning with Google Cloud Platform

Laravel Bigquery ⭐ 29

A Laravel package to access Google BigQuery

Debussy_concert ⭐ 29

Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and pipelines.

Big_data_demystified ⭐ 28

Big Data Demystified meetup and blog examples

Gcp Token Broker ⭐ 27

Magic The Gathering ⭐ 25

A complete pipeline to pull data from Scryfall's "Magic: The Gathering"-API, via Prefect orchestration and DBT transformation.

Training Gcp ⭐ 25

Labs and demos for courses in the Google Cloud Platform Training (https://training.topgate.co.jp).

Looker Gcp Control ⭐ 25

A Looker block for analysing Google Cloud Platform Billing and BigQuery data access logs

Ostelco Core ⭐ 24

Cloud-native Telco BSS hosted in GCP K8s with standalone Diameter to gRPC gateway. Rule Engine using Neo4j graphs. Analytics Events sent to GCP BigData (Dataflow+BigQuery) via PubSub. It's awesome!

Market Data Transcoder ⭐ 24

ffmpeg for market data

A lightweight tool to fetch tables from BigQuery as pandas DataFrame very fast using BigQuery Storage API combined with multiprocessing

Spark On K8s Gcp Examples ⭐ 24

Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub

Dlp Pdf Redaction ⭐ 24

This solution provides an automated, serverless way to redact sensitive data from PDF files using Google Cloud Services like Data Loss Prevention (DLP), Cloud Workflows, and Cloud Run.

Example_dataproc_twitter ⭐ 23

This repository is used as source code for the medium post about implementing a Twitter recommender system using GCP.

Multisite Lighthouse Gcp ⭐ 23

Run Lighthouse audits on URLs, and write the results daily into a BigQuery table.

Data Quality Monitor ⭐ 23

Data Quality Monitor (DQM) - Continuously validate your data with easy, customizable rules.

The simplest tool to manage views of BigQuery.

Gcp Dataprep Bigquery Twitter Stream ⭐ 21

Stream Twitter Data into BigQuery with Cloud Dataprep

Go Bqloader ⭐ 21

bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.

Snowplow Bigquery Loader ⭐ 20

Loads Snowplow enriched events into Google BigQuery

Datastore2bigquery ⭐ 20

Export Google Datastore to BigQuery

Gcp Fundamentals ⭐ 19

Notes and annotations from CBTNuggets CP100 and related resources: https://www.cbtnuggets.com/it-training/google-clou

Hive Bigquery Storage Handler ⭐ 19

Hive Storage Handler for interoperability between BigQuery and Apache Hive

Bigquery Sheets Slides ⭐ 18

Code repo for the Google Apps Script BigQuery-Sheets-Slides codelab application

Dbt Artifacts Loader ⭐ 17

Load dbt artifacts uploaded to GCS to BigQuery in order to track historical dbt results

Bigquery Kafka Connect ⭐ 17

☁️ nodejs kafka connect connector for Google BigQuery

Bigquery Dlp Remote Function ⭐ 16

Use Remote Functions to tokenize data with DLP in BigQuery using SQL

Beam Pipeline Examples ⭐ 16

Apache Beam examples for running on Google Cloud Dataflow.

Stock Data Pipeline ⭐ 16

Code Repository for my 1st Data Project.

Effortlessly validate and test your Google BigQuery queries with the power of pandas DataFrames in Python.

Gcp Accountant ⭐ 15

A tool to identify high cost resources in GCP at a granular level

Web Scraper Gcp ⭐ 15

Scrape all the pages and links of a given domain and write the results to Google Cloud BigQuery.

Datacatalog Tag Manager ⭐ 15

Python package to manage Google Cloud Data Catalog tags, loading metadata from external sources -- currently supports the CSV file format

Automated_etl_google_cloud Social_dashboard ⭐ 15

A dashboard is worth a thousand words => https://datastudio.google.com/reporting/755f3183-d

Bq Utilization Alerts ⭐ 14

A serverless bot which periodically checks configured BigQuery capacity commitments, reservations and assignments against actual slot consumption of running jobs and reports findings to Slack/Google Chat.

Ingestly Endpoint ⭐ 14

Ingestly Endpoint for Real-Time Analytics powered by Fastly & Google BigQuery

Kuromoji For Bigquery ⭐ 14

Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale

Gcp Pilot ⭐ 13

Deviceconnect ⭐ 12

https://deviceconnect.readthedocs.io/

Infoq Kafka Ksql ⭐ 12

Code samples to go with InfoQ article

Gcp Serverless Twitter Pipeline ⭐ 12

A full end-to-end serverless pipeline to read Tweets and send them to BigQuery and Firestore/Firebase

Crisp Bigquery ⭐ 11

Starter project with full stack BigQuery. Allows to overcome customisation restrictions imposed by pre-built dashboards and control data usage. Deploy your own cloud website hydrated by sample BigQuery data in 15 min without installing any development software.

Related Searches

Python Google Cloud Platform (1,267)

Javascript Google Cloud Platform (771)

1-47 of 47 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.