Awesome Open Source

Programming Languages

Search results for java bigquery

63 search results found

Airbyte ⭐ 12,918

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Dataflowtemplates ⭐ 1,060

Cloud Dataflow Google-provided templates for solving in-Cloud data tasks

Bigquery Utils ⭐ 994

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

Google Api Java Client Services ⭐ 550

Generated Java code for Google APIs

Spark Bigquery Connector ⭐ 332

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

Kafka Connect Bigquery ⭐ 151

DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigq A Kafka Connect BigQuery sink connector

Bigquery Data Lineage ⭐ 132

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

Java Bigquery ⭐ 102

Dataflow Opinion Analysis ⭐ 83

Opinion Analysis of News, Threaded Conversations, and User Generated Content

Dlp Dataflow Deidentification ⭐ 80

Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP

Java App Engine -> BigQuery log export framework

Bigquery Etl Dataflow Sample ⭐ 62

Processing Logs Using Dataflow ⭐ 56

Processing Logs at Scale using Cloud Dataflow

Java Bigquerystorage ⭐ 52

Bigquery Samples Java ⭐ 48

A sample Java application that accesses the BigQuery API using the Google Java API Client Libraries. Used in the Google BigQuery Java Codelab

Bigquery To Datastore ⭐ 47

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

Google Cloud ⭐ 42

A collection of Google Cloud Platform (GCP) plugins

Gameanalytics ⭐ 39

A fully-managed pipeline for game analytics

Squashql ⭐ 37

Official repository of SquashQL, the SQL query engine specialized in multi-dimensional queries that empowers your SQL database

Dataflow Video Analytics ⭐ 30

Video Clip Analytics By Using Dataflow and Video AI For Object Tracking

Kettle Beam ⭐ 30

Kettle plugins for Apache Beam

Nyyellowtaxiproject ⭐ 27

Big Data project using Hadoop (MapReduce, spark, Hive)

Gcp Token Broker ⭐ 27

Spark On K8s Gcp Examples ⭐ 24

Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub

Solutions Automated File Loader For Bigquery ⭐ 21

The Automated File Loader to BigQuery solution demonstrates the use of Object Change Notification service on Google Cloud Storage. It shows how one can easily build a simple App Engine application to automatically pick up new data in Cloud Storage based on business logic, and load it directly into Google BigQuery.

Bigquery Fake Client ⭐ 21

Locally mocks Google's BigQuery Java client, useful for testing/CI of Java/Scala applications

Apache Beam Sample, use master branch as a java skeleton project.

Dataflowtemplates ⭐ 20

Convenient Dataflow pipelines for transforming data between cloud data sources

Dataflow Whitepaper ⭐ 20

Accompanying repository for FIS/SunGard's whitepaper on the using the Dataflow SDK to transform options market data

Java Bigquerydatatransfer ⭐ 19

This library has moved to https://github.com/googleapis/google-cloud-java/tr

Gcp Batch Ingestion Bigquery ⭐ 17

Uses Cloud Build to deploy a scalable batch ingestion pipeline consisting of GCS, Cloud Functions, Dataflow and BigQuery

Cata_database ⭐ 17

blockchain database, cata metadata query

Bigquery Dlp Remote Function ⭐ 16

Use Remote Functions to tokenize data with DLP in BigQuery using SQL

Beam Pipeline Examples ⭐ 16

Apache Beam examples for running on Google Cloud Dataflow.

Protobeam ⭐ 15

Bigquery Data Importer ⭐ 14

A tool to import large datasets to BigQuery with automatic schema detection.

Kuromoji For Bigquery ⭐ 14

Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale

Dataflow Vision Analytics ⭐ 13

Vision analytics solution using Dataflow and Vision AI

Dataflowtemplates ⭐ 12

Useful Cloud Dataflow custom templates.

Sa360 Webquery Bigquery ⭐ 12

Tool to import Search Ads 360 Webquery report into BigQuery

Java Bigqueryconnection ⭐ 12

This library has moved to https://github.com/googleapis/google-cloud-java/tr

Nifi Bigquery Bundle ⭐ 11

Bigquery bundle for Apache NiFi

Flink Big Query Connector ⭐ 11

Flink connector for BigQuery

Beampipelinesamples ⭐ 10

Provides different code samples for Apache Beam and DataFlow

Bigquery Ingest Avro Dataflow Sample ⭐ 10

Stream Avro SpecificRecord objects in BigQuery using Cloud Dataflow

Gcp Dataflow Copy Bigquery ⭐ 9

An application that uses Cloud Dataflow and Cloud Build to copy/transfer BigQuery tables between locations/regions.

Dataflow Bigquery Dynamic Destinations ⭐ 9

An example pipeline for dynamically routing events from Pub/Sub to different BigQuery tables based on a message attribute.

Dataflow Salesforce ⭐ 8

Datacatalog Tag History ⭐ 8

Historical metadata of your data warehouse is a treasure trove to discover not just insights about changing data patterns, but also quality and user behaviour. This solution creates Data Catalog Tags history in BigQuery since Data Catalog keeps only the latest version of metadata for fast searchability.

Dataflow Samples ⭐ 8

Examples using Google Cloud Dataflow - Apache Beam

Hedera Etl ⭐ 8

ETL scripts for Hedera Hashgraph

Beam Bigquery Utils ⭐ 8

Collection of utilities for working with BigQuery in Apache Beam

Squashql Showcase ⭐ 7

Getting started with SquashQL tutorial to get familiar with SquashQL typescript library and build dynamic data analytic dashboards

Bigquery Samples Python ⭐ 7

Dataflow Precipitation Pipeline ⭐ 7

Datapipeline ⭐ 6

Circus Train Bigquery ⭐ 6

Circus Train plugin which replicates BigQuery tables to Hive

Dataflowsme ⭐ 6

Tutorial for Cloud Dataflow

Dremio Bigquery Connector ⭐ 6

BigQuery Data Connector for Dremio

Sql To Bigquery Dataflow ⭐ 6

This project contains a basic pipeline for migrating a MS SQL Server catalog to a BigQuery dataset.

LogUnify is a schema-centric service that provides structured application event logging and seamless integration with data warehouses such as BigQuery for easy storage and analysis of event data.

Happiness Levels ⭐ 5

A Beam pipeline that calculates the "happiness" levels of a population by performing sentiment analysis on tweets.

Google Log Aggregation Example ⭐ 5

Example to aggregate logs from Google Pub/Sub to date-partitioned BigQuery on Dataflow

Related Searches

Java Spring (21,350)

Java Spring Boot (11,982)

Java Video Game (8,093)

Java Gradle (8,072)

Java Docker (6,180)

Java Database (6,020)

Java Mysql (5,954)

Java Sdk (5,864)

Javascript Java (5,468)

Java Rest (4,956)

1-63 of 63 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.