Generic Event Parser

This project is a Google Dataflow pipeline that process generic JSON messages from Google PubSub or Apache Kafka and writes it parsed to Google BigQuery.
Alternatives To Generic Event Parser
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Dataflowtemplates1,060
3 months ago188apache-2.0Java
Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
Kubernetes Bigquery Python106
4 years ago5apache-2.0Python
Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub
Datashare Toolkit84
6 months ago45July 19, 202289apache-2.0JavaScript
DIY commercial datasets on Google Cloud Platform
Iris361
3 months ago3mitPython
An upgraded and improved version of the Iris automatic GCP-labeling project
Google Cloud42
3 months ago34October 27, 202361apache-2.0Java
A collection of Google Cloud Platform (GCP) plugins
Datahem40
5 years agomit
A serverless real-time end-2-end ML pipeline built entirely on Google Cloud Platform services - AppEngine, PubSub, Dataflow, BigQuery and Cloud ML
Weather Station Gcp Mongoose Os40
6 years ago2mitJavaScript
A Weather station made with an ESP32, sending data through Google Cloud IoT Core and storing in BigQuery
Gameanalytics39
6 years ago1Java
A fully-managed pipeline for game analytics
Github Activity Counter37
4 years ago2January 24, 20205apache-2.0Go
Cloud Run service for GitHub event Webhook to monitor repo or org activity in real-time in Stackdriver and analyze activity through ad-hoc SQL queries in BigQuery
Blockchain Etl Architecture36
2 years agomit
Blockchain ETL Architecture
Alternatives To Generic Event Parser
Select To Compare


Alternative Project Comparisons
Popular Bigquery Projects
Popular Pubsub Projects
Popular Data Processing Categories

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Google
Scala
Table
Pipeline
Pubsub
Bigquery
Data Flow