Awesome Open Source

Programming Languages

Search results for cloud computing data flow

cloud-computing x

0 search results found

Professional Services ⭐ 2,635

Common solutions and tools developed by Google Cloud's Professional Services team. This repository and its contents are not an officially supported Google product.

A Scala API for Apache Beam and Google Cloud Dataflow.

Nextflow ⭐ 2,447

A DSL for data-driven computational pipelines

Fluvio ⭐ 2,373

Lean and mean distributed stream processing system written in rust and web assembly.

Event Gateway ⭐ 1,534

React to any event with serverless functions across clouds

Dataflowjavasdk ⭐ 853

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.

Awesome Google Cloud ⭐ 707

A curated list of awesome stuff for Google Cloud Platform.

Cloud Bigtable Examples ⭐ 226

Examples of how to use Cloud Bigtable both with GCE map/reduce as well as stand alone applications.

SuperComputing 2017 Deep Learning Tutorial

Tensorflow Recorder ⭐ 158

TFRecorder makes it easy to create TensorFlow records (TFRecords) from Pandas DataFrames and CSVs files containing images or structured data.

Dataflowpythonsdk ⭐ 157

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.

Dataflowsdk Examples ⭐ 148

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines. This repository hosts a few example pipelines to get you started with Dataflow.

Datasplash ⭐ 128

Clojure API for a more dynamic Google Dataflow

Gcp Variant Transforms ⭐ 114

GCP Variant Transforms

Dockerflow ⭐ 90

Dockerflow is a workflow runner that uses Dataflow to run a series of tasks in Docker with the Pipelines API

Beamexample ⭐ 89

An example Apache Beam project.

Dataflow Opinion Analysis ⭐ 83

Opinion Analysis of News, Threaded Conversations, and User Generated Content

Dlp Dataflow Deidentification ⭐ 80

Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP

Dataflow Prediction Example ⭐ 73

Df Ml Anomaly Detection ⭐ 69

Streaming Anomaly Detection Solution by using Pub/Sub, Dataflow, BQML & Cloud DLP

Scalaflow ⭐ 57

Fluent Scala DSL for Google's Cloud Dataflow SDK

Processing Logs Using Dataflow ⭐ 56

Processing Logs at Scale using Cloud Dataflow

Cloud Pubsub Samples Java ⭐ 50

Cloud Pub/Sub sample applications with Java

A serverless real-time end-2-end ML pipeline built entirely on Google Cloud Platform services - AppEngine, PubSub, Dataflow, BigQuery and Cloud ML

Github Activity Counter ⭐ 37

Cloud Run service for GitHub event Webhook to monitor repo or org activity in real-time in Stackdriver and analyze activity through ad-hoc SQL queries in BigQuery

Auto Data Tokenize ⭐ 36

Identify and tokenize sensitive data automatically using Cloud DLP and Dataflow

Dataflow Java ⭐ 35

Google Cloud Dataflow pipelines such as Identity-By-State as well as useful utility classes.

Dataflow Contact Center Speech Analysis ⭐ 34

Speech Analysis Framework, a collection of components and code from Google Cloud that you can use to transcribe audio files to create analytics.

Healthcare Data Harmonization Dataflow ⭐ 34

Kaggle_outbrain_click_prediction_google_cloud_ml_engine ⭐ 29

A POC of Google's Wide & Deep Learning models deployed on Google Cloud ML Engine for Kaggle's Outbrain Click Competition

End To End Machine Learning With Google Cloud ⭐ 29

End to End Machine Learning with Google Cloud Platform

Google Cloud Dataflow Example Project ⭐ 25

Example stream processing job, written in Scala with Apache Beam, for Google Cloud Dataflow

Kafka To Avro Writer ⭐ 25

Kafka to Avro Writer based on Apache Beam. It's a generic solution that reads data from multiple kafka topics and stores it on in cloud storage in Avro format.

Nanostream Dataflow ⭐ 25

real-time stream processing of DNA nanopore sequencer reads with dataflow

Training Gcp ⭐ 25

Labs and demos for courses in the Google Cloud Platform Training (https://training.topgate.co.jp).

Tensorflow Spring Cloud Stream App Starters ⭐ 23

TensorFlow Processor for Spring Cloud Dataflow

Event Streams Dataflow ⭐ 22

Dataflow Whitepaper ⭐ 20

Accompanying repository for FIS/SunGard's whitepaper on the using the Dataflow SDK to transform options market data

Gcp Batch Ingestion Bigquery ⭐ 17

Uses Cloud Build to deploy a scalable batch ingestion pipeline consisting of GCS, Cloud Functions, Dataflow and BigQuery

Beam Pipeline Examples ⭐ 16

Apache Beam examples for running on Google Cloud Dataflow.

Redis Dataflow Realtime Analytics ⭐ 13

Build a real-time website analytics dashboard on GCP using Dataflow, Cloud Memorystore (Redis) and Spring Boot

Spring Cloud Dataflow Acceptance Tests ⭐ 13

Spring Cloud Dataflow Server Nomad ⭐ 12

Spring Cloud Data Flow Implementation for Hashicorp Nomad

Retail Demo ⭐ 12

Google Cloud Dataflow Demo Application. デモ用アプリのため更新（依存関係の更新・脆弱性対応）は行っていません。参考にされる方はご注意ください

Spring Cloud Data Flow Setup ⭐ 12

Scripts to get Spring Cloud Data Flow (SCDF) set up on Pivotal Web Services (PWS)

Oscar2015 Dataflow ⭐ 11

Code for Google Cloud Dataflow to analyze the tweets for the Oscar 2015

Prefect Cloud Gcp ⭐ 10

Repository template to get started with Prefect Cloud & Google Cloud

A demo Spring Cloud Task that pipes files from S3 to a database

Bigquery Ingest Avro Dataflow Sample ⭐ 10

Stream Avro SpecificRecord objects in BigQuery using Cloud Dataflow

Gcp Dataflow Copy Bigquery ⭐ 9

An application that uses Cloud Dataflow and Cloud Build to copy/transfer BigQuery tables between locations/regions.

Dataflow Salesforce ⭐ 8

Datacatalog Tag History ⭐ 8

Historical metadata of your data warehouse is a treasure trove to discover not just insights about changing data patterns, but also quality and user behaviour. This solution creates Data Catalog Tags history in BigQuery since Data Catalog keeps only the latest version of metadata for fast searchability.

Google Dataflow Examples ⭐ 8

Google Cloud Dataflow Examples

Dataflow Samples ⭐ 8

Examples using Google Cloud Dataflow - Apache Beam

Custom business logic for Search Ads 360

Kafka-like functionality in AWS Serverless Cloud

Cloud Native Kotlin ⭐ 7

Example microservice distributed architecture in Kotlin and Spring

Code Snippets ⭐ 6

The snippets in this repository support the content in this book.

Service scaling recommendation based on Kubernetes metric and event stream using Cloud Run, Cloud PubSub, Cloud Dataflow, and BigQuery ML

Project Cloud Monitor ⭐ 5

Hotel Ads Etl Tool ⭐ 5

Tool to extract information from Hotel Ads API to BigQuery.

Schedule Dataflow Appengine ⭐ 5

Appengine app for scheduling dataflow piplies

Google Log Aggregation Example ⭐ 5

Example to aggregate logs from Google Pub/Sub to date-partitioned BigQuery on Dataflow

Dsdevent1 ⭐ 5

Data Science Delhi

1-0 of 0 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.