Awesome Open Source

Programming Languages

Search results for java data flow

19 search results found

Apache Beam is a unified programming model for Batch and Streaming data processing.

Easyml ⭐ 1,966

Easy Machine Learning is a general-purpose dataflow-based system for easing the process of applying machine learning algorithms to real world tasks.

Joern ⭐ 1,685

Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc

Dataflowtemplates ⭐ 1,060

Cloud Dataflow Google-provided templates for solving in-Cloud data tasks

Dataflowjavasdk ⭐ 853

Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.

T.J. Watson Libraries for Analysis, with frontends for Java, Android, and JavaScript, and may common static program analyses

Mirror of Apache Pig

A Lazy Data Flow Framework (no longer active - see Apache TinkerPop)

Rule Engine ⭐ 234

基于流程,事件驱动,可拓展,响应式,轻量级的规则引擎。

Cloud Bigtable Examples ⭐ 226

Examples of how to use Cloud Bigtable both with GCE map/reduce as well as stand alone applications.

The GPars concurrency and parallelism framework for the JVM

Notebook ⭐ 170

我的技术笔记本~

Bigquery Data Lineage ⭐ 132

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

Asakusafw ⭐ 113

Asakusa Framework

Frankframework ⭐ 107

The Frank!Framework is an easy-to-use, stateless integration framework which allows (transactional) messages to be modified and exchanged between different systems.

Clojure ++ Apache Beam ++ Google Cloud Dataflow

Dockerflow ⭐ 90

Dockerflow is a workflow runner that uses Dataflow to run a series of tasks in Docker with the Pipelines API

Beamexample ⭐ 89

An example Apache Beam project.

Pig on Apache Spark

Google Cloud Eclipse ⭐ 83

Google Cloud Platform plugin for Eclipse

Dataflow Opinion Analysis ⭐ 83

Opinion Analysis of News, Threaded Conversations, and User Generated Content

Flink Dataflow ⭐ 83

Google Dataflow Runner for Apache Flink™ (deprecated; please use the up-to-date Beam Runner)

Dlp Dataflow Deidentification ⭐ 80

Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP

Frauddetection Microservices ⭐ 78

Static analysis using data-flow and type inference for PHP applications - Implemented in Scala

Df Ml Anomaly Detection ⭐ 69

Streaming Anomaly Detection Solution by using Pub/Sub, Dataflow, BQML & Cloud DLP

Pubsub To Bigquery ⭐ 64

A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub

Bigquery Etl Dataflow Sample ⭐ 62

Dataflowtemplate ⭐ 59

Mercari Dataflow Template

Scalaflow ⭐ 57

Fluent Scala DSL for Google's Cloud Dataflow SDK

Processing Logs Using Dataflow ⭐ 56

Processing Logs at Scale using Cloud Dataflow

Cloud Pubsub Samples Java ⭐ 50

Cloud Pub/Sub sample applications with Java

Cronner 是一个分布式定时任务框架，支持作业依赖、分片、失效转移、集中配置和监控。

Bigquery To Datastore ⭐ 47

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

Cloud Dataflow Nyc Taxi Tycoon ⭐ 45

This is the support code and solutions for the NYC Taxi Tycoon Dataflow Codelab

Gameanalytics ⭐ 39

A fully-managed pipeline for game analytics

Röda: A stream-oriented scripting language

Auto Data Tokenize ⭐ 36

Identify and tokenize sensitive data automatically using Cloud DLP and Dataflow

Dataflow Java ⭐ 35

Google Cloud Dataflow pipelines such as Identity-By-State as well as useful utility classes.

Healthcare Data Harmonization Dataflow ⭐ 34

Parallel and Real-time Embedded Executives Scheduling Method

Recycling Center ⭐ 31

Bringing reactive dataflow to RecyclerViews

Flowgrid ⭐ 31

FlowGrid is a visual dataflow programming environment for Android.

Kettle Beam ⭐ 30

Kettle plugins for Apache Beam

Dataflow Video Analytics ⭐ 30

Video Clip Analytics By Using Dataflow and Video AI For Object Tracking

Oracle Dataflow Samples ⭐ 28

Sample examples Examples demonstrating how to use OCI Data Flow

Spark Examples ⭐ 26

Spark pipelines that correspond to a series of Dataflow examples.

Open RVC-CAL Compiler

Elastic Job Lite Spring Boot Starter ⭐ 26

elastic-job-lite-spring-boot-starter 让你可以使用spring-boot的方式开发依赖elastic-job的程序

Kafka To Avro Writer ⭐ 25

Kafka to Avro Writer based on Apache Beam. It's a generic solution that reads data from multiple kafka topics and stores it on in cloud storage in Avro format.

Javadataflow ⭐ 25

Creating Data Flow Graphs from java input classes

Riot Bench ⭐ 25

Real-time IoT Benchmark Suite

Common Chicken Runtime Engine ⭐ 24

The CCRE is Team 1540's powerful open-source robot code framework, primarily for FIRST Robotics Competition robots.

Cluster computing using Stateful Dataflow Graphs

Foxsec Pipeline ⭐ 24

Log analysis pipeline utilizing Apache Beam

Data Timeseries Java ⭐ 23

Repository for streaming and batch samples of timeseries data

Tensorflow Spring Cloud Stream App Starters ⭐ 23

TensorFlow Processor for Spring Cloud Dataflow

Wala Start ⭐ 22

a basic Gradle configuration to get started with WALA

Apache Beam Sample, use master branch as a java skeleton project.

Hdf Tutorials Ja ⭐ 20

Dataflowtemplates ⭐ 20

Convenient Dataflow pipelines for transforming data between cloud data sources

Dataflow Whitepaper ⭐ 20

Accompanying repository for FIS/SunGard's whitepaper on the using the Dataflow SDK to transform options market data

Fiware Draco ⭐ 19

The Draco Generic Enabler is an alternative data persistence mechanism for managing the history of context. It is based on Apache NiFi and is a dataflow system based on the concepts of flow-based programming. It supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic and also offers an intuitive graphical interface

Gcp Batch Ingestion Bigquery ⭐ 17

Uses Cloud Build to deploy a scalable batch ingestion pipeline consisting of GCS, Cloud Functions, Dataflow and BigQuery

Storm Ml ⭐ 17

an online learning algorithm library for Storm

Beam Pipeline Examples ⭐ 16

Apache Beam examples for running on Google Cloud Dataflow.

Store2store ⭐ 16

store2store helps you to keep in sync your datas between differents sources.

Lib Fxml ⭐ 15

The `Lib-FXML` library simplifies the loading of [JavaFX] relevant files (model, view, controller, .fxml, .css, .properties) and enables a standardized handling of the data flow to (in, from) the gui.

Cloud Stenography ⭐ 15

Bigquery Data Importer ⭐ 14

A tool to import large datasets to BigQuery with automatic schema detection.

Noleme Flow ⭐ 14

A library enabling DAG structuring of data processing programs such as ETLs

Kuromoji For Bigquery ⭐ 14

Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale

Hdf Trucking App ⭐ 14

Example application demonstrating how to integrate all of the components of Hortonworks DataFlow.

Disruptor Net 3.3.0 Alpha ⭐ 13

disruptor-net 3.3.0 alpha

Cdc Kafka Hadoop ⭐ 13

MySQL to NoSQL real time dataflow

Redis Dataflow Realtime Analytics ⭐ 13

Build a real-time website analytics dashboard on GCP using Dataflow, Cloud Memorystore (Redis) and Spring Boot

Dataflow Vision Analytics ⭐ 13

Vision analytics solution using Dataflow and Vision AI

Spring Cloud Dataflow Acceptance Tests ⭐ 13

Retail Demo ⭐ 12

Google Cloud Dataflow Demo Application. デモ用アプリのため更新（依存関係の更新・脆弱性対応）は行っていません。参考にされる方はご注意ください

Jimpleframework ⭐ 11

A Rascal implementation of the Jimple framework.

Oscar2015 Dataflow ⭐ 11

Code for Google Cloud Dataflow to analyze the tweets for the Oscar 2015

Bigquery Ingest Avro Dataflow Sample ⭐ 10

Stream Avro SpecificRecord objects in BigQuery using Cloud Dataflow

A demo Spring Cloud Task that pipes files from S3 to a database

Store2realm ⭐ 10

Synchronize Realm with another Store. Realm Implementation for store2store library

Beampipelinesamples ⭐ 10

Provides different code samples for Apache Beam and DataFlow

Gcp Dataflow Copy Bigquery ⭐ 9

An application that uses Cloud Dataflow and Cloud Build to copy/transfer BigQuery tables between locations/regions.

Hedera Etl ⭐ 8

ETL scripts for Hedera Hashgraph

Dataflow Salesforce ⭐ 8

Datacatalog Tag History ⭐ 8

Historical metadata of your data warehouse is a treasure trove to discover not just insights about changing data patterns, but also quality and user behaviour. This solution creates Data Catalog Tags history in BigQuery since Data Catalog keeps only the latest version of metadata for fast searchability.

Datastoretogcs ⭐ 8

Simple dataflow job which takes Datastore Entities and backs them up as newline seperated json files in a gcs bucket.

Dataflow Samples ⭐ 8

Examples using Google Cloud Dataflow - Apache Beam

An Apache Pig based machine learning pack for bigdata

Metrics Flow ⭐ 7

Metrics collection library for Google Dataflow

Apache Beam Example ⭐ 7

Apache Beam Example 中国开源社区

Shiro - a declarative, dataflow programming language for exploring alternatives

Pregelix -- Big(ger) Graph Analytics Anywhere

Jdataflow ⭐ 7

A Flow Based Programming dataflow tool implementation for Java, using Meemoo Dataflow and FBP

Dataflow Precipitation Pipeline ⭐ 7

Apache Nifi Voiceops Skill ⭐ 7

This one is an Alexa skill which can be used to voice-control an Apache NiFi dataflow.

Spork Streaming ⭐ 6

Pig on Spark Streaming

Related Searches

Java Spring (21,350)

Java Spring Boot (11,982)

Java Video Game (8,093)

Java Gradle (8,072)

Java Docker (6,180)

Java Database (6,015)

Java Mysql (5,954)

Java Sdk (5,864)

Javascript Java (5,468)

Java Rest (4,956)

1-19 of 19 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.