Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for pipeline streaming
pipeline
x
streaming
x
40 search results found
Beam
⭐
7,355
Apache Beam is a unified programming model for Batch and Streaming data processing.
Conduit
⭐
860
A streaming data library
Hop
⭐
802
Hop Orchestration Platform
Psi
⭐
506
Platform for Situated Intelligence
Smooks
⭐
377
Extensible data integration Java framework for building XML and non-XML fragment-based applications
Obs Gstreamer
⭐
280
GStreamer OBS Studio plugin
Buildflow
⭐
188
BuildFlow, is an open source framework for building large scale systems using Python. All you need to do is describe where your input is coming from and where your output should be written, and BuildFlow handles the rest. No configuration outside of the code is required.
Piperator
⭐
186
Composable pipelines for Enumerators.
Dataflowpythonsdk
⭐
157
Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines.
Motorway
⭐
154
Cloud ready pure-python streaming data pipeline library
Dataflowsdk Examples
⭐
148
Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines. This repository hosts a few example pipelines to get you started with Dataflow.
Node Gstreamer Superficial
⭐
120
Superficial gstreamer binding
Stetl
⭐
81
Stetl, Streaming ETL, is a lightweight geospatial processing and ETL framework written in Python.
Docker Stream
⭐
68
CLI tool for automating the use of docker containers in streaming data processing pipelines. Works on Windows, Mac and Linux.
Gstreamercheatsheet
⭐
68
GStreamer pipelines and CLI commands for different GStreamer based features (process MPEG2-TS files, get video from DVB, deinterlace video, capture RTSP stream etc.)
Stream
⭐
60
Elegant stream processing pipeline written entirely in Golang
Vectordb
⭐
58
VectorDB is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.
Stream Splicer
⭐
55
streaming pipeline with a mutable configuration
Data Stream Development With Apache Spark Kafka And Spring Boot
⭐
54
Data Stream Development with Apache Spark, Kafka and Spring Boot by Packt Publishing
Trembita
⭐
43
Model complex data transformation pipelines easily
Hyperdrive
⭐
41
Extensible streaming ingestion pipeline on top of Apache Spark
Geonames Stream
⭐
36
Streaming geonames parser
Dataflow Video Analytics
⭐
30
Video Clip Analytics By Using Dataflow and Video AI For Object Tracking
Twitter
⭐
23
Use the twitter streaming API and store tweets, users, ... in a NEO4J database
Furnace
⭐
21
Build streaming data pipelines in minutes, respond to events in seconds.
Solutions Gcs Bq Streaming Functions Python
⭐
21
Streaming data from Cloud Storage into BigQuery using Cloud Functions
Analysis Pipelines
⭐
20
Enables data scientists to compose pipelines of analysis which consist of data manipulation, exploratory analysis & reporting, as well as modeling steps. Data scientists can use tools of their choice through an R interface, and compose interoperable pipelines between R, Spark, and Python.
Pgstream
⭐
17
Binary streaming library for Postgres data pipelines
Emojitrack Gostreamer
⭐
17
💫 Emojitracker Streaming API (Server implementation)
Streaming Analytics Pipeline
⭐
16
WARNING- This package is no longer supported and will be replaced in the near future. A solution that enables customers to easily create Kinesis Streams to load streaming data, Kinesis Analytics applications to process data with SQL code, and Kinesis Firehose delivery streams to persist data to various data stores.
Dp3
⭐
14
DP3: streaming processing pipeline for radio interferometric data
Python Pipes
⭐
12
A simple streaming framework for Python
Activevlc
⭐
11
Readable DSL for building VLC streaming/trandscoding pipelines
Snowplow Pipeline
⭐
11
End-to-end Snowplow Analytics Pipeline for real time events
Twitter Stream Pipeline
⭐
11
Easily collect and store tweets from the Twitter Streaming API
Trendingtopics
⭐
9
Discover what is trending anywhere in the world. An end-to-end data pipeline using big data tools on AWS.
Deva
⭐
9
函数流,数据流,同步异步,事件驱动,多种模式channel
Gstreamer Cookbook
⭐
9
A collection of GStreamer command lines and C snippets to help you get started
Stepflow
⭐
8
Streaming Engine that implements Flume patterns.
Demo Beam Summit 2018
⭐
8
Python Streaming Pipelines with Beam on Flink - Demo
Streaming Pipeline
⭐
7
A real-time text classification based on Kafka and Spark.
Openmrs Etl
⭐
7
openmrs - mysql - debezium - kafka - spark - scala
Aerobio
⭐
7
Extensible full DAG streaming computation server with services and jobs for RNA-Seq, Tn-Seq, WG-Seq and Term-Seq.
Flow
⭐
7
Create simple flows based on user-defined filters (data stream processing).
Spark Streaming Twitter
⭐
7
Building pipeline to process the real-time data using Spark and Mongodb.
Insight18b Sparksql Array
⭐
6
Repo of my Insight project. Extended SparkSQL functionality internally and tested its performance against UDFs. Additionally, implemented a batch pipeline HDFS->SparkSQL->MySQL->Flask and a streaming pipeline Kafka->Spark Streaming->MySQL->Flask to analyze Amazon User Data.
Dataflowsme
⭐
6
Tutorial for Cloud Dataflow
Gobean
⭐
6
依赖注入 & 扩展点
Streaming Data Pipeline
⭐
5
Streaming pipeline repo for data engineering training program
Parrot
⭐
5
Demo
⭐
5
AI+ [Data, I/O, and TensorFlow: Building A Reliable Machine Learning Data Pipeline]
Physonline
⭐
5
PhysOnline: An Open Source Machine Learning Pipeline for Real-Time Analysis of Waveform Data
Dataflowsme Python
⭐
5
Planner
⭐
5
Plan processing based on spec
Related Searches
Python Pipeline (4,255)
Javascript Streaming (2,085)
Stream Streaming (1,696)
Python Streaming (1,407)
Javascript Pipeline (1,369)
Pipeline Jenkins (1,150)
Shell Pipeline (1,143)
Java Streaming (1,103)
Docker Pipeline (1,018)
Jupyter Notebook Pipeline (976)
1-40 of 40 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.