Awesome Open Source
Awesome Open Source
Combined Topics
streaming-data
x
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
The Top 178 Streaming Data Open Source Projects on Github
Categories
>
Data Processing
>
Streaming Data
Awesome Bigdata
⭐
10,551
A curated list of awesome big data frameworks, ressources and other awesomeness.
Miller
⭐
4,922
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
Benthos
⭐
3,917
Fancy stream processing made operationally mundane
River
⭐
3,047
🌊 Online machine learning in Python
Smart_open
⭐
2,288
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Kafka Ui
⭐
2,088
Open-Source Web GUI for Apache Kafka Management
Pravega
⭐
1,707
Pravega - Streaming as a new software defined storage primitive
Trill
⭐
1,142
Trill is a single-node query processor for temporal or streaming data.
Streamz
⭐
1,014
Real-time stream processing for python
Go Streams
⭐
813
A lightweight stream processing library for Go
Zpl
⭐
719
📐 Pushing the boundaries of simplicity
Onlinestats.jl
⭐
641
⚡ Single-pass algorithms for statistics
Scikit Multiflow
⭐
545
A machine learning package for streaming data in Python. The other ancestor of River.
Sparta
⭐
521
Real Time Analytics and Data Pipelines based on Spark Streaming
Awesome Kafka
⭐
462
A list about Apache Kafka
Swim
⭐
424
Full stack application platform for building stateful microservices, streaming APIs, and real-time UIs
Cloudflow
⭐
310
Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.
Data Accelerator
⭐
258
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Rrcf
⭐
202
🌲 Implementation of the Robust Random Cut Forest algorithm for anomaly detection on streams
Optbinning
⭐
190
Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.
Kafka Streams In Action
⭐
183
Source code for the Kafka Streams in Action Book
Tractor
⭐
160
structured concurrent, Python parallelism
You Cant Download This Image
⭐
154
Downloading images from the web is as easy as right clicking them and selecting "Save image as..", right? Well, not anymore xD
Memgraph
⭐
153
Build modern, graph-based applications on top of your streaming data in minutes
Rangeless
⭐
142
c++ LINQ -like library of higher-order functions for data manipulation
Gsf
⭐
117
Grid Solutions Framework
Toolbox
⭐
104
A Java Toolbox for Scalable Probabilistic Machine Learning
Meros
⭐
102
🪢 A fast utility that makes reading multipart responses simple
Machine
⭐
101
Machine is a workflow/pipeline library for processing data
Openpdc
⭐
97
Open Source Phasor Data Concentrator
Axway Amplify Streams Js
⭐
80
AMPLIFY Streams Javascript package containing SDK, documentation and sample applications
Packmatic
⭐
78
Zipping on the fly
Euphoria
⭐
74
Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.
Real Time Sentiment Tracking On Twitter For Brand Improvement And Trend Recognition
⭐
69
A real-time interactive web app based on data pipelines using streaming Twitter data, automated sentiment analysis, and MySQL&PostgreSQL database (Deployed on Heroku)
Streaming Integrator
⭐
61
A stream processing runtime that allows connecting any streaming data source to any destination and act on it
Nsdb
⭐
52
Natural Series Database
Flexible Clustering
⭐
49
Clustering for arbitrary data and dissimilarity function
Datadash
⭐
48
Visualize and graph data in the terminal
Pwpae Concept Drift Detection And Adaptation
⭐
47
Implement online learning methods to address concept drift in data streams using the River library. Code for the paper entitled "PWPAE: An Ensemble Framework for Concept Drift Adaptation in IoT Data Streams" accepted in IEEE GlobeCom 2021.
Cinnamon
⭐
47
CinnaMon is a Python library which offers a number of tools to detect, explain, and correct data drift in a machine learning system
The Apache Ignite Book
⭐
40
All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above
Pravega Samples
⭐
38
Sample Applications for Pravega.
Mxfactorial
⭐
36
a payment application intended for deployment by the united states treasury
Rxhttpclient
⭐
36
Simple Http client (Use RxSwift for stream data)
Pysad
⭐
35
Streaming Anomaly Detection Framework in Python (Outlier Detection for Streaming Data)
Saber
⭐
34
Window-Based Hybrid CPU/GPU Stream Processing Engine
Download Using Streaming Response Body
⭐
28
An example for streaming large files in chunks using StreamingResponseBody in Spring MVC
Windflow
⭐
27
A C++17 Data Stream Processing Parallel Library for Multicores and GPUs
Imtsl
⭐
25
IMTSL - Incremental and Multi-feature Tensor Subspace Learning
Cinje
⭐
24
A Pythonic and ultra fast template engine DSL.
Onlinestatsbase.jl
⭐
23
Base types for OnlineStats.
Nestjs File Streaming
⭐
23
NestJS File Streaming With MongoDB
Go Mesh
⭐
20
Realtime data exchange platform for Smart Cities
Pandas_streaming
⭐
17
Streaming API for pandas applied to big datasets
Transit
⭐
17
Massively real-time city transit streaming application
Twitter Stream Api Dataset
⭐
16
Twitter Dynamic Dataset Api. Create any dataset YOU want.
Icicle
⭐
15
Icicle Streaming Query Language
Spark Streaming Visualize
⭐
15
Simple demonstration of how to build a complex real time machine learning visualization tool.
Makinage
⭐
15
Stream Processing Made Easy
Godsend
⭐
14
A simple and eloquent workflow for streaming messages to micro-services.
Richflow
⭐
13
A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.
Salesforce Rest Sdk
⭐
13
An SDK for the Salesforce Rest and Streaming (Bayeux) API
Twitter Stream Api
⭐
12
🐤 Another Twitter stream PHP library to retrieve filtered tweets on hot.
Frizzle
⭐
12
The magic message bus
Hyperstream
⭐
11
HyperStream
Ru202
⭐
11
Source code for the RU202 Redis Streams Course
Node File Upload
⭐
11
Example project how to stream files while doing upload with NodeJS and Express
Dotdotnet
⭐
11
C#.NET based DevFast NuGet package
Frafka
⭐
11
Frizzle for Apache Kafka
Pstl
⭐
10
Parallel Streaming Transformation Loader
Hermiter
⭐
10
Efficient Sequential and Batch Estimation of Univariate and Bivariate Probability Density Functions and Cumulative Distribution Functions along with Quantiles (Univariate) and Spearman's Correlation (Bivariate)
Specification
⭐
9
STTP Specification and Related Documentation
Graphzip
⭐
9
Mining graph streams using dictionary-based compression
Python_flask_file_streaming
⭐
9
Example of streaming files for upload/download in Python Flask
Streamingether
⭐
8
Streaming Ethereum market data published via Satori open data platform
Streambenchmarks
⭐
8
Suite of Benchmark Applications for Stream Processing Systems
Meetup Viz
⭐
8
http://alexklibisz.github.io/meetup-viz/ - real-time visualization of streaming data from the Meetup.com open events RSVP API.
Opcua Player
⭐
8
An OPC UA player that support replaying OPC UA data from file
Ds 503
⭐
7
Course Webpage for DS503 being taught at IIT Bhilai
Hstream
⭐
7
High Performance Stream Data Processing for IoT in 5G Era
Nestedsubtreehash
⭐
7
A distributed implementation of "Nested Subtree Hash Kernels for Large-Scale Graph Classification Over Streams" (ICDM 2012).
Spark Streaming Twitter
⭐
7
Building pipeline to process the real-time data using Spark and Mongodb.
Kinesis Redshift Streaming Demo
⭐
7
Streamdataio Js Sdk
⭐
7
The Streamdata.io JavaScript SDK
Aws Kinesis Local
⭐
7
Build for local AWS Kinesis
Kafka Boot
⭐
7
kafka-producer-consumer-with-spring-boot
Splex
⭐
7
Streaming Log Multiplexer - combine multiple logs to one
Video Stream
⭐
6
Fast HTTP Video Streaming Web API in ASP.NET MVC | C# | SQL Server FileStream
Streamdata Io Basic Demo Stockmarket Prices
⭐
6
Streamdata.io Stock Market Data Streaming To AWS S3 Data Lake Using Lambda Serverless
Labjack Controller
⭐
5
Easily stream data from LabJack T4 and T7 devices.
De 100 Days
⭐
5
data engineering 100 days 🤖 🧲 🦾 | #DE
Tnt4j Streams
⭐
5
TNT4J Streams allows data streaming, parsing from various data sources into TNT4J event sinks
Sample.starter_notebooks
⭐
5
Notebooks showing Streams applications written in Python
Donation Analytics
⭐
4
🤺 coding challenge from Insight Data Engineering Program 💯
Catenae Stopover
⭐
4
Microservices Framework for Stopover
Ptdc
⭐
4
Python Twitter Data Collector
Incremental Label Propagation
⭐
4
Incremental Label Propagation (ILP) - Incremental Semi-Supervised Learning from Streams for Object Classification
Gdax_to_remote_mongodb
⭐
4
The goal of this repository is to demonstrate how to stream data from an EC2 to a remote MongoDB instance hosted on another EC2.
Onlinestats
⭐
4
An online machine-learning library for creating robust statistical models of streaming data
Node File Management
⭐
4
Simple file management via a provider like S3
1-100 of 178 projects
Next >
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
Privacy policy
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.
