Awesome Open Source
Awesome Open Source
Combined Topics
streaming-data
x
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
The Top 170 Streaming Data Open Source Projects on Github
Categories
>
Data Processing
>
Streaming Data
Awesome Bigdata
⭐
10,187
A curated list of awesome big data frameworks, ressources and other awesomeness.
Miller
⭐
4,387
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
Benthos
⭐
3,403
Declarative stream processing for mundane tasks and data engineering
Smart_open
⭐
2,206
Utils for streaming large files (S3, HDFS, gzip, bz2...)
River
⭐
1,973
🌊 Online machine learning in Python
Pravega
⭐
1,592
Pravega - Streaming as a new software defined storage primitive
Trill
⭐
1,142
Trill is a single-node query processor for temporal or streaming data.
Streamz
⭐
955
Real-time stream processing for python
Kafka Ui
⭐
733
Open-Source Web GUI for Apache Kafka Management
Go Streams
⭐
707
A lightweight stream processing library for Go
Zpl
⭐
686
📐 Pushing the boundaries of simplicity
Onlinestats.jl
⭐
582
⚡ Single-pass algorithms for statistics ⚡
Scikit Multiflow
⭐
545
A machine learning package for streaming data in Python. The other ancestor of River.
Sparta
⭐
521
Real Time Analytics and Data Pipelines based on Spark Streaming
Awesome Kafka
⭐
436
A list about Apache Kafka
Swim
⭐
392
Full stack application platform for building stateful microservices, streaming APIs, and real-time UIs
Cloudflow
⭐
300
Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.
Shioaji
⭐
289
Shioaji all new cross platform api for trading ( 跨平台證券交易API )
Data Accelerator
⭐
253
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Rrcf
⭐
202
🌲 Implementation of the Robust Random Cut Forest algorithm for anomaly detection on streams
Kafka Streams In Action
⭐
183
Source code for the Kafka Streams in Action Book
Optbinning
⭐
151
Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.
Rangeless
⭐
142
c++ LINQ -like library of higher-order functions for data manipulation
Tractor
⭐
131
structured concurrent, Python parallelism
Gsf
⭐
116
Grid Solutions Framework
Toolbox
⭐
104
A Java Toolbox for Scalable Probabilistic Machine Learning
Machine
⭐
96
Machine is a workflow/pipeline library for processing data
Openpdc
⭐
91
Open Source Phasor Data Concentrator
Axway Amplify Streams Js
⭐
80
AMPLIFY Streams Javascript package containing SDK, documentation and sample applications
Packmatic
⭐
78
Zipping on the fly
Euphoria
⭐
74
Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.
Real Time Sentiment Tracking On Twitter For Brand Improvement And Trend Recognition
⭐
69
A real-time interactive web app based on data pipelines using streaming Twitter data, automated sentiment analysis, and MySQL&PostgreSQL database (Deployed on Heroku)
Meros
⭐
65
👣 A fast utility that makes reading multipart responses simple
Streaming Integrator
⭐
52
A stream processing runtime that allows connecting any streaming data source to any destination and act on it
Nsdb
⭐
51
Natural Series Database
Datadash
⭐
48
Visualize and graph data in the terminal
The Apache Ignite Book
⭐
40
All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above
Rxhttpclient
⭐
36
Simple Http client (Use RxSwift for stream data)
Pysad
⭐
35
Streaming Anomaly Detection Framework in Python (Outlier Detection for Streaming Data)
Mxfactorial
⭐
35
a payment application intended for deployment by the united states treasury
Saber
⭐
34
Window-Based Hybrid CPU/GPU Stream Processing Engine
Flexible Clustering
⭐
31
Clustering for arbitrary data and dissimilarity function
Pravega Samples
⭐
30
Sample Applications for Pravega.
Download Using Streaming Response Body
⭐
28
An example for streaming large files in chunks using StreamingResponseBody in Spring MVC
Imtsl
⭐
25
IMTSL - Incremental and Multi-feature Tensor Subspace Learning
Cinje
⭐
24
A Pythonic and ultra fast template engine DSL.
Onlinestatsbase.jl
⭐
23
Base types for OnlineStats.
Windflow
⭐
21
A C++17 Data Stream Processing Parallel Library for Multicores and GPUs
Go Mesh
⭐
20
Realtime data exchange platform for Smart Cities
Nestjs File Streaming
⭐
17
NestJS File Streaming With MongoDB
Transit
⭐
17
Massively real-time city transit streaming application
Twitter Stream Api Dataset
⭐
16
Twitter Dynamic Dataset Api. Create any dataset YOU want.
Pandas_streaming
⭐
16
Streaming API for pandas applied to big datasets
Icicle
⭐
15
Icicle Streaming Query Language
Spark Streaming Visualize
⭐
15
Simple demonstration of how to build a complex real time machine learning visualization tool.
Godsend
⭐
14
A simple and eloquent workflow for streaming messages to micro-services.
Salesforce Rest Sdk
⭐
13
An SDK for the Salesforce Rest and Streaming (Bayeux) API
Richflow
⭐
13
A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.
Twitter Stream Api
⭐
12
🐤 Another Twitter stream PHP library to retrieve filtered tweets on hot.
Frizzle
⭐
12
The magic message bus
Makinage
⭐
11
Stream Processing Made Easy
Node File Upload
⭐
11
Example project how to stream files while doing upload with NodeJS and Express
Frafka
⭐
11
Frizzle for Apache Kafka
Hyperstream
⭐
11
HyperStream
Dotdotnet
⭐
11
C#.NET based DevFast NuGet package
Pstl
⭐
10
Parallel Streaming Transformation Loader
Python_flask_file_streaming
⭐
9
Example of streaming files for upload/download in Python Flask
Ru202
⭐
9
Source code for the RU202 Redis Streams Course
Specification
⭐
9
STTP Specification and Related Documentation
Graphzip
⭐
9
Mining graph streams using dictionary-based compression
Streamingether
⭐
8
Streaming Ethereum market data published via Satori open data platform
Meetup Viz
⭐
8
http://alexklibisz.github.io/meetup-viz/ - real-time visualization of streaming data from the Meetup.com open events RSVP API.
Opcua Player
⭐
8
An OPC UA player that support replaying OPC UA data from file
Hermiter
⭐
8
Efficient Sequential and Batch Estimation of Univariate and Bivariate Probability Density Functions and Cumulative Distribution Functions along with Quantiles (Univariate) and Spearman's Correlation (Bivariate)
Splex
⭐
7
Streaming Log Multiplexer - combine multiple logs to one
Spark Streaming Twitter
⭐
7
Building pipeline to process the real-time data using Spark and Mongodb.
Nestedsubtreehash
⭐
7
A distributed implementation of "Nested Subtree Hash Kernels for Large-Scale Graph Classification Over Streams" (ICDM 2012).
Ds 503
⭐
7
Course Webpage for DS503 being taught at IIT Bhilai
Hstream
⭐
7
High Performance Stream Data Processing for IoT in 5G Era
Streamdataio Js Sdk
⭐
7
The Streamdata.io JavaScript SDK
Kinesis Redshift Streaming Demo
⭐
7
Streamdata Io Basic Demo Stockmarket Prices
⭐
6
Streamdata.io Stock Market Data Streaming To AWS S3 Data Lake Using Lambda Serverless
Streambenchmarks
⭐
5
Suite of Benchmark Applications for Stream Processing Systems
Labjack Controller
⭐
5
Easily stream data from LabJack T4 and T7 devices.
Sample.starter_notebooks
⭐
5
Notebooks showing Streams applications written in Python
De 100 Days
⭐
5
data engineering 100 days 🤖 🧲 🦾 | #DE
Node File Management
⭐
4
Simple file management via a provider like S3
Incremental Label Propagation
⭐
4
Incremental Label Propagation (ILP) - Incremental Semi-Supervised Learning from Streams for Object Classification
Donation Analytics
⭐
4
🤺 coding challenge from Insight Data Engineering Program 💯
Gdax_to_remote_mongodb
⭐
4
The goal of this repository is to demonstrate how to stream data from an EC2 to a remote MongoDB instance hosted on another EC2.
Ptdc
⭐
4
Python Twitter Data Collector
Catenae Stopover
⭐
4
Microservices Framework for Stopover
Contpl
⭐
4
ConTPL: Controlling Temporal Privacy Leakage in Streaming Data Release with Differential Privacy
Aws Kinesis Local
⭐
4
Build for local AWS Kinesis
Utilities
⭐
4
Utilities for Modern C++
Iotstreammining Tpt
⭐
4
Official repo for DK904 - IOT Stream Data Mining
Tnt4j Streams
⭐
4
TNT4J Streams allows data streaming, parsing from various data sources into TNT4J event sinks
Onlinestats
⭐
4
An online machine-learning library for creating robust statistical models of streaming data
Livelinq
⭐
3
Streaming LINQ for .NET
Undkafka
⭐
3
This repository contains Exercise solutions to Data-Streaming Nanodegree on UDACITY
1-100 of 170 projects
Next >
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.
