Awesome Open Source
Awesome Open Source
Combined Topics
data-stream
x
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
The Top 99 Data Stream Open Source Projects on Github
Categories
>
Data Processing
>
Data Stream
Awesome Bigdata
⭐
10,187
A curated list of awesome big data frameworks, ressources and other awesomeness.
Strimzi Kafka Operator
⭐
2,615
Apache Kafka running on Kubernetes
Boomfilters
⭐
1,348
Probabilistic data structures for processing continuous, unbounded streams.
Openscap
⭐
832
NIST Certified SCAP 1.2 toolkit
Datastream.io
⭐
761
An open-source framework for real-time anomaly detection using Python, ElasticSearch and Kibana
Go Streams
⭐
707
A lightweight stream processing library for Go
Automi
⭐
655
A stream processing API for Go (alpha)
Spreads
⭐
360
Series and Panels for Real-time and Exploratory Analysis of Data Streams
Pktvisor
⭐
358
pktvisor is an observability agent that summarizes deep network data streams in real time, enabling on-node and centralized data visibility and analysis
Scramjet
⭐
190
Simple yet powerful live data computation framework
Openhistorian
⭐
129
The Open Source Time-Series Data Historian
Flex
⭐
125
Probabilistic deep learning for data streams.
Tornado
⭐
75
The Tornado 🌪 framework, designed and implemented for adaptive online learning and data stream mining in Python.
Gocells
⭐
63
Tideland GoCells (Event Based Applications)
Appbase Js
⭐
41
Appbase.io streaming client lib for Javascript
Stream Learn
⭐
35
The stream-learn is an open-source Python library for difficult data stream analysis.
Stream
⭐
29
A framework for data stream modeling and associated data mining tasks such as clustering and classification. - R Package
Bboxdb
⭐
27
BBoxDB is a scalable, highly available, and distributed data store for multi-dimensional big data. The software supports operations like multi-dimensional range queries and spatial joins. In addition, data streams are supported.
Flink Connector Kudu
⭐
25
基于Apache-bahir-kudu-connector的flink-connector-kudu，支持Flink1.11.x DynamicTableSource/Sink，支持Range分区等
D3 Discriminative Drift Detector Concept Drift
⭐
21
unsupervised concept drift detection
Pwpae Concept Drift Detection And Adaptation
⭐
19
Online learning methods used to address concept drift in data streams. Code for the paper entitled "PWPAE: An Ensemble Framework for Concept Drift Adaptation in IoT Data Streams" accepted in IEEE GlobeCom 2021.
Kafka Ml
⭐
19
Kafka-ML: connecting the data stream with ML/AI frameworks (now TensorFlow)
Pachinko
⭐
18
modular plug-able media sorter
Mist
⭐
16
MIST: High-performance IoT Stream Processing
Analyzing Reddit Sentiment With Aws
⭐
16
Learn how to use Kinesis Firehose, AWS Glue, S3, and Amazon Athena by streaming and analyzing reddit comments in realtime. 100-200 level tutorial.
Comstream
⭐
15
In this project, we implemented a topic detection system on Twitter. This system reads tweets from a data stream and assigns them to one of the existing clusters or a new one. Each cluster acts as an agent, which makes the proposed approach a multi-agent system. There is also a coordinator, who monitors the whole system and coordinates the agent.
Pmuconnectiontester
⭐
15
Verifies data streams from synchrophasor measurement devices
Regulus.remote
⭐
15
A simple C# network library.
Adaptiverandomforest
⭐
14
Repository for the AdaptiveRandomForest algorithm implemented in MOA 2016-04
Sketches
⭐
13
HyperLogLog and other probabilistic data structures for mining in data streams
Richflow
⭐
13
A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.
Dspbench
⭐
12
a suite of benchmark applications for distributed data stream processing systems
Cdc
⭐
12
A library for performing Content-Defined Chunking (CDC) on data streams.
Nanocloudlogger
⭐
10
Simple cloud based logger for microcontrollers.
Rpi
⭐
10
RPJiOS: RPJ's RPi OS, a sensor data platform for the Raspberry Pi built with python2.7 and redis.
Oasw Concept Drift Detection And Adaptation
⭐
9
An online learning method used to address concept drift. Code for the paper entitled "A Lightweight Concept Drift Detection and Adaptation Framework for IoT Data Streams" published in IEEE Internet of Things Magazine.
Gh Repos
⭐
6
🗂 List all repositories on Github (separated by language)
Go Event Hub
⭐
5
Library to connect to the Azure Event Hub via AMQP 1.0 for the Go programming language (Golang) based on Apache Qpid Proton (an AMQP 1.0 C library)
Air
⭐
5
Real-time data stream classification and knowledge generation engine with no dependencies
Telestion Core
⭐
5
Telestion is a ground station software developed by the TelestionTeam for WüSpace projects.
Clipstream
⭐
4
ClipStream - multiple data streams clustering method
Twitter Sentiment Analysis
⭐
4
Twitter based sentiment analysis using JAVA and Hadoop. In this project we are doing the sentiment analysis on twitter data to analyse whether the tweets posted by people are positive or negative or neutral by checking the tweets with the AFFIN dictionary which has a set of 2500 words along with the value of each word ranging from -5 to +5 denoting whether tweets are positive or negative.
Unstructured Data Analysis
⭐
4
非结构化课程作业，包括社交网络、链路预测、数据流、文本分析
Sand
⭐
4
SAND: Semi-Supervised Adaptive Novel Class Detection and Classification over Data Stream
Echo
⭐
3
ECHO is a semi-supervised framework for classifying evolving data streams based on our previous approach SAND. The most expensive module of SAND is the change detection module, which has cubic time complexity. ECHO uses dynamic programming to reduce the time complexity. Moreover, ECHO has a maximum allowable sliding window size. If there is no concept drift detected within this limit, ECHO updates the classifiers and resets the sliding window. Experiment results show that ECHO achieves significant speed up over SAND while maintaining similar accuracy. Please refer to the paper (mentioned in the reference section) for further details.
Datahub Workshop
⭐
3
Repository for the DataHub Workshop, Knowledge Media Institute (KMi, Open University, Milton Keynes, UK) on the 12th of June 2018
Puro
⭐
3
Puro - Highly configurable data streams in Python 3.x
Reelay Codegen
⭐
3
A code generator from high-level formal specifications for monitoring and pattern matching sequential/temporal data.
Datastreamalgorithms
⭐
3
A Java package implementing algorithms for computing entropy and Gini index from time-changing data streams.
Automl Streams
⭐
3
AutoML framework for implementing automated machine learning on data streams
Fads K Anonymiser
⭐
3
Implementation of "Fast clustering-based anonymization approaches with time constraints for data streams".
Text Cluster
⭐
3
Offline and online (i.e., real-time) annotated clustering methods for text data.
Visualize Realtime Data Stream Chart In Flask
⭐
3
Automate Visualization of realtime data streams in chart.JS using Flask in python3.
Concept Drift Datasets Scikit Multiflow
⭐
3
concept drift datasets edited to work with scikit-multiflow directly
Historian
⭐
3
big data timeseries historian
Pack Binary
⭐
3
use to read or write binary files / binary data stream
Figmn C
⭐
2
Fast Incremental Gaussian Mixture Networks
Ux Dataflow
⭐
2
UX-Dataflow is a streaming capable data multiplexer that allows you to aggregate data and then process it using a Chain of Responsibility design pattern.
Tweepy Sparktwitteri
⭐
2
Data Practicum II
Minas
⭐
2
MINAS (MultI-class learNing Algorithm for data Streams) An algorithm to address novelty detection in data streams multi-class problems.
Queue_based_resampling
⭐
2
Queue-Based Resampling (QBR)
Barenboim
⭐
2
Barenboim is prepared to tackle with data streaming dependencies in concurrent flows
Paper 2019 Iceis
⭐
2
Detecting Influencers in Very Large Social Networks of Games
Idpso Elm S
⭐
2
Algorithms used in the following paper: OLIVEIRA, Gustavo HFMO et al. Time series forecasting in the presence of concept drift: A pso-based approach. In: 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI). IEEE, 2017. p. 239-246.
One Class Drift Detection
⭐
1
unsupervised concept drift detection with one-class classifiers
Clustream
⭐
1
Effective and efficient method for clustering large evolving data streams.
Undergradthesis Report Farsi
⭐
1
Repository for the Farsi version of my Undergraduate Thesis (SDMiner: A Tool for Mining Data Streams on Top of Apache Spark)
Student Manage Data Stream Class
⭐
1
This program demonstrates the use of DataInput and DataOutputStream classes
Sketchmodelling
⭐
1
Code supporting a series of experiments on the use of efficient sliding window sketches to aid in the modelling of time series.
Semi Supervised Active Learning Over Evolving Data Streams
⭐
1
Strategies based on active learning and semi supervised learning for classification, novelty detection and concept drift detection over data streams.
Chat Component App Simple
⭐
1
A React group chat demo powered by PubNub and reusable chat components.
Hierarchical Modulation
⭐
1
Simulations, Paper Submission Drafts and Patent Applications for Research on Hierarchical Modulations
Image_compare
⭐
1
comparaison d'image raster avec openlayers4
Castoe Streamer
⭐
1
A customizable data stream handler. Features a console and file transport. For those who seek more own stream support that's also possible!
Clusopt_core
⭐
1
Clustream, Streamkm++ and metrics utilities C/C++ bindings for python
Ciclad
⭐
1
ciclad C++ :: A super fast Streaming, memory ultra-lite, sliding-window Closed Itemset Miner
Clusopt
⭐
1
A data stream clusterer and hyper parameter optimizer using microservices.
Data Sequence Bytebuffer Datastream
⭐
1
c++ header-only lib for primitive type serialization similar(conceptually) to java's bytebuffer and datastream classes. No external dependencies
Dreamcatcher
⭐
1
A service that aggregates amateur radio data worldwide in real time for public use
Flink Consumer
⭐
1
This contains code for consuming event from an Event Hub/Kafka
Chapter 7
⭐
1
Code examples for Chapter 7 of Data Wrangling with JavaScript
Chum
⭐
1
Chunked Data Streams for Rust
Go Cells
⭐
1
Light-weight event-processing based on the idea of meshed cells with different pluggable behaviors
Datastream
⭐
1
Compressed binary data designed for inter-process communication.
Streamchaos
⭐
1
R package for analysis of nonlinear data streams
Moa Flow
⭐
1
Simple workflow API for MOA.
Gooweml
⭐
1
GOOWE-ML: A Novel Online Ensemble for Multi-Label Stream Classification
Rxjs
⭐
1
RXJS NOTE
Adl
⭐
1
This code refers to all experiments in our paper "Autonomous Deep Learning: Continual Learning Approach for Dynamic Environments"
Case.study Oop.fp.balance
⭐
1
Исследование 1. ООП и ФП -> поиск баланса / Case Study 1. OOP & FP -> Finding Balance
Orion
⭐
1
This repository contains the implmentation of a cluster-based outlier detection algorithm called Orion in Java.
Concept Drift
⭐
1
Concept Drift Detection Through Resampling - Algorithms Implementation
Sam Knn
⭐
1
A classifier for heterogeneous concept drift inspired in the biologically memory model.
Social Stocks
⭐
1
A Graphical Data and Analysis Tool
Cfimining
⭐
1
Closed Frequent Itemset Mining in Data Streams
Cohesionkit
⭐
1
Keep your data synchronized between all your screens.
Vysmaw
⭐
1
Fast visibility stream muncher
Adwin
⭐
1
Python implementation of adwin algorithm
Json File Parser
⭐
0
A CLI application that reads from a stream of JSON files, and computes some data-quality metrics
1-99 of 99 projects
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.
