Awesome Open Source
Awesome Open Source
Combined Topics
streaming-data x

The Top 206 Streaming Data Open Source Projects

Categories > Data Processing > Streaming Data
Awesome Bigdata ⭐ 11,473
A curated list of awesome big data frameworks, ressources and other awesomeness.
most recent commit a day ago
Miller ⭐ 5,880
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
total releases 64most recent commit 3 days ago
Benthos ⭐ 5,426
Fancy stream processing made operationally mundane
dependent packages 4total releases 518most recent commit a day ago
Kafka Ui ⭐ 4,105
Open-Source Web UI for Apache Kafka Management
most recent commit 18 hours ago
River ⭐ 3,915
🌊 Online machine learning in Python
dependent packages 12total releases 11most recent commit 18 hours agopypi river} Downloads
Smart_open ⭐ 2,691
Utils for streaming large files (S3, HDFS, gzip, bz2...)
dependent packages 156total releases 54most recent commit 3 days agopypi smart-open} Downloads
Smoothie ⭐ 2,171
Smoothie Charts: smooooooth JavaScript charts for realtime streaming data
dependent packages 10total releases 22most recent commit 5 months agonpm smoothie} Downloads
Pravega ⭐ 1,815
Pravega - Streaming as a new software defined storage primitive
dependent packages 23total releases 23most recent commit 2 days ago
Readyset ⭐ 1,627
ReadySet is a lightweight SQL caching engine written in Rust that helps developers enhance the performance and scalability of existing applications.
most recent commit a day ago
Trill ⭐ 1,200
Trill is a single-node query processor for temporal or streaming data.
total releases 19most recent commit 15 days ago
Streamz ⭐ 1,111
Real-time stream processing for python
dependent packages 21total releases 16most recent commit 16 days agopypi streamz} Downloads
Go Streams ⭐ 1,082
A lightweight stream processing library for Go
dependent packages 9total releases 18most recent commit 2 months ago
Zpl ⭐ 823
📐 Pushing the boundaries of simplicity
dependent packages 8total releases 188most recent commit a month agonpm zpl.c} Downloads
Memgraph ⭐ 761
Open-source graph database, built for real-time streaming data, compatible with Neo4j.
most recent commit 18 hours ago
Onlinestats.jl ⭐ 718
⚡ Single-pass algorithms for statistics
most recent commit 2 months ago
Scikit Multiflow ⭐ 545
A machine learning package for streaming data in Python. The other ancestor of River.
total releases 7most recent commit a year ago
Sparta ⭐ 521
Real Time Analytics and Data Pipelines based on Spark Streaming
most recent commit 3 years ago
Awesome Kafka ⭐ 514
A list about Apache Kafka
most recent commit 8 days ago
Swim ⭐ 448
Full stack application platform for building stateful microservices, streaming APIs, and real-time UIs
dependent packages 64total releases 32most recent commit 2 months agonpm @swim/codec} Downloads
You Cant Download This Image ⭐ 340
Downloading images from the web is as easy as right clicking them and selecting "Save image as..", right? Well, not anymore xD
most recent commit 4 months ago
Cloudflow ⭐ 321
Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.
dependent packages 7total releases 604most recent commit 15 days ago
Data Accelerator ⭐ 279
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
dependent packages 5total releases 26most recent commit a day agonpm datax-common} Downloads
Optbinning ⭐ 278
Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.
dependent packages 3total releases 23most recent commit 16 days agopypi optbinning} Downloads
Oandapy ⭐ 275
Python wrapper for the OANDA REST API
most recent commit 2 years ago
Bytewax ⭐ 268
Python Stream Processing
most recent commit 3 days ago
Rrcf ⭐ 202
🌲 Implementation of the Robust Random Cut Forest algorithm for anomaly detection on streams
most recent commit 2 years ago
Tractor ⭐ 187
structured concurrent, Python parallelism
total releases 33most recent commit 2 months ago
Kafka Streams In Action ⭐ 183
Source code for the Kafka Streams in Action Book
most recent commit a year ago
Pwpae Concept Drift Detection And Adaptation ⭐ 160
Data stream analytics: Implement online learning methods to address concept drift in data streams using the River library. Code for the paper entitled "PWPAE: An Ensemble Framework for Concept Drift Adaptation in IoT Data Streams" published in IEEE GlobeCom 2021.
most recent commit 2 months ago
Meros ⭐ 151
🪢 A fast utility that makes reading multipart responses simple
dependent packages 3total releases 27most recent commit 3 months agonpm meros} Downloads
Rangeless ⭐ 142
c++ LINQ -like library of higher-order functions for data manipulation
most recent commit 2 years ago
Gsf ⭐ 140
Grid Solutions Framework
dependent packages 17total releases 1,190most recent commit 6 days agonuget GSF.Core} Downloads
Machine ⭐ 118
Machine is a workflow/pipeline library for processing data
dependent packages 13total releases 172most recent commit a month ago
Openpdc ⭐ 107
Open Source Phasor Data Concentrator
most recent commit a day ago
Toolbox ⭐ 104
A Java Toolbox for Scalable Probabilistic Machine Learning
most recent commit 2 years ago
Axway Amplify Streams Js ⭐ 79
AMPLIFY Streams Javascript package containing SDK, documentation and sample applications
most recent commit 9 months ago
Packmatic ⭐ 78
Zipping on the fly
total releases 5most recent commit a year ago
Euphoria ⭐ 74
Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.
total releases 4most recent commit 2 years ago
Streaming Integrator ⭐ 72
A stream processing runtime that allows connecting any streaming data source to any destination and act on it
total releases 20most recent commit 3 days ago
Real Time Sentiment Tracking On Twitter For Brand Improvement And Trend Recognition ⭐ 69
A real-time interactive web app based on data pipelines using streaming Twitter data, automated sentiment analysis, and MySQL&PostgreSQL database (Deployed on Heroku)
most recent commit 3 years ago
Cinnamon ⭐ 66
CinnaMon is a Python library which offers a number of tools to detect, explain, and correct data drift in a machine learning system
total releases 4most recent commit a day ago
The Apache Ignite Book ⭐ 65
All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above
most recent commit 12 days ago
Materialize Tutorials ⭐ 56
Materialize is a streaming database for real-time analytics. This is a collection of Materialize demos and tutorials.
most recent commit 17 days ago
Nsdb ⭐ 52
Natural Series Database
most recent commit a year ago
Pravega Samples ⭐ 51
Sample Applications for Pravega.
most recent commit 2 months ago
Flexible Clustering ⭐ 49
Clustering for arbitrary data and dissimilarity function
most recent commit a year ago
Datadash ⭐ 48
Visualize and graph data in the terminal
most recent commit 3 years ago
D3 Bubble ⭐ 41
Showcasing d3 bubble chart using PubNub streaming data
most recent commit 6 years ago
Arc ⭐ 40
Programming Language for Continuous Deep Analytics
most recent commit 3 days ago
Windflow ⭐ 38
A C++17 Data Stream Processing Parallel Library for Multicores and GPUs
most recent commit a month ago
Mxfactorial ⭐ 36
a payment application intended for deployment by the united states treasury
most recent commit 13 days ago
Rxhttpclient ⭐ 36
Simple Http client (Use RxSwift for stream data)
most recent commit 3 years ago
Pysad ⭐ 35
Streaming Anomaly Detection Framework in Python (Outlier Detection for Streaming Data)
total releases 2most recent commit 2 years ago
Onlineai.jl ⭐ 31
Machine learning for sequential/streaming data
most recent commit 6 years ago
Cinje ⭐ 28
A Pythonic and ultra fast template engine DSL.
total releases 4most recent commit 9 days ago
Onlinestatsbase.jl ⭐ 26
Base types for OnlineStats.
most recent commit 21 days ago
Imtsl ⭐ 25
IMTSL - Incremental and Multi-feature Tensor Subspace Learning
most recent commit 2 years ago
Nestjs File Streaming ⭐ 24
NestJS File Streaming With MongoDB
most recent commit 10 months ago
Pandas_streaming ⭐ 22
Streaming API for pandas applied to big datasets
most recent commit 11 days ago
Twitter Network Analysis ⭐ 22
Analyzing a network of tweets and retweets using graph algorithms
most recent commit 5 months ago
Makinage ⭐ 21
Stream Processing Made Easy
most recent commit 7 months ago
Go Mesh ⭐ 20
Realtime data exchange platform for Smart Cities
total releases 7most recent commit 2 years ago
Examples ⭐ 20
DataTorrent code samples for guides, tutorials, blogs
most recent commit 5 years ago
Transit ⭐ 19
Massively real-time city transit streaming application
most recent commit 16 days ago
Ru202 ⭐ 17
Source code for the RU202 Redis Streams Course
most recent commit a month ago
Icicle ⭐ 16
Icicle Streaming Query Language
most recent commit 10 months ago
Twitter Stream Api Dataset ⭐ 16
Twitter Dynamic Dataset Api. Create any dataset YOU want.
most recent commit 3 years ago
Spark Streaming Visualize ⭐ 15
Simple demonstration of how to build a complex real time machine learning visualization tool.
most recent commit 7 years ago
Godsend ⭐ 14
A simple and eloquent workflow for streaming messages to micro-services.
most recent commit 5 years ago
Richflow ⭐ 13
A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.
dependent packages 1total releases 7most recent commit 5 years agonpm richflow} Downloads
Turbine Go ⭐ 13
Turbine Library for Go
most recent commit 6 days ago
Salesforce Rest Sdk ⭐ 13
An SDK for the Salesforce Rest and Streaming (Bayeux) API
most recent commit 3 years ago
Frizzle ⭐ 12
The magic message bus
dependent packages 2total releases 3most recent commit 4 years ago
Twitter Stream Api ⭐ 12
🐤 Another Twitter stream PHP library to retrieve filtered tweets on hot.
dependent packages 1most recent commit 5 years agopackagist mineur/twitter-stream-api} Downloads
Hermiter ⭐ 12
Efficient Sequential and Batch Estimation of Univariate and Bivariate Probability Density Functions and Cumulative Distribution Functions along with Quantiles (Univariate) and Spearman's Correlation (Bivariate)
most recent commit 25 days ago
Ofxmultipeerconnectivity ⭐ 12
openframeworks addons for iOS MultipeerConnectivity.framework
most recent commit 8 years ago
Node File Upload ⭐ 11
Example project how to stream files while doing upload with NodeJS and Express
most recent commit 4 years ago
Frafka ⭐ 11
Frizzle for Apache Kafka
total releases 9most recent commit 2 years ago
Dotdotnet ⭐ 11
C#.NET based DevFast NuGet package
total releases 24most recent commit 8 months ago
Hyperstream ⭐ 11
HyperStream
most recent commit 3 years ago
Aws Kinesis Local ⭐ 11
Build for local AWS Kinesis
most recent commit 2 months ago
Pstl ⭐ 10
Parallel Streaming Transformation Loader
most recent commit 4 years ago
Streambenchmarks ⭐ 9
Suite of Benchmark Applications for Stream Processing Systems
most recent commit 5 months ago
Specification ⭐ 9
STTP Specification and Related Documentation
most recent commit 2 years ago
Crandash ⭐ 9
Demo dashboard for Shiny, shows streaming CRAN log data
most recent commit 7 years ago
Python_flask_file_streaming ⭐ 9
Example of streaming files for upload/download in Python Flask
most recent commit 5 years ago
Rst ⭐ 9
[IEEE TSP 2021] “Robust Subspace Tracking with Missing Data and Outliers: Novel Algorithm with Convergence Guarantee”. IEEE Transactions on Signal Processing, 2021.
most recent commit 5 months ago
Graphzip ⭐ 9
Mining graph streams using dictionary-based compression
most recent commit 5 years ago
Rtclientsdk.net ⭐ 8
C# (.NET) implementation of the real-time protocol for Qualisys Track Manager
most recent commit 7 days ago
Meetup Viz ⭐ 8
http://alexklibisz.github.io/meetup-viz/ - real-time visualization of streaming data from the Meetup.com open events RSVP API.
most recent commit 7 years ago
Streamingether ⭐ 8
Streaming Ethereum market data published via Satori open data platform
most recent commit 3 years ago
Opcua Player ⭐ 8
An OPC UA player that support replaying OPC UA data from file
most recent commit a year ago
Spark Streaming Twitter ⭐ 7
Building pipeline to process the real-time data using Spark and Mongodb.
most recent commit 3 years ago
Hstream ⭐ 7
High Performance Stream Data Processing for IoT in 5G Era
most recent commit 3 years ago
Kafka Boot ⭐ 7
kafka-producer-consumer-with-spring-boot
most recent commit a year ago
Streamdataio Js Sdk ⭐ 7
The Streamdata.io JavaScript SDK
dependent packages 3total releases 6most recent commit 9 months agonpm streamdataio-js-sdk} Downloads
Tnt4j Streams ⭐ 7
TNT4J Streams allows data streaming, parsing from various data sources into TNT4J event sinks
dependent packages 11total releases 41most recent commit 3 days ago
Eon Spark ⭐ 7
Developers can create lovely visuals from live data streams. EON Spark is the visual representation of live streaming data, the way you would imagine. iOS, Android and web browsers.
total releases 12most recent commit 5 years ago
Splex ⭐ 7
Streaming Log Multiplexer - combine multiple logs to one
total releases 15most recent commit 2 years ago
Nestedsubtreehash ⭐ 7
A distributed implementation of "Nested Subtree Hash Kernels for Large-Scale Graph Classification Over Streams" (ICDM 2012).
most recent commit 4 months ago
1-100 of 206 projects
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,121,606)
Python  (865,695)
Java  (404,416)
Php  (293,699)
Typescript  (285,088)
C Plus Plus  (252,382)
Ruby  (223,378)
C  (190,138)
Shell  (179,132)
C Sharp  (174,070)
Golang  (168,135)
Swift  (67,905)
Rust  (65,448)
R  (61,063)
Dart  (59,151)
Objective C  (57,045)
Kotlin  (51,453)
Lua  (37,172)
Matlab  (32,393)
Perl  (30,738)
Language  (29,926)
Scala  (29,146)
Haskell  (20,812)
Powershell  (20,003)
Clojure  (19,428)
Bash  (19,043)
Elixir  (17,208)
Coffeescript  (17,173)
Assembly  (15,260)
Julia  (13,695)
Processing  (13,306)
Emacs Lisp  (10,699)
Basic  (10,677)
Flow  (10,516)
Solidity  (9,601)
Erlang  (9,104)
Groovy  (8,541)
Scheme  (8,428)
Ocaml  (6,885)
Pascal  (6,720)
Hack  (6,554)
Lisp  (6,351)
Fortran  (5,737)
Elm  (5,546)
Common Lisp  (5,431)
Dlang  (4,783)
Shell Script  (4,773)
Python Library  (4,499)
Crystal  (4,424)
Scripting  (4,233)
Privacy | About | Terms | Follow Us On Twitter | Top Projects

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.