Awesome Open Source
Awesome Open Source
Combined Topics
stream-processing x

The Top 603 Stream Processing Open Source Projects

Categories > Data Processing > Stream Processing
Mediapipe ⭐ 19,543
Cross-platform, customizable ML solutions for live and streaming media.
dependent packages 94total releases 24most recent commit 8 hours agopypi mediapipe} Downloads
Flink Learning ⭐ 12,942
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《 Flink 实战与性能优化》
most recent commit 5 days ago
Vector ⭐ 11,858
A high-performance observability data pipeline.
total releases 3most recent commit 6 hours ago
Awesome Bigdata ⭐ 11,122
A curated list of awesome big data frameworks, ressources and other awesomeness.
most recent commit 3 months ago
Faust ⭐ 6,245
Python Stream Processing
dependent packages 15total releases 46most recent commit 4 months agopypi faust} Downloads
Awesome System Design ⭐ 5,986
A curated list of awesome System Design (A.K.A. Distributed Systems) resources.
most recent commit 3 months ago
Ksql ⭐ 5,302
The database purpose-built for stream processing applications.
most recent commit 8 hours ago
Hazelcast ⭐ 5,127
Open-source distributed computation and storage platform
dependent packages 361total releases 240most recent commit 9 hours ago
Benthos ⭐ 5,103
Fancy stream processing made operationally mundane
dependent packages 4total releases 518most recent commit 7 hours ago
Watermill ⭐ 4,834
Building event-driven applications the easy way in Go.
dependent packages 104total releases 40most recent commit 11 days ago
Materialize ⭐ 4,657
The Fastest Way to Build the Fastest Data Products. Build data-intensive applications and services in SQL — without pipelines or caches — using materialized views that are always up-to-date.
total releases 2most recent commit 6 hours ago
Fluent Bit ⭐ 4,139
Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows
total releases 3most recent commit 6 hours ago
Danfojs ⭐ 3,904
Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.
dependent packages 3total releases 36most recent commit 19 days agonpm danfojs-node} Downloads
River ⭐ 3,885
🌊 Online machine learning in Python
dependent packages 12total releases 11most recent commit 16 hours agopypi river} Downloads
Hudi ⭐ 3,709
Upserts, Deletes And Incremental Processing on Big Data.
dependent packages 26total releases 13most recent commit 6 hours ago
Risingwave ⭐ 3,573
RisingWave: the next-generation streaming database in the cloud.
most recent commit 6 hours ago
Dpark ⭐ 2,637
Python clone of Spark, a MapReduce alike framework in Python
total releases 19most recent commit 2 years ago
Pipelinedb ⭐ 2,303
High-performance time-series aggregation for PostgreSQL
most recent commit 4 years ago
Awesome Streaming ⭐ 2,126
a curated list of awesome streaming frameworks, applications, etc
most recent commit 2 days ago
Gojay ⭐ 1,991
fastest JSON encoder/decoder with powerful stream API for Golang
dependent packages 270total releases 4most recent commit a year ago
Riko ⭐ 1,573
A Python stream processing engine modeled after Yahoo! Pipes
total releases 59most recent commit a year ago
Wally ⭐ 1,453
Distributed Stream Processing
most recent commit 2 years ago
Siddhi ⭐ 1,399
Stream Processing and Complex Event Processing Engine
dependent packages 90total releases 34most recent commit 5 days ago
Yomo ⭐ 1,281
🦖 Serverless Streaming Framework for low-latency geo-distributed system and realtime collaboration application, running atop QUIC protocol, as Metaverse infrastructure, engaging 5G technology.
dependent packages 7total releases 73most recent commit 2 days ago
Go Streams ⭐ 1,082
A lightweight stream processing library for Go
dependent packages 9total releases 18most recent commit a month ago
Hazelcast Jet ⭐ 975
Distributed Stream and Batch Processing
most recent commit 8 months ago
Spring Cloud Dataflow ⭐ 937
A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
dependent packages 5total releases 71most recent commit 13 days ago
Manifold ⭐ 914
A compatibility layer for event-driven abstractions
total releases 52most recent commit 6 months ago
Wormhole ⭐ 863
Wormhole is a SPaaS (Stream Processing as a Service) Platform
most recent commit 2 years ago
Spring Cloud Stream ⭐ 847
Framework for building Event-Driven Microservices
dependent packages 36total releases 56most recent commit 7 days ago
Json Machine ⭐ 770
Efficient, easy-to-use, and fast PHP JSON stream parser
dependent packages 11total releases 19most recent commit a month agopackagist halaxa/json-machine} Downloads
Gearpump ⭐ 758
Lightweight real-time big data streaming engine over Akka
dependent packages 16total releases 21most recent commit 9 months ago
Faust ⭐ 752
Python Stream Processing. A Faust fork
dependent packages 9total releases 167most recent commit 6 days agopypi faust-streaming} Downloads
Kafka Streams ⭐ 728
equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨
dependent packages 6total releases 43most recent commit 8 months agonpm kafka-streams} Downloads
Memgraph ⭐ 716
Open-source graph database, built for real-time streaming data, compatible with Neo4j.
most recent commit 9 hours ago
Stream Json ⭐ 708
The micro-library of Node.js stream components for creating custom JSON processing pipelines with a minimal memory footprint. It can parse JSON files far exceeding available memory streaming individual primitives using a SAX-inspired API.
dependent packages 110total releases 43most recent commit 5 days agonpm stream-json} Downloads
Automi ⭐ 655
A stream processing API for Go (alpha)
dependent packages 1total releases 3most recent commit a year ago
Streaming Readings ⭐ 640
Streaming System 相关的论文读物
most recent commit 10 months ago
Flink Sql Cookbook ⭐ 594
The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.
most recent commit 21 days ago
Hstream ⭐ 563
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
total releases 4most recent commit 16 hours ago
Awesome Kafka ⭐ 513
A list about Apache Kafka
most recent commit 8 days ago
Core ⭐ 442
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
dependent packages 2total releases 39most recent commit 3 months ago
Psi ⭐ 427
Platform for Situated Intelligence
dependent packages 34total releases 17most recent commit 10 days agonuget Microsoft.Psi.Runtime} Downloads
Kasper ⭐ 413
Kasper is a lightweight library for processing Kafka topics.
most recent commit 5 years ago
Pqstream ⭐ 410
pqstream turns your postgres database into an event stream
most recent commit 3 years ago
Hudi Resources ⭐ 394
汇总Apache Hudi相关资料
most recent commit 2 days ago
Norikra ⭐ 363
Schemaless Stream Processing (Complex Event Processing) Server with SQL
most recent commit 2 years ago
Streampipes ⭐ 355
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
most recent commit 7 hours ago
Smooks ⭐ 351
Extensible data integration Java framework for building XML and non-XML fragment-based applications
dependent packages 12total releases 20most recent commit 7 days ago
Nussknacker ⭐ 342
A visual tool to define and run real-time decision algorithms. Brings agility to business teams, liberates developers to focus on technology.
dependent packages 14total releases 13most recent commit 8 hours ago
Amadeus ⭐ 334
Harmonious distributed data analysis in Rust.
dependent packages 7total releases 25most recent commit a year agocargo amadeus-core} Downloads
Numaflow ⭐ 301
Kubernetes-native platform to run massively parallel data/streaming jobs
most recent commit 10 hours ago
Redisgears ⭐ 265
Dynamic execution framework for your Redis data
most recent commit 7 days ago
Bytewax ⭐ 261
A Python framework for building highly scalable dataflows.
most recent commit 15 hours ago
Pulsar Flink ⭐ 255
Elastic data processing with Apache Pulsar and Apache Flink
total releases 71most recent commit 7 months ago
Kafka Tutorials ⭐ 248
Tutorials and Recipes for Apache Kafka
most recent commit 7 hours ago
Examples Java ⭐ 238
Stream Processing with Apache Flink - Java Examples
most recent commit 9 months ago
Media Stream Library Js ⭐ 237
JavaScript library to handle media streams on the command line (Node.js) and in the browser.
dependent packages 2total releases 61most recent commit 6 months agonpm media-stream-library} Downloads
Dagger ⭐ 235
Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.
most recent commit 4 days ago
Pluck ⭐ 194
Pluck text in a fast and intuitive way 🐓
total releases 7most recent commit 3 years ago
Vectorsql ⭐ 191
VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.
most recent commit a year ago
Kafka Streams In Action ⭐ 183
Source code for the Kafka Streams in Action Book
most recent commit a year ago
Logrange ⭐ 183
High performance data aggregating storage
total releases 12most recent commit 2 years ago
Akka Stream Contrib ⭐ 174
Add-ons to Akka Stream
dependent packages 11total releases 18most recent commit 9 months ago
Fero ⭐ 173
light, fast, scalable, streaming microservices made easy
most recent commit 5 years ago
Function Mesh ⭐ 170
The serverless framework purpose-built for event streaming applications.
total releases 85most recent commit 18 hours ago
Talaria ⭐ 163
TalariaDB is a distributed, highly available, and low latency time-series database for Presto
most recent commit a month ago
Futuresdr ⭐ 160
An Async SDR Runtime for Heterogeneous Architectures
dependent packages 2total releases 3most recent commit 5 days agocargo futuresdr-pmt} Downloads
Neo4j Streams ⭐ 157
Neo4j Kafka Integrations, Docs =>
most recent commit 24 days ago
Dolphinbeat ⭐ 153
A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.
most recent commit 4 years ago
Xlstream ⭐ 145
Turns XLSX into a readable stream.
dependent packages 4total releases 32most recent commit a month agonpm xlstream} Downloads
Gsf ⭐ 140
Grid Solutions Framework
dependent packages 17total releases 1,190most recent commit 2 days agonuget GSF.Core} Downloads
Dspatch ⭐ 139
The Refreshingly Simple Cross-Platform C++ Dataflow / Patching / Pipelining / Stream Processing / Reactive Programming Framework
most recent commit 8 days ago
Wayeb ⭐ 139
Wayeb is a Complex Event Processing and Forecasting (CEP/F) engine written in Scala.
most recent commit a year ago
Log Anomaly Detector ⭐ 134
Log Anomaly Detection - Machine learning to detect abnormal events logs
total releases 8most recent commit 2 years ago
Daggy ⭐ 134
Daggy - Data Aggregation Utility and C/C++ developer library for data streams catching
most recent commit 3 months ago
Libretto ⭐ 129
Declarative concurrency and stream processing library for Scala
total releases 4most recent commit 18 days ago
Mage ⭐ 123
MAGE - Memgraph Advanced Graph Extensions 🔮
total releases 7most recent commit 7 days ago
Samsara ⭐ 120
Samsara is a real-time analytics platform
total releases 6most recent commit 3 years ago
Spoc ⭐ 119
Stream Processing with OCaml
most recent commit 9 months ago
Machine ⭐ 118
Machine is a workflow/pipeline library for processing data
dependent packages 13total releases 172most recent commit 21 days ago
Stream Registry ⭐ 110
Stream Discovery and Stream Orchestration
dependent packages 2total releases 33most recent commit 6 days ago
Go Kafka Example ⭐ 108
Golang Kafka consumer and producer example
most recent commit 2 years ago
Openpdc ⭐ 107
Open Source Phasor Data Concentrator
most recent commit 2 days ago
Logisland ⭐ 105
Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.
dependent packages 34total releases 11most recent commit a year ago
Kspp ⭐ 97
A high performance/ real-time C++ Kafka streams framework (C++17)
most recent commit 2 months ago
React Player ⭐ 96
One audio player built with ReactJS, Web Audio API and Web Worker API
most recent commit 18 days ago
Demos ⭐ 96
Repository with DC/OS demos to show specific use cases, usually industry specific.
most recent commit 3 years ago
Kafka Spark Streaming Example ⭐ 96
Simple examle for Spark Streaming over Kafka topic
most recent commit 2 years ago
Pulsar Spark ⭐ 93
When Apache Pulsar meets Apache Spark
total releases 3most recent commit 8 days ago
Flink Connectors ⭐ 91
Apache Flink connectors for Pravega.
total releases 9most recent commit 7 days ago
Tensorflow Serving Java Grpc Kafka Streams ⭐ 85
Kafka Streams + Java + gRPC + TensorFlow Serving => Stream Processing combined with RPC / Request-Response
most recent commit 3 years ago
Hailstorm ⭐ 85
Haskell distributed stream processing with exactly-once semantics
most recent commit 8 years ago
Remotecodecompiler ⭐ 81
An online code compiler supporting 11 programming languages (Java, Kotlin, Scala, C, C++, C#, Golang, Python, Ruby, Rust and Haskell) for competitive programming and coding interviews.
most recent commit 3 days ago
Csv ⭐ 77
Fast C# CSV parser
dependent packages 2total releases 2most recent commit 5 months agonuget NReco.Csv} Downloads
Kafka Streams Real Time Stream Processing ⭐ 76
This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.
most recent commit 2 years ago
Kafka4s ⭐ 75
Functional programming with Kafka and Scala
total releases 40most recent commit 6 days ago
Fs2 Kafka ⭐ 75
Kafka client for functional streams for scala (fs2)
total releases 8most recent commit 3 years ago
Product Sp ⭐ 74
An open source, cloud-native streaming data integration and analytics product optimized for agile digital businesses
dependent packages 1total releases 6most recent commit 3 years ago
Grppi ⭐ 72
Generic Reusable Parallel Patterns Interface
most recent commit 18 days ago
1-100 of 603 projects
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,114,612)
Python  (860,459)
Java  (402,966)
Php  (292,746)
Typescript  (281,047)
C Plus Plus  (251,243)
Ruby  (223,115)
C  (189,468)
Shell  (178,484)
C Sharp  (173,233)
Golang  (167,331)
Swift  (67,673)
Rust  (64,694)
R  (60,818)
Dart  (58,623)
Objective C  (57,044)
Kotlin  (50,945)
Lua  (36,944)
Matlab  (32,297)
Perl  (30,697)
Language  (29,924)
Scala  (29,110)
Haskell  (20,749)
Powershell  (19,905)
Clojure  (19,387)
Bash  (19,012)
Coffeescript  (17,177)
Elixir  (17,147)
Assembly  (15,188)
Julia  (13,615)
Processing  (13,290)
Basic  (10,688)
Emacs Lisp  (10,669)
Flow  (10,517)
Solidity  (9,511)
Erlang  (9,088)
Groovy  (8,508)
Scheme  (8,422)
Ocaml  (6,870)
Pascal  (6,688)
Hack  (6,547)
Lisp  (6,346)
Fortran  (5,726)
Elm  (5,537)
Common Lisp  (5,421)
Visual Basic  (4,960)
Dlang  (4,780)
Shell Script  (4,761)
Python Library  (4,491)
Crystal  (4,419)
Privacy | About | Terms | Follow Us On Twitter | Top Projects

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.