Awesome Open Source

Programming Languages

Search results for stream processing

stream-processing x

362 search results found

Logisland ⭐ 106

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Pulsar Spark ⭐ 103

Spark Connector to read and write with Pulsar

A high performance/ real-time C++ Kafka streams framework (C++17)

Repository with DC/OS demos to show specific use cases, usually industry specific.

Kafka Spark Streaming Example ⭐ 96

Simple examle for Spark Streaming over Kafka topic

React Player ⭐ 96

One audio player built with ReactJS, Web Audio API and Web Worker API

Flink Connectors ⭐ 93

Apache Flink connectors for Pravega.

Hailstorm ⭐ 85

Haskell distributed stream processing with exactly-once semantics

Tensorflow Serving Java Grpc Kafka Streams ⭐ 85

Kafka Streams + Java + gRPC + TensorFlow Serving => Stream Processing combined with RPC / Request-Response

Functional programming with Kafka and Scala

Mirotalkbro ⭐ 78

📡 MiroTalk WebRTC Live Broadcast allows to broadcast live video, audio and screen stream to all connected users (viewers).

Kafka Streams Real Time Stream Processing ⭐ 76

This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.

Fs2 Kafka ⭐ 75

Kafka client for functional streams for scala (fs2)

RTEC is an Event Calculus implementation optimised for stream reasoning

Fluxtion ⭐ 74

core fluxtion static event processor generator tool and runtime components

Product Sp ⭐ 74

An open source, cloud-native streaming data integration and analytics product optimized for agile digital businesses

Generic Reusable Parallel Patterns Interface

Scotty Window Processor ⭐ 71

This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.

Elkeid Hub ⭐ 70

Elkeid HUB is a rule/event processing engine maintained by the Elkeid Team that supports streaming/offline (not yet supported by the community edition) data processing. The original intention is to solve complex data/event processing and external system linkage requirements through standardized rules.

Gostream ⭐ 70

A Go port of the Java Streams API. Type-safe and functional Go Streams processing for Go 1.18+.

Toolkit for graph-relational data across space and time

Real Time Sentiment Tracking On Twitter For Brand Improvement And Trend Recognition ⭐ 69

A real-time interactive web app based on data pipelines using streaming Twitter data, automated sentiment analysis, and MySQL&PostgreSQL database (Deployed on Heroku)

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

Dynatrace hash library for Java

Event_sourcing_for_everyone ⭐ 65

Quic Rpc ⭐ 65

A streaming rpc system based on quic

Kafka Shell ⭐ 65

⚡A supercharged, interactive Kafka shell built on top of the existing Kafka CLI tools.

River Js ⭐ 64

Unbounded stream processing in node.js

Transform Hub ⭐ 63

Scramjet Transform Hub (STH) is a runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters. It connects to Scramjet Spaces in Scramjet Cloud Platform.

Pg2kafka ⭐ 63

Ship changes in Postgres 🐘 to Kafka 📖

Elegant stream processing pipeline written entirely in Golang

Ksqldb Go ⭐ 59

A Golang client for ksqlDB

Windflow ⭐ 58

A C++17 Data Stream Processing Parallel Library for Multicores and GPUs

stream is a concurrency pattern implementation using Go generics. a.k.a. my accidentally awesome library

Pipeline ⭐ 56

Build streaming pipelines in PHP. The missing pipe operator. General-purpose collection pipeline. Since 2017.

Dspatcher ⭐ 55

Cross-Platform Graphical Tool for DSPatch

Eventstoredb Client Java ⭐ 55

Official Asynchronous Java 8+ Client Library for EventStoreDB 20.6+

Gostream ⭐ 54

Stream Processing library for Go

Data_processing_course ⭐ 53

Some class materials for a data processing course using PySpark

Streamprocessing_readinglist ⭐ 52

stream processing reading list

Flink K8s Toolbox ⭐ 50

Flink Kubernetes Toolbox is the Swiss Army knife for deploying and managing Apache Flink on Kubernetes

Converts csv data to markdown tables

Parallelize _anything_ //

Vertx Reactive Streams ⭐ 48

Complete log pipeline solution in Python. Runs fast in Go.

Kafka Fraud Detector ⭐ 47

🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python

High-Performance Erlang Stream Processor

Track and Trace 4 Java API, Application event streaming and logging framework for correlation, diagnostics and tracking of application activities.

Infoworld Post ⭐ 43

Code examples for a blog post on infoworld.com

A Redis dehydrator module

Storm Dynamic Spout ⭐ 41

A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.

Taxi Demo Rp Mz Rv Rd St ⭐ 40

🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations

Gretel Python Client ⭐ 40

The Gretel Python Client allows you to interact with the Gretel REST API.

Mxfactorial ⭐ 40

a payment application intended for deployment by the united states treasury that replaces banking with accounting

This repository contains open-source sample applications for IBM Streams.

Pystream Protobuf ⭐ 39

Python implementation of stream library for streaming google protocol buffer objects

Window-Based Hybrid CPU/GPU Stream Processing Engine

Concurrent.cr ⭐ 38

Modern concurrency tools for Crystal

Eye_of_sauron ⭐ 37

Stream processing using kafka-python to track people (user input images of target) in the wild over multiple video streams.

Geeguide ⭐ 37

Harmonization of Landsat and Sentinel 2 in Google Earth Engine, documentation and scripts

Lightsaber ⭐ 35

Multi-core Window-Based Stream Processing Engine

A library to build streaming applications that consume from and produce to Kafka.

Ksql Recipes Try It At Home ⭐ 35

Files needed to try out KSQL Recipes for yourself

Watermill.rs ⭐ 35

🦀 Online statistics in Rust

Streamsx.health ⭐ 34

(Incubation) Streams Healthcare Analytics Platform - To enable and inspire the next generation healthcare solutions

Briskstream ⭐ 33

A Multicore, NUMA Optimised Data Stream Processing System

Theodolite ⭐ 33

Theodolite is a framework for benchmarking the horizontal and vertical scalability of cloud-native applications.

智能数据探索服务(Intelligent Data Exploration Service)，一站式Data + AI数据解决方案！

Pure Java implementation of H264 decoder to replace Xuggler

Streamsx.messaging ⭐ 30

This toolkit is focused on interacting with popular messaging systems such as Kafka, JMS, XMS, and MQTT. After release v5.4.2 the complete toolkit will be deprecated. See the README.md file for hints to alternative toolkits.

Simple, high-performance event streaming broker

Benthos Captain ⭐ 30

A Kubernetes Operator to orchestrate Benthos pipelines

Table Computing ⭐ 29

Table-Computing (Simplified as TC) is a high performance and low latency computing framework, 10x faster than Flink for complicated use cases, distributed and light weighted, relational operation, simple to use, write less and do more.

RSP4J a library for RDF Stream Processing

Fault-tolerant multithreaded stream processing for Ruby

Kafka Workers ⭐ 28

Kafka Workers is a client library which unifies records consuming from Kafka and processing them by user-defined WorkerTasks.

Antimony Core ⭐ 28

a real-time stream processing and distributed computation system written purely in Rust.

Stream Processors on Kafka in Golang

Numalogic Prometheus ⭐ 27

AIOps for metrics in Prometheus

A header-only C++ library for system-level verification and declarative testing of real-time systems with Python bindings.

Akka_streams_tutorial ⭐ 27

A collection of runnable and self-contained examples inspired by various akka-streams (pekko-streams) and Alpakka (Pekko connectors) docs, tutorials and blogs

Football Events ⭐ 27

Event-Driven microservices with Kafka Streams

Massively real-time traffic streaming application

Stream Handbook ⭐ 26

How to write node programs with streams

⚙️ Ralph, the ultimate Learning Record Store (and more!) for your learning analytics

Spark Structured Streaming Examples ⭐ 25

Spark structured streaming examples with using of version 3.4.0

Streams Bootstrap ⭐ 25

Utility functions and base classes for Kafka Streams applications

Examples ⭐ 25

This repository will contain examples of use cases that utilize Decodable streaming solution

Streampipes Extensions ⭐ 25

Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams. This repository contains ready-to-use pipeline elements and adapters for StreamPipes Connect

Affinity ⭐ 24

Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka

Jetprobe ⭐ 24

🚀 Validation DSL for data pipelines

Go Rivers ⭐ 24

Collection of stream processing / multiplexing / networking libs in Go

Event Sourcing Kafka Streams ⭐ 24

Demo code from my talk @ Codemotion Milan 2018 - "Building event sourced systems with Kafka Streams"

Open Stream Processing Benchmark ⭐ 24

This repository contains the code base for the Open Stream Processing Benchmark.

Redisgears Py ⭐ 23

RedisGears python client

Dspatchables ⭐ 22

DSPatch Component Repository

functional STReam processing for the IOT

Perfect Kafka ⭐ 21

An Express Swift Client of Apache Kafka 0.8, the Stream Processing Platform

Redis Stream Demo ⭐ 21

Demo for Redis Streams

Makinage ⭐ 21

Stream Processing Made Easy

101-200 of 362 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.