Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for streaming kafka
kafka
x
streaming
x
255 search results found
Flink Learning
⭐
13,801
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《 Flink 实战与性能优化》
Redpanda
⭐
8,709
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
Ksql
⭐
5,739
The database purpose-built for stream processing applications.
Materialize
⭐
5,547
The data warehouse for operational workloads.
Jocko
⭐
4,818
Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
Liftbridge
⭐
2,413
Lightweight, fault-tolerant message streams.
Examples
⭐
1,821
Apache Kafka and Confluent Platform examples and demos
Flink Streaming Platform Web
⭐
1,698
基于flink的实时流计算web平台
Killrweather
⭐
1,174
KillrWeather is a reference application (work in progress) showing how to easily integrate streaming and batch data processing with Apache Spark Streaming, Apache Cassandra, Apache Kafka and Akka for fast, streaming computations on time series data in asynchronous event-driven environments.
Pathway
⭐
1,118
Pathway is a high-throughput, low-latency data processing framework that handles live data & streaming for you. Made with ❤️ for Python & ML/AI developers.
Kafka Connect Jdbc
⭐
980
Kafka Connect connector for JDBC-compatible databases
Stream Reactor
⭐
960
A collection of open source Apache 2.0 Kafka Connector maintained by Lenses.io.
Brooklin
⭐
875
An extensible distributed system for reliable nearline data streaming at scale
Kafka In Production
⭐
853
📚 Tech blogs & talks by companies that run Kafka in production
Hstream
⭐
668
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
Nussknacker
⭐
564
Low-code tool for automating actions on real time data | Stream processing for the users.
Sparta
⭐
526
Real Time Analytics and Data Pipelines based on Spark Streaming
Cp Demo
⭐
515
Confluent Platform Demo including Apache Kafka, ksqlDB, Control Center, Schema Registry, Security, Schema Linking, and Cluster Linking
Kafka Connect Hdfs
⭐
473
Kafka Connect HDFS connector
Tributary
⭐
424
Streaming reactive and dataflow graphs in Python
Real Time Stock Market Prediction
⭐
395
In this repository, I have developed the entire server-side principal architecture for real-time stock market prediction with Machine Learning. I have used Tensorflow.js for constructing ml model architecture, and Kafka for real-time data streaming and pipelining.
Jackdaw
⭐
359
A Clojure library for the Apache Kafka distributed streaming platform.
Airy
⭐
355
💬 Open Source App Framework to build streaming apps with real-time data - 💎 Build real-time data pipelines and make real-time data universally accessible - 🤖 Join historical and real-time data in the stream to create smarter ML and AI applications. - ⚡ Standardize complex data ingestion and stream data to apps with pre-built connectors
Firehose
⭐
312
Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
Automq For Kafka
⭐
304
A cloud native implementation for Apache Kafka, reducing your cloud infrastructure bill by up to 90%.
Data Accelerator
⭐
293
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Storagetapper
⭐
269
StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service
Sparkstreaming
⭐
253
Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志
Azure Event Hubs Spark
⭐
225
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Streaming At Scale
⭐
224
How to implement a streaming at scale solution in Azure
Voik
⭐
217
♒︎ [WIP] An experimental ~distributed~ commit-log
Feldera
⭐
199
Feldera Continuous Analytics Platform
Ksql Udf Deep Learning Mqtt Iot
⭐
188
Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data
Kafka Streams In Action
⭐
183
Source code for the Kafka Streams in Action Book
Spark Streaming With Kafka
⭐
161
Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference
⭐
159
Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required
Streamline
⭐
156
StreamLine - Streaming Analytics
Spark Structured Streaming Examples
⭐
153
Spark Structured Streaming / Kafka / Cassandra / Elastic
Spark Kafka
⭐
136
Low level integration of Spark and Kafka
Postgres Kafka Demo
⭐
116
Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.
Nats Kafka
⭐
109
NATS to Kafka Bridging
Streamis
⭐
96
Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.
Kafka Spark Streaming Example
⭐
96
Simple examle for Spark Streaming over Kafka topic
Streamx
⭐
95
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Learning Spark
⭐
94
Practical examples of using Apache Spark in several different use cases
Kafka Connect Web
⭐
91
Web tool for operating kafka connect https://hub.docker.com/r/officialkakao/kafka-conne
Blog Spark Streaming Log Aggregation
⭐
91
Example of use of Spark Streaming with Kafka
Kafta
⭐
87
Kafta is a command line for managing Kafka clusters
Kotlin Kafka
⭐
87
Kafka bindings for Kotlin `suspend`, and Kafka streaming operators for KotlinX Flow.
Automq For Rocketmq
⭐
86
A cloud native implementation for Apache RocketMQ 5.0
Kafka Sparkstreaming Cassandra
⭐
86
Docker container for Kafka - Spark Streaming - Cassandra
Recipes
⭐
85
The Immerok Apache Flink Cookbook is a collection of examples of Apache Flink applications in the format of "recipes". Each recipe explains how you can solve a specific problem by leveraging one or more of the APIs of Apache Flink. The recipes can be extended or provide a basis for solving your requirements with Apache Flink.
Hydra
⭐
82
A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.
Twitter Sentiment Analysis Using Spark Streaming And Kafka
⭐
78
Twitter Sentiment Analysis using Spark and Kafka
Fs2 Kafka
⭐
75
Kafka client for functional streams for scala (fs2)
Product Sp
⭐
74
An open source, cloud-native streaming data integration and analytics product optimized for agile digital businesses
Clojure Kafka Examples
⭐
72
Clojure examples for Kafka and Kafka Streams (JAVA Interop)
Zipkin Sparkstreaming
⭐
72
A streaming alternative to Zipkin's collector
Kafka Streams Workshop
⭐
71
Cookiecutter Faust
⭐
70
A Cookiecutter template for creating Faust projects quickly.
Kafka Spark Streaming Zeppelin Docker
⭐
68
One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)
Spark Structured Streaming
⭐
66
Spark structured streaming with Kafka data source and writing to Cassandra
Coast
⭐
59
Experiments in Streaming
Kafka Streaming Click Analysis
⭐
56
Use Kafka and Apache Spark streaming to perform click stream analytics
Conduktor Platform
⭐
55
Streamline Apache Kafka with Conduktor Platform. 🚀
Data Stream Development With Apache Spark Kafka And Spring Boot
⭐
54
Data Stream Development with Apache Spark, Kafka and Spring Boot by Packt Publishing
Awesome Pulsar
⭐
53
A curated list of Pulsar tools, integrations and resources.
Kafka Learning
⭐
52
Go from Zero to Hero in Kafka
Spark Cep
⭐
51
Spark CEP is an extension of Spark Streaming to support SQL-based query processing
Realtime Dashboard
⭐
49
Real-time report dashboard with Apache Kafka, Apache Spark Streaming and Node.js
Sparkonkudu
⭐
48
Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.
Dayinthelife Streaming
⭐
48
Day in the Streaming Life (Event-Driven) Workshop
Twitterstream
⭐
45
Twitter Streaming API Example with Kafka Streams in Scala
Awesome Recommendation Engine
⭐
43
The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.
Simple Stream Kafka
⭐
42
This is a simple streaming application that utilises Kafka and Python
Hyperdrive
⭐
41
Extensible streaming ingestion pipeline on top of Apache Spark
Noah
⭐
39
Kafka Streams in Clojure
Realtime Data Analytics Using Spark
⭐
39
Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc
Tweetmap
⭐
39
A real time Tweet Trend Map and Sentiment Analysis web application with kafka, Angular, Spring Boot, Flink, Elasticsearch, Kibana, Docker and Kubernetes deployed on the cloud
Bigdata Getting Started
⭐
37
大数据相关框架实战项目(Hadoop, Spark, Storm, Flink)
Real Time Stream Processing Engine
⭐
37
This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.
Spark Kafka 0 8 Sql
⭐
36
Spark Structured Streaming Kafka 0.8 Source Implementation
Arroyo
⭐
35
A library to build streaming applications that consume from and produce to Kafka.
Sparkngin
⭐
35
Pluggable server to Stream messages / events to queues like Kafka and other systems
Styx
⭐
34
Streaming Analytics platform, built with Apache Flink and Kafka
Twitter Network Analysis
⭐
34
Analyzing a network of tweets and retweets using graph algorithms
Kafka_stock
⭐
34
A financial data processing and visualization platform using Apache Kafka, Apache Cassandra, and Bokeh.
Spark Twitter Sentiment Analysis
⭐
33
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
Pafka
⭐
33
Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for streaming/messaging system.
Kanadi
⭐
32
Kanadi is a Nakadi client for Scala
Structuredstreaminginsql
⭐
31
sql实现Structured Streaming
Kafka Sse Example
⭐
31
Expose Kafka messages via HTTP streaming API
Hdinsight Kafka Java Get Started
⭐
30
Basic example of using Java to create a producer and consumer that work with Kafka on HDInsight. Also a demonstration of the streaming api.
Samza Sql
⭐
30
SamzaSQL: Streaming SQL implementation on top of Apache Samza and Apache Kafka
Spark Streaming Direct Kafka
⭐
30
High Performance Spark Streaming with Direct Kafka in Java
Df_data_service
⭐
29
DataFibers Data Service
Spark Secure Kafka App
⭐
29
Sample Spark Streaming application for secure consumption from Kafka
Building Data Streaming Applications With Apache Kafka
⭐
27
Building Data Streaming Applications with Apache Kafka, published by Packt
Iot_demo
⭐
26
Demo showcasing Spark Streaming, Kafka, Kudu - all in Python
Wasp
⭐
25
WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.
Related Searches
Java Kafka (3,237)
Javascript Streaming (2,085)
Stream Streaming (1,696)
Python Streaming (1,407)
Kafka Zookeeper (1,229)
Docker Kafka (1,191)
Python Kafka (1,133)
Java Streaming (1,103)
Spark Kafka (979)
Scala Kafka (969)
1-100 of 255 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.