Awesome Open Source
Awesome Open Source
Combined Topics
apache-kafka
x
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
The Top 274 Apache Kafka Open Source Projects on Github
Categories
>
Control Flow
>
Apache Kafka
Debezium
⭐
6,129
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Librdkafka
⭐
5,688
The Apache Kafka C/C++ library
Kafka Ui
⭐
2,078
Open-Source Web GUI for Apache Kafka Management
Kowl
⭐
1,919
Kowl is a Web UI for Apache Kafka that allows exploring messages, consumers, configurations and more with a focus on a good UI & UX.
Oryx
⭐
1,759
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Karafka
⭐
1,314
Framework for Apache Kafka based Ruby and Rails applications development.
Pykafka
⭐
1,071
Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
Kt
⭐
833
Kafka command line tool that likes JSON
Kafka Storm Starter
⭐
725
Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Cp Helm Charts
⭐
639
The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.
Kq
⭐
531
Kafka-based Job Queue for Python
Awesome Kafka
⭐
462
A list about Apache Kafka
Cppkafka
⭐
439
Modern C++ Apache Kafka client library (wrapper for librdkafka)
Agile_data_code_2
⭐
423
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Kafka Connect Hdfs
⭐
423
Kafka Connect HDFS connector
Cp All In One
⭐
419
docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud
Kafka Sprout
⭐
401
🚀 Web GUI for Kafka Cluster Management
Trading
⭐
353
💱 Trading application written in Scala 3 that showcases an Event-Driven Architecture (EDA) and Functional Programming (FP)
Wirbelsturm
⭐
331
Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.
Kafkactl
⭐
330
Command Line Tool for managing Apache Kafka
Incubator Rocketmq
⭐
319
带中文代码注释 Mirror of Apache RocketMQ 源码解析：http://www.iocoder.cn/categories/RocketMQ/?github
Kop
⭐
283
Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
Slimmessagebus
⭐
206
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Kafka Tutorials
⭐
201
Kafka Tutorials microsite
Azkarra Streams
⭐
168
🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.
Waterdrop
⭐
161
WaterDrop is a standalone Karafka component library for generating Kafka messages
Dagger
⭐
159
Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.
Azure Event Hubs For Kafka
⭐
149
Azure Event Hubs for Apache Kafka Ecosystems
Kcctl
⭐
143
A modern and intuitive command line client for Kafka Connect
Docker Kafka
⭐
143
Apache Kafka on Docker
Apachekafkatutorials
⭐
127
Example Code for Kafka Tutorials @ Learning Journal
Meetup
⭐
123
Kafka 한국 사용자 모임에서 운영하는 meetup repository
Kafka Serialization
⭐
116
Lego bricks to build Apache Kafka serializers and deserializers
Atomickafka
⭐
106
Akka Stream Eventsourcing
⭐
105
Event sourcing for Akka Streams
Kafka Notebook
⭐
103
The Internals of Apache Kafka
Kafka Connect Fs
⭐
98
Kafka Connect FileSystem Connector
Kukulcan
⭐
91
A REPL for Apache Kafka
Tensorflow Serving Java Grpc Kafka Streams
⭐
85
Kafka Streams + Java + gRPC + TensorFlow Serving => Stream Processing combined with RPC / Request-Response
Kafka Streams Real Time Stream Processing
⭐
76
This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.
Kafkaesk
⭐
73
An event-driven monitoring tool that can consume messages from Apache Kafka clusters and display the aggregated data on a dashboard for analysis and maintenance.
Kafka Streams Workshop
⭐
71
Kattlo Cli
⭐
63
Kattlo CLI Project
Formula1 Telemetry Kafka
⭐
63
Awesome Opensource Contribs Kafka
⭐
59
A list of all awesome open-source contributions for the Apache Kafka project
Ksql Jdbc Driver
⭐
59
JDBC driver for Apache Kafka
Awesome Pulsar
⭐
53
A curated list of Pulsar tools, integrations and resources.
Pico
⭐
51
Object Detection and Analysis Made easy using Raspberry Pi, Apache Kafka, AWS Rekognition & Docker
Docker Kafka Alpine
⭐
50
Alpine Linux based Kafka Docker Image
Insulator
⭐
50
A client UI to inspect Kafka topics, consume, produce and much more
Kafka Workshop
⭐
48
Materials (slides and code) for Kafka and Kafka Streams Workshop
Southpaw
⭐
46
⚾️ Streaming left joins in Kafka for change data capture
Goneli
⭐
41
Implementation of the NELI leader election protocol for Go and Kafka
Storm Dynamic Spout
⭐
41
A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.
Insulator
⭐
41
A client UI to inspect Kafka topics, consume, produce and much more
Go Notify
⭐
39
An email automation solution, written in Golang.
Spark Twitter Sentiment Analysis
⭐
33
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
Strimzi Kafka Cli
⭐
33
Command Line Interface for Strimzi Kafka Operator
Opensourcecomputervision
⭐
30
Open Source Computer Vision with TensorFlow, MiniFi, Apache NiFi, OpenCV, Apache Tika and Python For processing images from IoT devices like Raspberry Pis, NVidia Jetson TX1, NanoPi Duos and more which are equipped with attached cameras or external USB webcams, we use Python to interface via OpenCV and PiCamera. From there we run image processing at the edge on these IoT device using OpenCV and TensorFlow to determine attributes and image analytics. A pache MiniFi coordinates running these Python scripts and decides when and what to send from that analysis and the image to a remote Apache NiFi server for additional processing. At the Apache NiFi cluster in the cluster it routes the images to one processing path and the JSON encoded metadata to another flow. The JSON data (with it's schema referenced from a central Schema Registry) is routed and routed using Record Processing and SQL, this data in enriched and augment before conversion to AVRO to be send via Apache Kafka to SAM. Streaming Analytics Manager then does deeper processing on this stream and others including weather and twitter to determine what should be done on this data. References https://community.hortonworks.com/articles/103863/using-an-asus-tinkerboard-with-tensorflow-and-pyth.html https://community.hortonworks.com/articles/118132/minifi-capturing-converting-tensorflow-inception-t.html https://github.com/tspannhw/rpi-noir-screen https://community.hortonworks.com/articles/77988/ingest-remote-camera-images-from-raspberry-pi-via.html https://community.hortonworks.com/articles/107379/minifi-for-image-capture-and-ingestion-from-raspbe.html https://community.hortonworks.com/articles/58265/analyzing-images-in-hdf-20-using-tensorflow.html
Docker Kafka Zookeeper
⭐
29
Docker image for Kafka (0.10.x - 0.11.x - 1.x, 2.x) message broker including Zookeeper
Kafkasaur
⭐
29
Apache Kafka client for Deno
Python Fake Data Producer For Apache Kafka
⭐
28
Kafka Python Fake Data Producer is a complete demo app allowing you to quickly produce a Python fake Pizza-based streaming dataset and push it to an Apache Kafka topic. It gives an example on how easy is to create great fake streaming data to feed Apache Kafka.
Kafka Connect Transform Kryptonite
⭐
28
Kryptonite is a turn-key ready transformation (SMT) for Apache Kafka® Connect to do field-level 🔒 encryption/decryption 🔓 of records. It's an UNOFFICIAL community project.
Xk6 Kafka
⭐
27
k6 extension to load test Apache Kafka with support for Avro messages and SASL Authentication
Kafkaer
⭐
27
Template based Kafka topic/cluster/ACL management
Baskerville
⭐
27
Security Analytics Engine - Anomaly Detection in Web Traffic
Brave Kafka Interceptor
⭐
25
Kafka Interceptor for Zipkin
F1 Demo
⭐
25
Real-time vehicle telematics analytics demo using OmniSci
Learn Hadoop And Spark
⭐
22
This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.
Esque
⭐
21
esque - an operational kafka tool.
Franzy
⭐
21
A set of Clojure libraries to work with Apache Kafka (producer, consumer, rebalancing, administration, and validation).
Amq Examples
⭐
20
This repository contains a set of examples to be used with Red Hat AMQ messaging suite components.
Kafka Cluster Ansible
⭐
20
Fully Managed Apache Kafka Cluster with Ansible & Terraform.
Kafka Python Camera Stream
⭐
20
Distributed Streaming with Apache Kafka and Python OpenCV
Pulsar Io Kafka
⭐
20
Pulsar IO Kafka Connector
Confluent Avro Py
⭐
18
An Avro SerDe implementation that integrates with the confluent schema registry and serializes and deserializes data according to the defined confluent wire format
Kafka Net Core
⭐
18
kafka .net core library
Ravine
⭐
18
A bridge between synchronous HTTP workload and event-driven landscapes powered by Apache Kafka.
Kafka Streams
⭐
17
Oh you know, just a coupla, two, tree Kafka Streams in Scala
Kafka_role
⭐
17
Ansible role to install Apache Kafka
Kafka Twitter Spark Streaming
⭐
16
Counting Tweets Per User in Real-Time
Post Kafka Opentracing
⭐
16
Post: Tracing Kafka Applications
Vault Plugin Secrets Kafka
⭐
15
A vault plugin for generating ACLs for dynamic users
Vkitm
⭐
14
A native Kafka protocol proxy for Apache Kafka
Kafka Streams Scala Examples
⭐
14
Kafka Connect Arangodb
⭐
13
🥑 Kafka Connect Sink Connector for ArangoDB
Scylla Cdc Source Connector
⭐
13
A Kafka source connector capturing Scylla CDC changes
Fink Broker
⭐
13
Astronomy Broker based on Apache Spark
Pulsar Adapters
⭐
12
Apache Pulsar Adapters
Plumber
⭐
12
Simple desktop application for Apache Kafka
Kafka Topic View
⭐
12
A simple UI for monitoring Apache Kafka topics and their state.
Infoq Kafka Ksql
⭐
12
Code samples to go with InfoQ article
Stocks Nifi Kafka
⭐
11
Stocks -> NiFi -> Kafka -> Profit
Kafka Connect Jdbc Exasol
⭐
10
Exasol dialect for the Kafka Connect JDBC Connector
Kafka_producer_consumer_tutorial
⭐
9
A tutorial on building a real-time data streaming application pipeline with Apache Kafka🔥🔥🔥
Sn Platform
⭐
9
StreamNative Platform Downloads
Zeelos
⭐
9
A prototype of utilizing Apache Kafka and Lightweight M2M protocol as the backbone for cloud/edge IoT integration.
Marsrover
⭐
9
A mars rover simulation project that will serve as a test bed for machine learning algorithms.
Kafka Clients Kotlin
⭐
9
This projects gives Kotlin bindings and several extensions for Apache Kafka Clients.
Perl Net Kafka
⭐
9
Net::Kafka - High-performant Perl client for Apache Kafka
1-100 of 274 projects
Next >
Related Projects
Java Apache Kafka Projects (98)
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
Privacy policy
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.
