Awesome Open Source
Awesome Open Source
Combined Topics
apache-kafka
x
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
The Top 270 Apache Kafka Open Source Projects on Github
Categories
>
Control Flow
>
Apache Kafka
Librdkafka
⭐
5,405
The Apache Kafka C/C++ library
Debezium
⭐
5,375
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Oryx
⭐
1,759
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Kowl
⭐
1,614
Apache Kafka Web UI for exploring messages, consumers, configurations and more with a focus on a good UI & UX.
Karafka
⭐
1,277
Framework for Apache Kafka based Ruby and Rails applications development.
Pykafka
⭐
1,071
Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
Kt
⭐
780
Kafka command line tool that likes JSON
Kafka Ui
⭐
733
Open-Source Web GUI for Apache Kafka Management
Kafka Storm Starter
⭐
725
Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Cp Helm Charts
⭐
585
The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.
Kq
⭐
531
Kafka-based Job Queue for Python
Cppkafka
⭐
439
Modern C++ Apache Kafka client library (wrapper for librdkafka)
Awesome Kafka
⭐
436
A list about Apache Kafka
Kafka Connect Hdfs
⭐
421
Kafka Connect HDFS connector
Agile_data_code_2
⭐
418
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Kafka Sprout
⭐
401
🚀 Web GUI for Kafka Cluster Management
Cp All In One
⭐
338
docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud
Wirbelsturm
⭐
331
Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.
Incubator Rocketmq
⭐
319
带中文代码注释 Mirror of Apache RocketMQ 源码解析：http://www.iocoder.cn/categories/RocketMQ/?github
Kafkactl
⭐
252
Command Line Tool for managing Apache Kafka
Kop
⭐
245
Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
Kafka Tutorials
⭐
185
Kafka Tutorials microsite
Slimmessagebus
⭐
175
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Azkarra Streams
⭐
156
🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.
Waterdrop
⭐
146
WaterDrop is a standalone Karafka component library for generating Kafka messages
Docker Kafka
⭐
143
Apache Kafka on Docker
Azure Event Hubs For Kafka
⭐
136
Azure Event Hubs for Apache Kafka Ecosystems
Dagger
⭐
128
Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.
Apachekafkatutorials
⭐
127
Example Code for Kafka Tutorials @ Learning Journal
Meetup
⭐
113
Kafka 한국 사용자 모임에서 운영하는 meetup repository
Kafka Serialization
⭐
109
Lego bricks to build Apache Kafka serializers and deserializers
Atomickafka
⭐
106
Akka Stream Eventsourcing
⭐
105
Event sourcing for Akka Streams
Kafka Notebook
⭐
103
The Internals of Apache Kafka
Kukulcan
⭐
91
A REPL for Apache Kafka
Kafka Connect Fs
⭐
86
Kafka Connect FileSystem Connector
Tensorflow Serving Java Grpc Kafka Streams
⭐
85
Kafka Streams + Java + gRPC + TensorFlow Serving => Stream Processing combined with RPC / Request-Response
Kafka Streams Real Time Stream Processing
⭐
76
This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.
Kafkaesk
⭐
73
An event-driven monitoring tool that can consume messages from Apache Kafka clusters and display the aggregated data on a dashboard for analysis and maintenance.
Kcctl
⭐
72
A command line client for Kafka Connect
Kafka Streams Workshop
⭐
71
Kattlo Cli
⭐
63
Kattlo CLI Project
Ksql Jdbc Driver
⭐
59
JDBC driver for Apache Kafka
Formula1 Telemetry Kafka
⭐
54
Awesome Pulsar
⭐
53
A curated list of Pulsar tools, integrations and resources.
Pico
⭐
51
Object Detection and Analysis Made easy using Raspberry Pi, Apache Kafka, AWS Rekognition & Docker
Awesome Opensource Contribs Kafka
⭐
48
A list of all awesome open-source contributions for the Apache Kafka project
Southpaw
⭐
46
⚾️ Streaming left joins in Kafka for change data capture
Insulator
⭐
45
A client UI to inspect Kafka topics, consume, produce and much more
Kafka Workshop
⭐
44
Materials (slides and code) for Kafka and Kafka Streams Workshop
Docker Kafka Alpine
⭐
43
Alpine Linux based Kafka Docker Image
Goneli
⭐
41
Implementation of the NELI leader election protocol for Go and Kafka
Insulator
⭐
41
A client UI to inspect Kafka topics, consume, produce and much more
Go Notify
⭐
39
An email automation solution, written in Golang.
Storm Dynamic Spout
⭐
37
A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.
Spark Twitter Sentiment Analysis
⭐
33
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
Opensourcecomputervision
⭐
30
Open Source Computer Vision with TensorFlow, MiniFi, Apache NiFi, OpenCV, Apache Tika and Python For processing images from IoT devices like Raspberry Pis, NVidia Jetson TX1, NanoPi Duos and more which are equipped with attached cameras or external USB webcams, we use Python to interface via OpenCV and PiCamera. From there we run image processing at the edge on these IoT device using OpenCV and TensorFlow to determine attributes and image analytics. A pache MiniFi coordinates running these Python scripts and decides when and what to send from that analysis and the image to a remote Apache NiFi server for additional processing. At the Apache NiFi cluster in the cluster it routes the images to one processing path and the JSON encoded metadata to another flow. The JSON data (with it's schema referenced from a central Schema Registry) is routed and routed using Record Processing and SQL, this data in enriched and augment before conversion to AVRO to be send via Apache Kafka to SAM. Streaming Analytics Manager then does deeper processing on this stream and others including weather and twitter to determine what should be done on this data. References https://community.hortonworks.com/articles/103863/using-an-asus-tinkerboard-with-tensorflow-and-pyth.html https://community.hortonworks.com/articles/118132/minifi-capturing-converting-tensorflow-inception-t.html https://github.com/tspannhw/rpi-noir-screen https://community.hortonworks.com/articles/77988/ingest-remote-camera-images-from-raspberry-pi-via.html https://community.hortonworks.com/articles/107379/minifi-for-image-capture-and-ingestion-from-raspbe.html https://community.hortonworks.com/articles/58265/analyzing-images-in-hdf-20-using-tensorflow.html
Docker Kafka Zookeeper
⭐
29
Docker image for Kafka (0.10.x - 0.11.x - 1.x, 2.x) message broker including Zookeeper
Strimzi Kafka Cli
⭐
28
Command Line Interface for Strimzi Kafka Operator
Kafkaer
⭐
27
Template based Kafka topic/cluster/ACL management
Wafka
⭐
26
Apache Kafka API exposed through WebSocket and REST protocols
Brave Kafka Interceptor
⭐
25
Kafka Interceptor for Zipkin
F1 Demo
⭐
25
Real-time vehicle telematics analytics demo using OmniSci
Xk6 Kafka
⭐
23
k6 extension to load test Apache Kafka with support for Avro messages and SASL Authentication
Learn Hadoop And Spark
⭐
22
This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.
Kafka Connect Transform Kryptonite
⭐
21
Kryptonite is a turn-key ready transformation (SMT) for Apache Kafka® Connect to do field-level 🔒 encryption/decryption 🔓 of records. It's an UNOFFICIAL community project.
Franzy
⭐
21
A set of Clojure libraries to work with Apache Kafka (producer, consumer, rebalancing, administration, and validation).
Kafka Python Camera Stream
⭐
20
Distributed Streaming with Apache Kafka and Python OpenCV
Esque
⭐
20
esque - an operational kafka tool.
Pulsar Io Kafka
⭐
20
Pulsar IO Kafka Connector
Kafka Cluster Ansible
⭐
19
Fully Managed Apache Kafka Cluster with Ansible & Terraform.
Ravine
⭐
18
A bridge between synchronous HTTP workload and event-driven landscapes powered by Apache Kafka.
Confluent Avro Py
⭐
18
An Avro SerDe implementation that integrates with the confluent schema registry and serializes and deserializes data according to the defined confluent wire format
Kafka Net Core
⭐
18
kafka .net core library
Kafka Streams
⭐
17
Oh you know, just a coupla, two, tree Kafka Streams in Scala
Amq Examples
⭐
17
This repository contains a set of examples to be used with Red Hat AMQ messaging suite components.
Post Kafka Opentracing
⭐
16
Post: Tracing Kafka Applications
Kafka Twitter Spark Streaming
⭐
16
Counting Tweets Per User in Real-Time
Kafka Streams Scala Examples
⭐
14
Vkitm
⭐
14
A native Kafka protocol proxy for Apache Kafka
Vault Plugin Secrets Kafka
⭐
14
A vault plugin for generating ACLs for dynamic users
Kafka_role
⭐
14
Ansible role to install Apache Kafka
Baskerville
⭐
14
Security Analytics Engine - Anomaly Detection in Web Traffic
Kafka Connect Arangodb
⭐
13
🥑 Kafka Connect Sink Connector for ArangoDB
Fink Broker
⭐
13
Astronomy Broker based on Apache Spark
Infoq Kafka Ksql
⭐
12
Code samples to go with InfoQ article
Msggw
⭐
11
Apache Kafka compatible message gateway for Apache Pulsar
Stocks Nifi Kafka
⭐
11
Stocks -> NiFi -> Kafka -> Profit
Kafka Connect Jdbc Exasol
⭐
10
Exasol dialect for the Kafka Connect JDBC Connector
Scylla Cdc Source Connector
⭐
10
A Kafka source connector capturing Scylla CDC changes
Pulsar Adapters
⭐
10
Apache Pulsar Adapters
Spark Kafka Sink
⭐
9
A Kafka metric sink for Apache Spark
Sn Platform
⭐
9
StreamNative Platform Downloads
Kafka_producer_consumer_tutorial
⭐
9
A tutorial on building a real-time data streaming application pipeline with Apache Kafka🔥🔥🔥
Zeelos
⭐
9
A prototype of utilizing Apache Kafka and Lightweight M2M protocol as the backbone for cloud/edge IoT integration.
Perl Net Kafka
⭐
9
Net::Kafka - High-performant Perl client for Apache Kafka
Kafka Clients Kotlin
⭐
9
This projects gives Kotlin bindings and several extensions for Apache Kafka Clients.
Marsrover
⭐
9
A mars rover simulation project that will serve as a test bed for machine learning algorithms.
Telemetry Staging Ansible
⭐
8
All in one orchestrated ecosystem to experiment with Cisco XR Model Driven Telemetry
Replicamap
⭐
8
Key-value Kafka Database
1-100 of 270 projects
Next >
Related Projects
Java Apache Kafka Projects (93)
Advertising
📦 9
All Projects
Application Programming Interfaces
📦 120
Applications
📦 181
Artificial Intelligence
📦 72
Blockchain
📦 70
Build Tools
📦 111
Cloud Computing
📦 79
Code Quality
📦 28
Collaboration
📦 30
Command Line Interface
📦 48
Community
📦 81
Companies
📦 60
Compilers
📦 60
Computer Science
📦 74
Configuration Management
📦 39
Content Management
📦 167
Control Flow
📦 197
Data Formats
📦 77
Data Processing
📦 266
Data Storage
📦 132
Economics
📦 60
Frameworks
📦 198
Games
📦 122
Graphics
📦 103
Hardware
📦 148
Integrated Development Environments
📦 47
Learning Resources
📦 147
Legal
📦 28
Libraries
📦 119
Lists Of Projects
📦 21
Machine Learning
📦 336
Mapping
📦 61
Marketing
📦 15
Mathematics
📦 55
Media
📦 228
Messaging
📦 97
Networking
📦 304
Operating Systems
📦 84
Operations
📦 120
Package Managers
📦 52
Programming Languages
📦 229
Runtime Environments
📦 96
Science
📦 42
Security
📦 375
Social Media
📦 26
Software Architecture
📦 70
Software Development
📦 68
Software Performance
📦 57
Software Quality
📦 127
Text Editors
📦 45
Text Processing
📦 131
User Interface
📦 310
User Interface Components
📦 465
Version Control
📦 29
Virtualization
📦 68
Web Browsers
📦 38
Web Servers
📦 25
Web User Interface
📦 194
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.
