The Top 703 Apache Kafka Open Source Projects

Awesome Open Source

Share On Twitter

Combined Topics

apache-kafka x

The Top 703 Apache Kafka Open Source Projects

Categories > Control Flow > Apache Kafka

Kafka ⭐ 23,655

Mirror of Apache Kafka

most recent commit 8 hours ago

Sarama ⭐ 9,413

Sarama is a Go library for Apache Kafka.

dependent packages 1,759total releases 152most recent commit a day ago

Debezium ⭐ 7,833

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

dependent packages 32total releases 137most recent commit 15 hours ago

Librdkafka ⭐ 6,346

The Apache Kafka C/C++ library

dependent packages 25total releases 144most recent commit 9 hours ago

Kafka Python ⭐ 5,001

Python client for Apache Kafka

dependent packages 321total releases 36most recent commit a month ago

Kafka Ui ⭐ 4,066

Open-Source Web UI for Apache Kafka Management

most recent commit 10 hours ago

Strimzi Kafka Operator ⭐ 3,573

Apache Kafka® running on Kubernetes

dependent packages 2total releases 34most recent commit 14 hours ago

Console ⭐ 2,857

Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.

total releases 112most recent commit 15 hours ago

Goka ⭐ 2,055

Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.

dependent packages 17total releases 62most recent commit 14 hours ago

Spring Kafka ⭐ 1,801

Provides Familiar Spring Abstractions for Apache Kafka

dependent packages 225total releases 160most recent commit a day ago

Oryx ⭐ 1,759

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

dependent packages 2total releases 14most recent commit a year ago

Kaf ⭐ 1,753

Modern CLI for Apache Kafka, written in Go.

dependent packages 2total releases 71most recent commit 18 days ago

Karafka ⭐ 1,538

Ruby and Rails efficient Kafka processing framework

dependent packages 5total releases 70most recent commit 10 hours ago

Pykafka ⭐ 1,071

Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

dependent packages 20total releases 38most recent commit 2 years ago

Sarama Cluster ⭐ 921

Cluster extensions for Sarama, the Go client library for Apache Kafka 0.9 [DEPRECATED]

dependent packages 202total releases 25most recent commit 3 years ago

Kt ⭐ 893

Kafka command line tool that likes JSON

total releases 24most recent commit 15 days ago

Kafka Web Console ⭐ 763

A web console for Apache Kafka (retired)

most recent commit 7 years ago

Kafka Storm Starter ⭐ 729

[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

most recent commit 8 months ago

Cp Helm Charts ⭐ 725

The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.

most recent commit a month ago

Kafka Streams Machine Learning Examples ⭐ 632

This project contains examples which demonstrate how to deploy analytic models to mission-critical, scalable production environments leveraging Apache Kafka and its Streams API. Models are built with Python, H2O, TensorFlow, Keras, DeepLearning4 and other technologies.

most recent commit 2 years ago

Cp All In One ⭐ 585

docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

most recent commit 16 days ago

Kq ⭐ 539

Kafka-based Job Queue for Python

total releases 13most recent commit 10 months ago

Awesome Kafka ⭐ 514

A list about Apache Kafka

most recent commit a day ago

Kafkactl ⭐ 489

Command Line Tool for managing Apache Kafka

total releases 30most recent commit 24 days ago

Cppkafka ⭐ 481

Modern C++ Apache Kafka client library (wrapper for librdkafka)

most recent commit 8 months ago

Trading ⭐ 473

💱 Trading application written in Scala 3 that showcases an Event-Driven Architecture (EDA) and Functional Programming (FP)

most recent commit 2 days ago

Kafka Connect Hdfs ⭐ 450

Kafka Connect HDFS connector

most recent commit a month ago

Agile_data_code_2 ⭐ 423

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

most recent commit a year ago

Kafka Sprout ⭐ 401

🚀 Web GUI for Kafka Cluster Management

most recent commit 2 years ago

Kareldb ⭐ 382

A Relational Database Backed by Apache Kafka

dependent packages 1total releases 15most recent commit 5 days ago

Kop ⭐ 375

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

most recent commit 2 days ago

Jackdaw ⭐ 337

A Clojure library for the Apache Kafka distributed streaming platform.

total releases 98most recent commit a month ago

Wirbelsturm ⭐ 333

[PROJECT IS NO LONGER MAINTAINED] Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

most recent commit 9 months ago

Kafka Streams Dotnet ⭐ 330

.NET Stream Processing Library for Apache Kafka 🚀

dependent packages 9total releases 23most recent commit 4 days ago

Incubator Rocketmq ⭐ 319

带中文代码注释 Mirror of Apache RocketMQ 源码解析：http://www.iocoder.cn/categories/RocketMQ/?gi

most recent commit 4 years ago

Spring Integration Kafka ⭐ 316

most recent commit a year ago

Slimmessagebus ⭐ 308

Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.

dependent packages 16total releases 35most recent commit 8 days ago

Firehose ⭐ 277

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

most recent commit 3 days ago

Decaton ⭐ 266

High throughput asynchronous task processing on Apache Kafka

dependent packages 3total releases 25most recent commit 4 days ago

Kcctl ⭐ 259

A modern and intuitive command line client for Kafka Connect

most recent commit 3 days ago

Kafka Tutorials ⭐ 248

Tutorials and Recipes for Apache Kafka

most recent commit 9 hours ago

Dagger ⭐ 235

Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

most recent commit 7 days ago

Kafka Connect File Pulse ⭐ 226

🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka

dependent packages 3total releases 5most recent commit 8 days ago

Pubsub ⭐ 224

This repository contains open-source projects managed by the owners of Google Cloud Pub/Sub.

most recent commit a month ago

Kcache ⭐ 202

An In-Memory Cache Backed by Apache Kafka

dependent packages 3total releases 40most recent commit 6 days ago

Kafka Php ⭐ 198

PHP client library for Apache Kafka

total releases 2most recent commit 3 years ago

Mirus ⭐ 192

Mirus is a cross data-center data replication tool for Apache Kafka

total releases 22most recent commit 24 days ago

Kafka Client ⭐ 188

Go client library for Apache Kafka

dependent packages 11total releases 12most recent commit 3 years ago

Waterdrop ⭐ 187

Standalone Karafka library for producing Kafka messages

dependent packages 6total releases 59most recent commit 12 days ago

Azure Event Hubs For Kafka ⭐ 183

Azure Event Hubs for Apache Kafka Ecosystems

most recent commit 3 days ago

Azkarra Streams ⭐ 168

🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.

dependent packages 5total releases 14most recent commit a year ago

Go Notify ⭐ 165

An email automation solution, written in Golang.

most recent commit 5 months ago

Meetup ⭐ 160

Kafka 한국 사용자 모임에서 운영하는 meetup repository

most recent commit 3 months ago

Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference ⭐ 159

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

most recent commit 2 years ago

Awesome Kafka ⭐ 148

most recent commit 17 hours ago

Docker Kafka ⭐ 143

Apache Kafka on Docker

most recent commit 5 years ago

Webtcp ⭐ 140

SockJS/TCP bridge that allows browsers to interact with TCP servers

most recent commit 9 years ago

Kafka Serialization ⭐ 116

Lego bricks to build Apache Kafka serializers and deserializers

most recent commit a year ago

Kafka Prometheus Monitoring ⭐ 110

Dockerised example of monitoring Apache Kafka with Prometheus and Grafana

most recent commit 4 years ago

Kafka Connect Fs ⭐ 106

Kafka Connect FileSystem Connector

most recent commit 25 days ago

Atomickafka ⭐ 106

total releases 15most recent commit a year ago

Formula1 Telemetry Kafka ⭐ 105

most recent commit 2 months ago

Akka Stream Eventsourcing ⭐ 105

Event sourcing for Akka Streams

most recent commit 5 years ago

Bifrost ⭐ 98

Safely archive data from Apache Kafka to S3 with no Hadoop dependencies :)

most recent commit 3 years ago

Kafka Graphs ⭐ 94

Graph Analytics with Apache Kafka

dependent packages 1total releases 13most recent commit 7 days ago

Kafka Backup ⭐ 93

Backup and Restore for Apache Kafka

most recent commit 2 years ago

Kukulcan ⭐ 91

A REPL for Apache Kafka

most recent commit 2 years ago

Tensorflow Serving Java Grpc Kafka Streams ⭐ 85

Kafka Streams + Java + gRPC + TensorFlow Serving => Stream Processing combined with RPC / Request-Response

most recent commit 3 years ago

Pankh ⭐ 84

most recent commit 8 years ago

Kafta ⭐ 79

Kafta is a command line for managing Kafka clusters

most recent commit 22 days ago

Ansible Kafka ⭐ 77

Ansible role for installing and configuring Apache Kafka on RedHat and Debian platforms.

most recent commit a month ago

Kafka Streams Real Time Stream Processing ⭐ 76

This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.

most recent commit 2 years ago

Eventing Kafka Broker ⭐ 74

Alternate Kafka Broker implementation.

total releases 126most recent commit 15 hours ago

Micronaut Kafka ⭐ 73

Integration between Micronaut and Apache Kafka

dependent packages 2total releases 20most recent commit 3 days ago

Kafkaesk ⭐ 73

An event-driven monitoring tool that can consume messages from Apache Kafka clusters and display the aggregated data on a dashboard for analysis and maintenance.

most recent commit 2 years ago

Kafka Streams Workshop ⭐ 71

most recent commit 4 years ago

Spring And Kafka ⭐ 68

Example code for my blog introducing Spring and Apache Kafka

most recent commit 6 years ago

Xk6 Kafka ⭐ 65

k6 extension to load test Apache Kafka with support for various serialization formats, SASL, TLS, compression, Schema Registry client and beyond

total releases 29most recent commit 16 hours ago

Kattlo Cli ⭐ 63

Kattlo CLI Project

most recent commit 2 years ago

Kafka Kubernetes ⭐ 60

Apache Kafka on Kubernetes

most recent commit 6 years ago

Ksql Jdbc Driver ⭐ 59

JDBC driver for Apache Kafka

most recent commit 3 years ago

Hiveka ⭐ 59

Kafka as Hive Storage

most recent commit 8 years ago

Awesome Opensource Contribs Kafka ⭐ 59

A list of all awesome open-source contributions for the Apache Kafka project

most recent commit a year ago

Docker Kafka Alpine ⭐ 59

Alpine Linux based Kafka Docker Image

most recent commit 16 days ago

Kafka Workshop ⭐ 56

Materials (slides and code) for Kafka and Kafka Streams Workshops

most recent commit 4 days ago

Insulator ⭐ 55

A client UI to inspect Kafka topics, consume, produce and much more

most recent commit 3 days ago

Awesome Pulsar ⭐ 53

A curated list of Pulsar tools, integrations and resources.

most recent commit 2 years ago

Galapagos ⭐ 53

DevOps Self-Service Software for Apache Kafka, including an opinionated approach on how to use Kafka for event-driven enterprise architecture.

most recent commit 14 days ago

Kafka Learning ⭐ 52

Go from Zero to Hero in Kafka

most recent commit 2 years ago

Siesta ⭐ 52

Making support for Apache Kafka in Go better

most recent commit 4 years ago

Pico ⭐ 51

Object Detection and Analysis Made easy using Raspberry Pi, Apache Kafka, AWS Rekognition & Docker

most recent commit 3 years ago

Kafka El7 Rpm ⭐ 50

A set of scripts to package Apache Kafka into an rpm (CentOS/RedHat 7)

most recent commit 3 years ago

Southpaw ⭐ 48

⚾️ Streaming left joins in Kafka for change data capture

most recent commit a month ago

Kafka Fraud Detector ⭐ 47

🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python

most recent commit 4 years ago

Ari Proxy ⭐ 45

Ari-proxy connects Asterisk, an open source communication server, to the Apache Kafka distributed streaming platform.

most recent commit 10 days ago

Strimzi Kafka Cli ⭐ 45

Command Line Interface for the Strimzi Kafka Operator

total releases 67most recent commit 2 months ago

Article Tcc ⭐ 44

TCC(Try-Confirm/Cancel) 구현 샘플

most recent commit 4 years ago

Python Fake Data Producer For Apache Kafka ⭐ 44

The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and push it to an Apache Kafka topic.

most recent commit 2 months ago

Goneli ⭐ 41

Implementation of the NELI leader election protocol for Go and Kafka

most recent commit 2 years ago

Insulator ⭐ 41

A client UI to inspect Kafka topics, consume, produce and much more

most recent commit 2 years ago

1-100 of 703 projects

Next >