Awesome Open Source
Awesome Open Source
Combined Topics
kafka x
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194

The Top 3,413 Kafka Open Source Projects on Github

Kafka ⭐ 21,011
Mirror of Apache Kafka
Springboot Labs ⭐ 12,788
一个涵盖六个专栏：Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖，右上角来个 Star，感恩 1024
Technology Talk ⭐ 12,011
汇总java生态圈常用技术框架、开源中间件，系统架构、数据库、大公司架构案例、常用三方类库、项目管理、线上问题排查、个人成长、思考等知识
Flink Learning ⭐ 11,591
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
Thingsboard ⭐ 10,707
Open-source IoT Platform - Device management, data collection, processing and visualization.
Cmak ⭐ 10,532
CMAK is a tool for managing Apache Kafka clusters
Bigdata Notes ⭐ 9,567
大数据入门指南 ⭐️
Sarama ⭐ 8,096
Sarama is a Go library for Apache Kafka.
Workflow ⭐ 7,090
C++ Parallel Computing and Asynchronous Networking Engine
Debezium ⭐ 6,158
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Graylog2 Server ⭐ 5,992
Free and open source log management
Faust ⭐ 5,955
Python Stream Processing
God Of Bigdata ⭐ 5,853
专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
Librdkafka ⭐ 5,698
The Apache Kafka C/C++ library
Signoz ⭐ 5,665
SigNoz is an open-source APM. It helps developers monitor their applications & troubleshoot problems, an open-source alternative to DataDog, NewRelic, etc. 🔥 🖥. 👉 Open source Application Performance Monitoring (APM) & Observability tool
Cap ⭐ 5,292
Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern
Ksql ⭐ 4,721
The database purpose-built for stream processing applications.
Kafka Python ⭐ 4,701
Python client for Apache Kafka
Jocko ⭐ 4,487
Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
Kafka Go ⭐ 4,321
Kafka library in Go
Gpmall ⭐ 4,285
【咕泡学院实战项目】-基于SpringBoot+Dubbo构建的电商平台-微服务架构、商城、电商、微服务、高并发、kafka、Elasticsearch
Pipeline ⭐ 4,113
PipelineAI Kubeflow Distribution
Benthos ⭐ 3,931
Fancy stream processing made operationally mundane
Watermill ⭐ 3,668
Building event-driven applications the easy way in Go.
Materialize ⭐ 3,524
Materialize simplifies application development with streaming data. Incrementally-updated materialized views - in PostgreSQL and in real time. Materialize is powered by Timely Dataflow.
Logikm ⭐ 3,468
一站式Apache Kafka集群指标监控与运维管控平台
Gizmo ⭐ 3,460
A Microservice Toolkit from The New York Times
Kafdrop ⭐ 3,286
Kafka Web UI
Openreplay ⭐ 3,284
📺 OpenReplay is developer-friendly, open-source session replay.
Redpanda ⭐ 3,277
Redpanda is the real-time engine for modern apps. Kafka API Compatible; 10x faster 🚀 See more at vectorized.io/redpanda
Surging ⭐ 3,089
Surging is a micro-service engine that provides a lightweight, high-performance, modular RPC request pipeline. The service engine supports http, TCP, WS,Grpc, Thrift,Mqtt, UDP, and DNS protocols. It uses ZooKeeper and Consul as a registry, and integrates it. Hash, random, polling, Fair Polling as a load balancing algorithm, built-in service governance to ensure reliable RPC communication, the engine contains Diagnostic, link tracking for protocol and middleware calls, and integration SkyWalking Distributed APM
Alink ⭐ 2,974
Alink is the Machine Learning algorithm platform based on Flink, developed by the PAI team of Alibaba computing platform.
Strimzi Kafka Operator ⭐ 2,919
Apache Kafka running on Kubernetes
Qmq ⭐ 2,428
QMQ是去哪儿网内部广泛使用的消息中间件，自2012年诞生以来在去哪儿网所有业务场景中广泛的应用，包括跟交易息息相关的订单场景； 也包括报价搜索等高吞吐量场景。
Kafkajs ⭐ 2,373
A modern Apache Kafka client for node.js
Efak ⭐ 2,283
A easy and high-performance monitoring system, for comprehensive monitoring and management of kafka cluster.
Akhq ⭐ 2,236
Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...
Confluent Kafka Dotnet ⭐ 2,143
Confluent's Apache Kafka .NET client
Kafka Ui ⭐ 2,098
Open-Source Web GUI for Apache Kafka Management
Cruise Control ⭐ 2,079
Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.
Enqueue Dev ⭐ 1,985
Message Queue, Job Queue, Broadcasting, WebSockets packages for PHP, Symfony, Laravel, Magento. DEVELOPMENT REPOSITORY - provided by Forma-Pro
Netty Learning Example ⭐ 1,954
🥚 Netty实践学习案例，见微知著！带着你的心，跟着教程。我相信你行欧。
Spec ⭐ 1,912
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.
Kafka Rest ⭐ 1,874
Confluent REST Proxy for Kafka
Goka ⭐ 1,871
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
Kafka Stack Docker Compose ⭐ 1,863
docker compose files to create a fully working kafka stack
Node Rdkafka ⭐ 1,816
Node.js bindings for librdkafka
Ockam ⭐ 1,791
End-to-end encryption and mutual authentication for distributed applications.
Mizu ⭐ 1,780
API traffic viewer for Kubernetes enabling you to view all API communication between microservices. Think TCPDump and Wireshark re-invented for Kubernetes
Oryx ⭐ 1,759
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Secor ⭐ 1,743
Secor is a service implementing Kafka log persistence
Php Rdkafka ⭐ 1,717
Production-ready, stable Kafka client for PHP
Fast Data Dev ⭐ 1,705
Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors
Xtdb ⭐ 1,695
General-purpose bitemporal database for SQL, Datalog & graph queries. Developed by @juxt
Schema Registry ⭐ 1,673
Confluent Schema Registry for Kafka
Brighter ⭐ 1,592
A framework for building messaging apps with .NET and C#.
Whatsmars ⭐ 1,580
Java生态研究(Spring Boot + Redis + Dubbo + RocketMQ + Elasticsearch)🔥🔥🔥🔥🔥
Syslog Ng ⭐ 1,564
syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.
Rsyslog ⭐ 1,534
a Rocket-fast SYStem for LOG processing
Ultimate Go ⭐ 1,532
This repo contains my notes on working with Go and computer systems.
Myth ⭐ 1,475
Reliable messages resolve distributed transactions
Seldon Server ⭐ 1,420
Machine Learning Platform and Recommendation Engine built on Kubernetes
Java Eight Part ⭐ 1,390
『Java八股文』Java面试套路，Java进阶学习，打破内卷拿大厂Offer，升职加薪！
Kafka Php ⭐ 1,380
kafka php client
Alpakka Kafka ⭐ 1,359
Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
Examples ⭐ 1,356
Apache Kafka and Confluent Platform examples and demos
Bigdataguide ⭐ 1,349
大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料
Filodb ⭐ 1,327
Distributed Prometheus time series database
Karafka ⭐ 1,314
Framework for Apache Kafka based Ruby and Rails applications development.
Kafka_exporter ⭐ 1,310
Kafka exporter for Prometheus
Plumber ⭐ 1,222
A swiss army knife CLI tool for interacting with Kafka, RabbitMQ and other messaging systems.
Ruby Kafka ⭐ 1,115
A Ruby client library for Apache Kafka
Eventhorizon ⭐ 1,110
Event Sourcing for Go!
Kafkacenter ⭐ 1,076
KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.
Pykafka ⭐ 1,071
Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
Demo Scene ⭐ 1,053
👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/
Bds ⭐ 1,046
Blockchain data parsing and persisting results
Bigdata Interview ⭐ 1,041
🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结
Cp Docker Images ⭐ 1,039
[DEPRECATED] Docker images for Confluent Platform.
Nagios Plugins ⭐ 1,038
450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...
Zaneperfor ⭐ 1,018
前端性能监控系统,消息队列,高可用,集群等相关架构
Javakeeper ⭐ 996
✍️ Java 工程师必备架构体系知识总结：涵盖分布式、微服务、RPC等互联网公司常用架构，以及数据存储、缓存、搜索等必备技能
Pretendyourexyzzy ⭐ 992
A web clone of the card game Cards Against Humanity.
Dockerfiles ⭐ 966
50+ DockerHub public images for Docker & Kubernetes - DevOps, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak
Hazelcast Jet ⭐ 956
Distributed Stream and Batch Processing
Practical.cleanarchitecture ⭐ 950
Asp.Net Core 6 Clean Architecture (Microservices, Modular Monolith, Monolith) samples (+Blazor, Angular 13, React 17, Vue 2.6), Domain-Driven Design, CQRS, Event Sourcing, SOLID, Asp.Net Core Identity Custom Storage, Identity Server 4 Admin UI, Entity Framework Core, Selenium E2E Testing, SignalR, Hosted Services, Health Checks, Security Headers, ...
Scrapy Cluster ⭐ 934
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
Sarama Cluster ⭐ 921
Cluster extensions for Sarama, the Go client library for Apache Kafka 0.9 [DEPRECATED]
Kudo ⭐ 912
Kubernetes Universal Declarative Operator (KUDO)
Fooltrader ⭐ 912
a modular quant framework
Szt Bigdata ⭐ 892
深圳地铁大数据客流分析系统🚇🚄🌟
Hmq ⭐ 889
High performance mqtt broker
Imi ⭐ 862
imi 是一款支持长连接微服务分布式的 PHP 开发框架，它可以运行在 PHP-FPM、Swoole、Workerman、RoadRunner 等多种容器环境下。它支持 HttpApi、WebSocket、TCP、UDP、MQTT 服务的开发。特别适合互联网微服务、即时通讯聊天im、物联网等场景！QQ群：17916227
Vflow ⭐ 855
Enterprise Network Flow Collector (IPFIX, sFlow, Netflow)
Sitewhere ⭐ 854
SiteWhere is an industrial strength open-source application enablement platform for the Internet of Things (IoT). It provides a multi-tenant microservice-based infrastructure that includes device/asset management, data ingestion, big-data storage, and integration through a modern, scalable architecture. SiteWhere provides REST APIs for all system functionality. SiteWhere provides SDKs for many common device platforms including Android, iOS, Arduino, and any Java-capable platform such as Raspberry Pi rapidly accelerating the speed of innovation.
Kt ⭐ 833
Kafka command line tool that likes JSON
Stream Reactor ⭐ 833
Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.
Rust Rdkafka ⭐ 821
A fully asynchronous, futures-based Kafka client library for Rust based on librdkafka
Go Streams ⭐ 813
A lightweight stream processing library for Go
Nakadi ⭐ 808
A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues
1-100 of 3,413 projects

Related Projects

Java Kafka Projects (1,192)
Docker Kafka Projects (465)
Python Kafka Projects (431)
Go Kafka Projects (402)
Scala Kafka Projects (374)
Kafka Spark Projects (338)
Spring Boot Kafka Projects (324)
Redis Kafka Projects (296)
Java Spring Boot Kafka Projects (273)
Elasticsearch Kafka Projects (269)
Kafka Zookeeper Projects (240)
Javascript Kafka Projects (224)
Microservice Kafka Projects (203)
Kubernetes Kafka Projects (203)
Mongodb Kafka Projects (191)
Advertising 📦 9
All Projects
Application Programming Interfaces 📦 120
Applications 📦 181
Artificial Intelligence 📦 72
Blockchain 📦 70
Build Tools 📦 111
Cloud Computing 📦 79
Code Quality 📦 28
Collaboration 📦 30
Command Line Interface 📦 48
Community 📦 81
Companies 📦 60
Compilers 📦 60
Computer Science 📦 74
Configuration Management 📦 39
Content Management 📦 167
Control Flow 📦 197
Data Formats 📦 77
Data Processing 📦 266
Data Storage 📦 132
Economics 📦 60
Frameworks 📦 198
Games 📦 122
Graphics 📦 103
Hardware 📦 148
Integrated Development Environments 📦 47
Learning Resources 📦 147
Legal 📦 28
Libraries 📦 119
Lists Of Projects 📦 21
Machine Learning 📦 336
Mapping 📦 61
Marketing 📦 15
Mathematics 📦 55
Media 📦 228
Messaging 📦 97
Networking 📦 304
Operating Systems 📦 84
Operations 📦 120
Package Managers 📦 52
Programming Languages 📦 229
Runtime Environments 📦 96
Science 📦 42
Security 📦 375
Social Media 📦 26
Software Architecture 📦 70
Software Development 📦 68
Software Performance 📦 57
Software Quality 📦 127
Text Editors 📦 45
Text Processing 📦 131
User Interface 📦 310
User Interface Components 📦 465
Version Control 📦 29
Virtualization 📦 68
Web Browsers 📦 38
Web Servers 📦 25
Web User Interface 📦 194
Privacy policy
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Source 2018-2022