Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Kubeshark | 9,080 | 3 days ago | 80 | apache-2.0 | Go | |||||
The API traffic analyzer for Kubernetes providing real-time K8s protocol-level visibility, capturing and monitoring all traffic and payloads going in, out and across containers, pods, nodes and clusters.. Think TCPDump and Wireshark re-invented for Kubernetes | ||||||||||
Redpanda | 6,786 | 1 | a day ago | 343 | April 25, 2021 | 1,336 | C++ | |||
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM! | ||||||||||
Kafdrop | 4,531 | 3 days ago | 45 | apache-2.0 | Java | |||||
Kafka Web UI | ||||||||||
Pipeline | 4,160 | 7 months ago | 85 | July 18, 2017 | 1 | apache-2.0 | Jsonnet | |||
PipelineAI Kubeflow Distribution | ||||||||||
Strimzi Kafka Operator | 3,855 | 2 | a day ago | 34 | September 06, 2022 | 136 | apache-2.0 | Java | ||
Apache Kafka® running on Kubernetes | ||||||||||
Go Zero Looklook | 3,192 | 12 days ago | 2 | mit | Go | |||||
🔥基于go-zero(go zero) 微服务全技术栈开发最佳实践项目。Develop best practice projects based on the full technology stack of go zero (go zero) microservices. | ||||||||||
Vanus | 2,156 | 5 days ago | 59 | apache-2.0 | Go | |||||
Vanus is a Serverless, event streaming system with processing capabilities. It easily connects SaaS, Cloud Services, and Databases to help users build next-gen Event-driven Applications. | ||||||||||
Kubernetes Kafka | 1,773 | 5 months ago | 83 | apache-2.0 | Shell | |||||
Kafka cluster as Kubernetes StatefulSet, plain manifests and config | ||||||||||
Examples | 1,734 | 5 days ago | 573 | July 07, 2022 | 95 | apache-2.0 | Shell | |||
Apache Kafka and Confluent Platform examples and demos | ||||||||||
Practical.cleanarchitecture | 1,529 | 3 days ago | 25 | C# | ||||||
Full-stack .Net 7 Clean Architecture (Microservices + Dapr, Modular Monolith, Monolith), Blazor, Angular 15, React 18, Vue 3, Domain-Driven Design, CQRS, SOLID, Asp.Net Core Identity Custom Storage, Identity Server, Entity Framework Core, Selenium, SignalR, Hosted Services, Health Checks, Rate Limiting, Cloud (Azure, AWS) Services, ... |
This community seeks to provide:
To quote @arthurk:
thanks for creating and maintaining this Kubernetes files, they're up-to-date (unlike the kubernetes contrib files, don't require helm and work great!
We suggest you apply -f
manifests in the following order:
That'll give you client "bootstrap" bootstrap.kafka.svc.cluster.local:9092
.
Our only dependency is kubectl
. Not because we dislike Helm or Operators, but because we think plain manifests make it easier to collaborate.
If you begin to rely on this kafka setup we recommend you fork, for example to edit broker config.
With the introduction of app customization in kubectl
1.14 there's an alternative to forks. We as a community can maintain a set of overlays.
See the variants folder for different overlays. For example to scale to 1 kafka broker try kubectl apply -k variants/scale-1/
.
Variants also include examples of how to configure volumes for GKE, AWS and AKS with different storage classes.
kubectl create namespace kafka && \
kubectl apply -k github.com/Yolean/kubernetes-kafka/variants/dev-small/?ref=v6.0.3
When all pods are Ready, test with for example kafkacat -b localhost:9094 -L
over kubectl -n kafka port-forward kafka-0 9094
.
Start your variant as a new folder in your choice of version control, with a base kustomization.yaml
pointing to a tag or revision in this repository:
bases:
- github.com/Yolean/kubernetes-kafka/rbac-namespace-default/?ref=60d01b5
- github.com/Yolean/kubernetes-kafka/kafka/?ref=60d01b5
- github.com/Yolean/kubernetes-kafka/zookeeper/?ref=60d01b5
Then pick and chose from patches our example variants to tailor your Kafka setup.
tag | k8s ≥ | highlights |
---|---|---|
v7.0.0 | 1.15+ | Breaking with nonroot and native bases |
v6.0.x | 1.13+ | Kafka 2.4.0 + standard storage class |
v6.0.0 | 1.11+ | Kafka 2.2.0 + apply -k (kubectl 1.14+) + #270
|
v5.1.0 | 1.11+ | Kafka 2.1.1 |
v5.0.3 | 1.11+ | Zookeeper fix #227 + maxClientCnxns=1 |
v5.0 | 1.11+ | Destabilize because in Docker we want Java 11 #197 #191 |
v4.3.1 | 1.9+ | Critical Zookeeper persistence fix #228 |
v4.3 | 1.9+ | Adds a proper shutdown hook #207 |
v4.2 | 1.9+ | Kafka 1.0.2 and tools upgrade |
... see releases for full history ... | ||
v1.0 | 1 | Stateful? In Kubernetes? In 2016? Yes. |
Have a look at:
Available for: