Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for kafka avro
avro
x
kafka
x
204 search results found
Confluent Kafka Dotnet
⭐
2,691
Confluent's Apache Kafka .NET client
Schema Registry
⭐
2,092
Confluent Schema Registry for Kafka
Examples
⭐
1,821
Apache Kafka and Confluent Platform examples and demos
Bottledwater Pg
⭐
1,517
Change data capture from PostgreSQL into Kafka
Pmacct
⭐
982
pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].
Kafka Storm Starter
⭐
729
[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Kafkactl
⭐
708
Command Line Tool for managing Apache Kafka
Data Engineering Interview Questions
⭐
554
More than 2000+ Data engineer interview questions.
Schema Registry Ui
⭐
415
Web tool for Avro Schema Registry |
Slimmessagebus
⭐
412
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Mypipe
⭐
390
MySQL binary log consumer with the ability to act on changed rows and publish changes to different systems with emphasis on Apache Kafka.
Prometheus Kafka Adapter
⭐
331
Use Kafka as a remote storage database for Prometheus (remote write only)
Mongo Kafka
⭐
315
MongoDB Kafka Connector
Kafka Connect File Pulse
⭐
289
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
Divolte Collector
⭐
275
Divolte Collector
Storagetapper
⭐
269
StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service
Abris
⭐
215
Avro SerDe for Apache Spark structured APIs.
Trifecta
⭐
211
Trifecta is a web-based and CLI tool that simplifies inspecting Kafka messages and Zookeeper data. Additionally, the CLI tool provides the capability to import/export data to/from ElasticSearch and MongoDB.
Srclient
⭐
208
Golang Client for Schema Registry
Dataclasses Avroschema
⭐
189
Generate avro schemas from python classes. Code generation from avro schemas. Serialize/Deserialize python instances with avro schemas
Kafka Avro Course
⭐
176
Learn the Confluent Schema Registry & REST Proxy
Kafka Connect Datagen
⭐
161
Connector that generates data for demos
Bigdata Playground
⭐
154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Kafka Connect Bigquery
⭐
151
DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigq A Kafka Connect BigQuery sink connector
Kafka Connect Mongodb
⭐
148
**Unofficial / Community** Kafka Connect MongoDB Sink Connector -> integrated 2019 into the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
Kafka Rest Node
⭐
144
Node.js client for the Kafka REST proxy
Confluent Schema Registry
⭐
142
is a library that makes it easier to interact with the Confluent schema registry
Eel Sdk
⭐
140
Big Data Toolkit for the JVM
Clickhouse Sink Connector
⭐
140
Replicate data from MySQL, Postgres and MongoDB to ClickHouse
Kafka Serialization
⭐
121
Lego bricks to build Apache Kafka serializers and deserializers
Dotnet Avro
⭐
121
An Avro implementation for .NET
Schema Registry
⭐
116
A CLI and Go client for Kafka Schema Registry. This repository is deprecated and no longer maintained.
Xk6 Kafka
⭐
116
k6 extension to load test Apache Kafka with support for various serialization formats, SASL, TLS, compression, Schema Registry client and beyond
Datagen
⭐
109
Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.
Confluent Kafka Certification
⭐
108
This repos is to keep all the relevant informations for Confluent Certified Developer for Apache Kafka (CCDAK)
Jr
⭐
104
JR: streaming quality random data from the command line
Schema Registry Plugin
⭐
103
Gradle plugin to interact with Confluent Schema-Registry.
Kspp
⭐
97
A high performance/ real-time C++ Kafka streams framework (C++17)
Kaufmann_ex
⭐
91
Kafka backed service library.
Avroconvert
⭐
90
Rapid Avro serializer for C# .NET
Avrora
⭐
87
A convenient Elixir library to work with Avro schemas and Confluent® Schema Registry
Camus
⭐
87
Mirror of Linkedin's Camus
Fluent Kafka Streams Tests
⭐
86
Fluent Kafka Streams Test with Java
Springboot Kafka Connect Jdbc Streams
⭐
82
Project goal: Explore Kafka, Kafka Connect, and Kafka Streams. Components: store-api: Inserts/updates MySQL records. Source Connectors: Monitor MySQL changes, push messages to Kafka. Sink Connectors: Listen to Kafka, insert/update Elasticsearch docs. store-streams: Listens to Kafka, processes with Kafka Streams, pushes new messages to Kafka.
Messenger Kafka
⭐
79
Simple Kafka transport for Symfony Messenger.
Kafka Avro
⭐
79
Node.js bindings for librdkafka with Avro schema serialization.
Kafka Connect Twitter
⭐
75
Kafka Connect Sink/Source for Twitter
Open Bank Mark
⭐
72
A bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.
Castle
⭐
70
Framework for building Kafka and avro based apps in typescript
Orleans.streams.kafka
⭐
68
An implementation of a PersistentStreamProvider for Microsoft Orleans and Kafka using the Confluent API
Spark Structured Streaming
⭐
66
Spark structured streaming with Kafka data source and writing to Cassandra
Springboot Kafka Connect Debezium Ksqldb
⭐
65
Experiment with Kafka, Debezium, and ksqlDB. research-service: Performs MySQL record manipulation. Source Connectors: Monitor MySQL changes, push messages to Kafka. Sink Connectors and kafka-research-consumer: Listen to Kafka, insert/update Elasticsearch. ksqlDB-Server: Listens to Kafka, performs joins, and pushes new messages to new Kafka topics.
Python Kafka Avro
⭐
62
A simple examle for Python Kafka Avro
Faust Docker Compose Example
⭐
62
Faust dockerized application
Avro_ex
⭐
60
An Avro Library that emphasizes testability and ease of use.
Ecommerce App
⭐
59
eCommerce application is a platform where customers can find products, shop around using a cart, check out the products and initiate payments. It is used for the didactic purpose only, as a support project for my training at https://www.ionutbalosin.com/training
Kadmin
⭐
58
Web Based Kafka Consumer and Producer
Avro Kafka Storm
⭐
57
Avro Kafka and Strom integration
Insulator
⭐
56
A client UI to inspect Kafka topics, consume, produce and much more
Kafka Serde Scala
⭐
56
Implicitly converts typeclass encoders to kafka Serializer, Deserializer, Serde.
Kafka Connect Elasticsearch Source
⭐
55
Kafka Connect Elasticsearch Source
Deimos
⭐
55
Framework to work with Kafka, Avro and ActiveRecord
Php Kafka Lib
⭐
48
PHP Kafka producer / consumer library with PHP Avro support, based on php-rdkafka
Kafka Connect Rest
⭐
48
Kafka Connect REST connector
Schema Registry Transfer Smt
⭐
48
Kafka Connect Transform to copy Avro schemas between Schema Registries
Java 11 Examples
⭐
46
JDK 11 examples and demo projects.
Kafka Zsh Completions
⭐
46
ZSH plugin to have Kafka automatic completion for most CLI tools
Kotlin Kafka And Kafka Streams Examples
⭐
46
Kafka with KafkaReactor and Kafka Streams Examples in Kotlin
Kafka Connect Cosmosdb
⭐
43
Kafka Connect connectors for Azure Cosmos DB
Learn You Some Kafka
⭐
43
Atomic, bite-size, highly-focused interactive tutorials that teach you how to work with Kafka
Kafka Scala Examples
⭐
42
Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala
Tamer
⭐
41
Standalone alternatives to Kafka Connect Connectors
Kafka Examples
⭐
39
Practical examples with Apache Kafka®
Kafka Sink Azure Kusto
⭐
39
Kafka sink for Kusto
Etl Light
⭐
38
A light Kafka to HDFS/S3 ETL library based on Apache Spark
Registryless Avro Converter
⭐
33
An avro converter for Kafka Connect without a Schema Registry
Kafka Connect Hbase
⭐
33
Kafka Connect to Hbase
Kafka Tutorial Simple Client
⭐
32
Kafka Message Scheduler
⭐
32
Scheduler for low-frequency and long-term scheduling of delayed messages to Kafka topics.
Collecting Data
⭐
31
This is a HOWTO for collecting data in Ruby and Python applications and sending it to S3 via Kafka.
Framework Of Bigdata
⭐
30
大数据面试题,从0到1走向架构师之路。Flink、Spark、Hive、HBase、Hadoop、K
Kafkian
⭐
29
An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka
Buildoop
⭐
29
Hadoop Ecosystem Builder: Build, package, test and deploy your Hadoop ecosystem project.
Kafka Compose
⭐
28
🎼 Docker compose files for various kafka stacks
Kafka Tool Avro
⭐
27
Avro plugin for Kafka Tool
Go Kafka Avro
⭐
26
A library provides consumer/producer to work with kafka, avro and schema registry
Spring Schema Registry
⭐
26
The purpose of this module is to solve the problem of multiple keystores using Spring Boot + Kafka + Schema Registry + SSL and Spring Schema Resgistry Test
Go Kafka Avro
⭐
26
Library to work with Apache Kafka using Avro serialization format
Kafka Questdb Connector
⭐
26
QuestDB connector for Kafka
Kafka To Avro Writer
⭐
25
Kafka to Avro Writer based on Apache Beam. It's a generic solution that reads data from multiple kafka topics and stores it on in cloud storage in Avro format.
Singlestore Logistics Sim
⭐
25
Scalable package delivery logistics simulator built using SingleStore and Vectorized Redpanda
Kafkacli
⭐
24
CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry)
Pulsar Io Kafka
⭐
24
Pulsar IO Kafka Connector
Schema Registry Statistics
⭐
24
Schema Registry Statistics Tool
Spring Cloud Stream Event Sourcing Testcontainers
⭐
24
Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an event informing this change is sent to Kafka. Also, we will implement another application that listens to those events and saves them in Cassandra. Finally, we will use Testcontainers for end-to-end testing.
Affinity
⭐
24
Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka
Spring Kafka Event Sourcing Sampler
⭐
24
Showcases how to build a small Event-sourced application using Spring Boot, Spring Kafka, Apache Avro and Apache Kafka
Red Pnda
⭐
24
Minimal viable set of the core components for app developers
Py Avro Schema
⭐
24
Generate Apache Avro schemas for Python types including standard library data-classes and Pydantic data models.
Schema Registry
⭐
23
📙 json & avro http schema registry backed by Kafka
Related Searches
Java Kafka (3,237)
Kafka Zookeeper (1,229)
Docker Kafka (1,191)
Python Kafka (1,133)
Spark Kafka (979)
Scala Kafka (969)
Golang Kafka (919)
Apache Kafka (836)
Stream Kafka (790)
Shell Kafka (642)
1-100 of 204 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.