Awesome Open Source
Awesome Open Source
Combined Topics
kafka-connect x
Advertising ๐Ÿ“ฆย 9
All Projects
Application Programming Interfaces ๐Ÿ“ฆย 120
Applications ๐Ÿ“ฆย 181
Artificial Intelligence ๐Ÿ“ฆย 72
Blockchain ๐Ÿ“ฆย 70
Build Tools ๐Ÿ“ฆย 111
Cloud Computing ๐Ÿ“ฆย 79
Code Quality ๐Ÿ“ฆย 28
Collaboration ๐Ÿ“ฆย 30
Command Line Interface ๐Ÿ“ฆย 48
Community ๐Ÿ“ฆย 81
Companies ๐Ÿ“ฆย 60
Compilers ๐Ÿ“ฆย 60
Computer Science ๐Ÿ“ฆย 74
Configuration Management ๐Ÿ“ฆย 39
Content Management ๐Ÿ“ฆย 167
Control Flow ๐Ÿ“ฆย 197
Data Formats ๐Ÿ“ฆย 77
Data Processing ๐Ÿ“ฆย 266
Data Storage ๐Ÿ“ฆย 132
Economics ๐Ÿ“ฆย 60
Frameworks ๐Ÿ“ฆย 198
Games ๐Ÿ“ฆย 122
Graphics ๐Ÿ“ฆย 103
Hardware ๐Ÿ“ฆย 148
Integrated Development Environments ๐Ÿ“ฆย 47
Learning Resources ๐Ÿ“ฆย 147
Legal ๐Ÿ“ฆย 28
Libraries ๐Ÿ“ฆย 119
Lists Of Projects ๐Ÿ“ฆย 21
Machine Learning ๐Ÿ“ฆย 336
Mapping ๐Ÿ“ฆย 61
Marketing ๐Ÿ“ฆย 15
Mathematics ๐Ÿ“ฆย 55
Media ๐Ÿ“ฆย 228
Messaging ๐Ÿ“ฆย 97
Networking ๐Ÿ“ฆย 304
Operating Systems ๐Ÿ“ฆย 84
Operations ๐Ÿ“ฆย 120
Package Managers ๐Ÿ“ฆย 52
Programming Languages ๐Ÿ“ฆย 229
Runtime Environments ๐Ÿ“ฆย 96
Science ๐Ÿ“ฆย 42
Security ๐Ÿ“ฆย 375
Social Media ๐Ÿ“ฆย 26
Software Architecture ๐Ÿ“ฆย 70
Software Development ๐Ÿ“ฆย 68
Software Performance ๐Ÿ“ฆย 57
Software Quality ๐Ÿ“ฆย 127
Text Editors ๐Ÿ“ฆย 45
Text Processing ๐Ÿ“ฆย 131
User Interface ๐Ÿ“ฆย 310
User Interface Components ๐Ÿ“ฆย 465
Version Control ๐Ÿ“ฆย 29
Virtualization ๐Ÿ“ฆย 68
Web Browsers ๐Ÿ“ฆย 38
Web Servers ๐Ÿ“ฆย 25
Web User Interface ๐Ÿ“ฆย 194

The Top 294 Kafka Connect Open Source Projects on Github

Categoriesย >ย Data Processingย >ย Kafka Connect
Debezium โญย 5,728
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Ksql โญย 4,645
The database purpose-built for stream processing applications.
Strimzi Kafka Operator โญย 2,815
Apache Kafka running on Kubernetes
Kafka Ui โญย 1,832
Open-Source Web GUI for Apache Kafka Management
Kafkacenter โญย 1,034
KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.
Cp Docker Images โญย 1,033
[DEPRECATED] Docker images for Confluent Platform.
Demo Scene โญย 1,030
๐Ÿ‘พScripts and samples to support Confluent Demos and Talks. โš ๏ธMight be rough around the edges ;-) ๐Ÿ‘‰For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/
Stream Reactor โญย 817
Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.
Kafka Connect Elasticsearch โญย 627
Kafka Connect Elasticsearch connector
Cp Helm Charts โญย 585
The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.
Kafka Connect Ui โญย 432
Web tool for Kafka Connect |
All Things Cqrs โญย 386
Comprehensive guide to a couple of possible ways of synchronizing two states with Spring tools. Synchronization is shown by separating command and queries in a simple CQRS application.
Cp Ansible โญย 354
Ansible playbooks for the Confluent Platform
Dataengineeringproject โญย 299
Example end to end data engineering project.
Kafka Connect Github Source โญย 252
Get a stream of issues and pull requests for your chosen GitHub repository
Kafka Connect Oracle โญย 237
Kafka Source Connector For Oracle
Kafka Docker Playground โญย 236
๐Ÿณ Fully automated Kafka and Confluent Docker based examples
Mongo Kafka โญย 222
MongoDB Kafka Connector
Ksql Udf Deep Learning Mqtt Iot โญย 188
Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data
Mirus โญย 181
Mirus is a cross data-center data replication tool for Apache Kafka
Kafka Connect Storage Cloud โญย 176
Kafka Connect suite of connectors for Cloud storage (Amazon S3)
Kafka Connect File Pulse โญย 161
๐Ÿ”— A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference โญย 159
Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required
Kafka Connect Mongodb โญย 134
**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
Kafka Connect Spooldir โญย 127
Kafka Connect connector for reading CSV files into Kafka.
Kafka Connect Tools โญย 117
Kafka Connect Tooling
Postgres Kafka Demo โญย 116
Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.
Kcctl โญย 112
A modern and intuitive command line client for Kafka Connect
Kafka Connect Twitter โญย 104
Kafka Connect connector to stream data in real time from Twitter.
Kafka Connect โญย 102
equivalent to kafka-connect ๐Ÿ”ง for nodejs โœจ๐Ÿข๐Ÿš€โœจ
Streamx โญย 95
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Kafka Backup โญย 93
Backup and Restore for Apache Kafka
Kafka Connect Iot Mqtt Connector Example โญย 91
Internet of Things Integration Example => Apache Kafka + Kafka Connect + MQTT Connector + Sensor Data
Kukulcan โญย 91
A REPL for Apache Kafka
Debezium Incubator โญย 90
Previously used repository for new Debezium modules and connectors in incubation phase (archived)
Kspp โญย 87
A high performance/ real-time C++ Kafka streams framework (C++17)
Kafka Connect Fs โญย 86
Kafka Connect FileSystem Connector
Kafka Connect Twitter โญย 75
Kafka Connect Sink/Source for Twitter
Kafka Connect Protobuf Converter โญย 74
Protobuf converter plugin for Kafka Connect
Kafka Helm Charts โญย 68
In-deprecation. For Lenses please check lensesio/lenses-helm-charts. Soon Stream Reactor will also get its own Helm repository.
Kafka Connect Transform Common โญย 67
Common Transforms for Kafka Connect.
Kattlo Cli โญย 63
Kattlo CLI Project
Kafka Connect Mq Source โญย 62
This repository contains a Kafka Connect source connector for copying data from IBM MQ into Apache Kafka.
Snowflake Kafka Connector โญย 59
Snowflake Kafka Connect Connector
Kafka Connect Http โญย 59
Kafka Connect connector that enables Change Data Capture from JSON/HTTP APIs into Kafka.
Kafka Connect Zeebe โญย 56
Kafka Connector for Zeebe.io
Springboot Kafka Connect Jdbc Streams โญย 54
The main goal is to play with Kafka Connect and Streams. We have store-api that inserts/updates records in MySQL; Source connectors that monitor inserted/updated records in MySQL and push messages related to those changes to Kafka; Sink connectors that read messages from Kafka and insert documents in ES; Store-streams that listens for messages in Kafka, treats them using Kafka Streams and push new messages back to Kafka.
Streaming Ops โญย 47
Simulated production environment running Kubernetes targeting Apache Kafka and Confluent components on Confluent Cloud. Managed by declarative infrastructure and GitOps.
Oracdc โญย 45
Oracle database CDC (Change Data Capture)
Terraform Provider Kafka Connect โญย 44
Terraform provider for managing Apache Kafka Connect
Kafka Connect Storage Common โญย 43
Shared software among connectors that target distributed filesystems and cloud storage.
Kafka Connect Ftp โญย 41
A Kafka Connect Source for FTP servers - Monitors files on an FTP server and feeds changes into Kafka
Gcs Connector For Apache Kafka โญย 41
Aiven's GCS Sink Connector for Apache Kafka
Kafka Example โญย 40
Example Node.js kafka setup
Springboot Kafka Connect Debezium Ksqldb โญย 39
The goal of this project is to play with Kafka, Debezium and ksqlDB. For this, we have: research-service that inserts/updates/deletes records in MySQL; Source Connectors that monitor change of records in MySQL and push messages related to those changes to Kafka; Sink Connectors and kafka-research-consumer that listen messages from Kafka and insert/update documents in Elasticsearch; finally, ksqlDB-Server that listens to some topics in Kafka, does some joins and pushes new messages to new topics in Kafka.
Kafka Connect Lambda โญย 38
A Kafka Connect sink plugin to invoke AWS Lambda functions
Kafka Scala Examples โญย 36
Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala
Kafka Connect Elasticsearch Source โญย 34
Kafka Connect Elasticsearch Source
Microservices Observability โญย 34
๐ŸŽ‰ Microservices Observability - Log Aggregation, Distributed Tracking, Metrics
Registryless Avro Converter โญย 33
An avro converter for Kafka Connect without a Schema Registry
Kafka Connect Solr โญย 32
Kafka Connect connector for writing to Solr.
Connect โญย 31
CLI tool and Go client library for the Kafka Connect REST API
Kafka Connectors Tests โญย 31
Test suite for Kafka Connect connectors based on Landoop's Coyote and docker.
Ccloud Tools โญย 30
Running Tools from Confluent Platform along with your Confluent Cloudโ„ข Cluster
Schema Registry Transfer Smt โญย 28
Kafka Connect Transform to copy Avro schemas between Schema Registries
Kafka Connect Transform Kryptonite โญย 28
Kryptonite is a turn-key ready transformation (SMT) for Apache Kafkaยฎ Connect to do field-level ๐Ÿ”’ encryption/decryption ๐Ÿ”“ of records. It's an UNOFFICIAL community project.
Kafka Junit โญย 28
Enables you to start and stop a fully-fledged embedded Kafka cluster from within JUnit and provides a rich set of convenient accessors and fault injectors through a lean API. Supports working against external clusters as well.
Sequelize Kafka Connect โญย 28
๐Ÿ’Ž nodejs kafka connect connector for MySQL, Postgres, SQLite and MSSQL
Kafka Connect Jenkins โญย 28
Kafka Connect Connector for Jenkins Open Source Continuous Integration Tool
Kafka Compose โญย 28
๐ŸŽผ Docker compose files for various kafka stacks
Football Events โญย 27
Event-Driven microservices with Kafka Streams
Jdbc Connector For Apache Kafka โญย 27
Aiven's JDBC Sink and Source Connectors for Apache Kafka
Kafka Connect Mongo โญย 27
Kafka mongo connector (deeply inspired by https://github.com/DataReply/kafka-connect-mongodb)
Kafka Connect Dynamodb โญย 27
Kafka Connector for DynamoDB [unmaintained]
Kafka Connect Kcql Smt โญย 26
Kafka-Connect SMT (Single Message Transformations) with SQL syntax (Using Apache Calcite for the SQL parsing)
Kafka Connect Dynamodb โญย 25
A Kafka Connect Source Connector for DynamoDB
Fast Data Connect Cluster โญย 25
Create Kafka-Connect clusters with docker . You put the Kafka, we put the Connect.
Connect Utils โญย 25
Utility project for working with Kafka Connect.
Ns4kafka โญย 24
Namespaces on top of Kafka Broker, Kafka Connect and Schema Registry
Spring Rdbms Cdc Kafka Elasticsearch โญย 24
Denormalize and Index MySQL database with ElasticSearch and Kafka
Kafkacli โญย 24
CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry)
Kafka Connect Splunk โญย 23
Kafka Connect connector for receiving data and writing data to Splunk.
Kafka Connect Examples โญย 23
Kafka Connect Examples
Kafka Connect Redis โญย 23
Kafka Connect connector for Redis
Awesome Kafka In Clojure โญย 22
Awesome information for using Kafka and Confluent Platform in Clojure.
Kafka Connect Elastic Sink โญย 22
Kafka connect Elastic sink connector, with just in time index/delete behaviour.
Kafka Connect Mq Sink โญย 21
This repository contains a Kafka Connect sink connector for copying data from Apache Kafka into IBM MQ.
Kafka Connect Marklogic โญย 20
Kafka Sink Connect MarkLogic
Cassandra.realtime โญย 20
Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink
Transforms For Apache Kafka Connect โญย 20
Aiven's collection of Single Message Transformations (SMTs) for Apache Kafka Connect
Kafka Connect Client โญย 20
A kafka-connect REST api client for java
Mongodb Sink Connector โญย 19
Kafka MongoDb sink connector
Kafka Connect Cosmosdb โญย 18
Kafka Connect connectors for Azure Cosmos DB
Demo Twitter Kafka โญย 18
Kafka Connect Healthcheck โญย 18
๐Ÿฅ A simple healthcheck wrapper to monitor Kafka Connect.
Bigquery Kafka Connect โญย 17
โ˜๏ธ nodejs kafka connect connector for Google BigQuery
Kafka Connect Redis โญย 16
๐Ÿ“• Kafka Connect source and sink connector for Redis
Kafka Jdbc Connector โญย 16
Simple way to copy data from relational databases into kafka.
Iiot Integration Apache Plc4x Kafka Connect Ksql Opc Ua Modbus Siemens S7 โญย 16
Industrial IoT (IIoT) Integration and Data Processing with Apache PLC4X, Kafka Connect, KSQL (OPC-UA, Modbus, Siemens S7)
Ecupcakesfactoryoncontainers โญย 15
"eCupcakesFactoryOnContainers" is based on a simplified "Microservices" architecture and docker containers. Core intent of this reference application is to provide reference implementation forย .Net developers to easily get started with containerized microservices usingย .Net Core and Kafka.
1-100 of 294 projects

Related Projects

Java Kafka Connect Projects (154)
Kafka Connect Stream Projects (3)
Advertising ๐Ÿ“ฆย 9
All Projects
Application Programming Interfaces ๐Ÿ“ฆย 120
Applications ๐Ÿ“ฆย 181
Artificial Intelligence ๐Ÿ“ฆย 72
Blockchain ๐Ÿ“ฆย 70
Build Tools ๐Ÿ“ฆย 111
Cloud Computing ๐Ÿ“ฆย 79
Code Quality ๐Ÿ“ฆย 28
Collaboration ๐Ÿ“ฆย 30
Command Line Interface ๐Ÿ“ฆย 48
Community ๐Ÿ“ฆย 81
Companies ๐Ÿ“ฆย 60
Compilers ๐Ÿ“ฆย 60
Computer Science ๐Ÿ“ฆย 74
Configuration Management ๐Ÿ“ฆย 39
Content Management ๐Ÿ“ฆย 167
Control Flow ๐Ÿ“ฆย 197
Data Formats ๐Ÿ“ฆย 77
Data Processing ๐Ÿ“ฆย 266
Data Storage ๐Ÿ“ฆย 132
Economics ๐Ÿ“ฆย 60
Frameworks ๐Ÿ“ฆย 198
Games ๐Ÿ“ฆย 122
Graphics ๐Ÿ“ฆย 103
Hardware ๐Ÿ“ฆย 148
Integrated Development Environments ๐Ÿ“ฆย 47
Learning Resources ๐Ÿ“ฆย 147
Legal ๐Ÿ“ฆย 28
Libraries ๐Ÿ“ฆย 119
Lists Of Projects ๐Ÿ“ฆย 21
Machine Learning ๐Ÿ“ฆย 336
Mapping ๐Ÿ“ฆย 61
Marketing ๐Ÿ“ฆย 15
Mathematics ๐Ÿ“ฆย 55
Media ๐Ÿ“ฆย 228
Messaging ๐Ÿ“ฆย 97
Networking ๐Ÿ“ฆย 304
Operating Systems ๐Ÿ“ฆย 84
Operations ๐Ÿ“ฆย 120
Package Managers ๐Ÿ“ฆย 52
Programming Languages ๐Ÿ“ฆย 229
Runtime Environments ๐Ÿ“ฆย 96
Science ๐Ÿ“ฆย 42
Security ๐Ÿ“ฆย 375
Social Media ๐Ÿ“ฆย 26
Software Architecture ๐Ÿ“ฆย 70
Software Development ๐Ÿ“ฆย 68
Software Performance ๐Ÿ“ฆย 57
Software Quality ๐Ÿ“ฆย 127
Text Editors ๐Ÿ“ฆย 45
Text Processing ๐Ÿ“ฆย 131
User Interface ๐Ÿ“ฆย 310
User Interface Components ๐Ÿ“ฆย 465
Version Control ๐Ÿ“ฆย 29
Virtualization ๐Ÿ“ฆย 68
Web Browsers ๐Ÿ“ฆย 38
Web Servers ๐Ÿ“ฆย 25
Web User Interface ๐Ÿ“ฆย 194
Privacy policy
"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Sourceย 2018-2021