Awesome Open Source
Awesome Open Source
Combined Topics
kafka-connect x

The Top 375 Kafka Connect Open Source Projects

Categories > Data Processing > Kafka Connect
Debezium ⭐ 7,529
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
dependent packages 32total releases 137most recent commit a day ago
Ksql ⭐ 5,208
The database purpose-built for stream processing applications.
most recent commit 5 hours ago
Kafka Ui ⭐ 3,662
Open-Source Web UI for Apache Kafka Management
most recent commit 4 hours ago
Strimzi Kafka Operator ⭐ 3,448
Apache Kafka® running on Kubernetes
dependent packages 2total releases 33most recent commit 4 hours ago
Demo Scene ⭐ 1,204
👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/
most recent commit a month ago
Kcenter ⭐ 1,125
KCenter(KafkaCenter) is a unified platform for kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components(ksql/kafka connect).it's kafkacenter(kafka center).
most recent commit 2 months ago
Cp Docker Images ⭐ 1,062
[DEPRECATED] Docker images for Confluent Platform.
most recent commit 6 months ago
Stream Reactor ⭐ 888
Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.
dependent packages 1total releases 1most recent commit a month ago
Cp Helm Charts ⭐ 673
The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.
most recent commit 6 months ago
Kafka Connect Elasticsearch ⭐ 667
Kafka Connect Elasticsearch connector
most recent commit 2 days ago
Kafka Connect Ui ⭐ 432
Web tool for Kafka Connect |
most recent commit 10 months ago
Cp Ansible ⭐ 406
Ansible playbooks for the Confluent Platform
most recent commit 13 days ago
All Things Cqrs ⭐ 386
Comprehensive guide to a couple of possible ways of synchronizing two states with Spring tools. Synchronization is shown by separating command and queries in a simple CQRS application.
most recent commit 3 years ago
Dataengineeringproject ⭐ 385
Example end to end data engineering project.
most recent commit 8 months ago
Kafka Docker Playground ⭐ 346
🐳 Fully automated Apache Kafka® and Confluent Docker based examples
most recent commit 6 days ago
Mongo Kafka ⭐ 273
MongoDB Kafka Connector
dependent packages 1total releases 13most recent commit 6 days ago
Kafka Connect Github Source ⭐ 252
Get a stream of issues and pull requests for your chosen GitHub repository
most recent commit 2 years ago
Kafka Connect Oracle ⭐ 237
Kafka Source Connector For Oracle
most recent commit 2 years ago
Kcctl ⭐ 230
A modern and intuitive command line client for Kafka Connect
most recent commit 13 days ago
Kafka Connect File Pulse ⭐ 220
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
dependent packages 3total releases 5most recent commit 4 days ago
Kafka Connect Storage Cloud ⭐ 211
Kafka Connect suite of connectors for Cloud storage (Amazon S3)
most recent commit 2 days ago
Ksql Udf Deep Learning Mqtt Iot ⭐ 188
Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data
most recent commit 2 years ago
Mirus ⭐ 186
Mirus is a cross data-center data replication tool for Apache Kafka
total releases 22most recent commit 7 months ago
Kafka Streams In Action ⭐ 183
Source code for the Kafka Streams in Action Book
most recent commit a year ago
Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference ⭐ 159
Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required
most recent commit 2 years ago
Kafka Connect Mongodb ⭐ 134
**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
total releases 3most recent commit 2 years ago
Kafka Connect Spooldir ⭐ 130
Kafka Connect connector for reading CSV files into Kafka.
total releases 14most recent commit 9 months ago
Kafka Connect Tools ⭐ 117
Kafka Connect Tooling
most recent commit a year ago
Postgres Kafka Demo ⭐ 116
Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.
most recent commit 10 months ago
Camel Kafka Connector ⭐ 114
Camel Kafka Connector allows you to use all Camel components as Kafka Connect connectors
most recent commit 2 days ago
Kafka Connect Twitter ⭐ 104
Kafka Connect connector to stream data in real time from Twitter.
most recent commit a year ago
Kafka Connect ⭐ 102
equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨
dependent packages 13total releases 43most recent commit a year agonpm kafka-connect} Downloads
Kafka Connect Transform Common ⭐ 99
Common Transforms for Kafka Connect.
most recent commit 4 months ago
Kafka Connect Archtype ⭐ 99
Maven quick start for building Kafka Connect connectors.
total releases 5most recent commit 3 years ago
Kafka Connect Fs ⭐ 98
Kafka Connect FileSystem Connector
most recent commit 9 months ago
Kspp ⭐ 97
A high performance/ real-time C++ Kafka streams framework (C++17)
most recent commit 5 days ago
Streamx ⭐ 95
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
most recent commit 3 years ago
Kafka Backup ⭐ 93
Backup and Restore for Apache Kafka
most recent commit 2 years ago
Kafka Connect Iot Mqtt Connector Example ⭐ 91
Internet of Things Integration Example => Apache Kafka + Kafka Connect + MQTT Connector + Sensor Data
most recent commit 3 years ago
Kukulcan ⭐ 91
A REPL for Apache Kafka
most recent commit 2 years ago
Debezium Incubator ⭐ 90
Previously used repository for new Debezium modules and connectors in incubation phase (archived)
total releases 67most recent commit 2 years ago
Snowflake Kafka Connector ⭐ 83
Snowflake Kafka Connector (Sink Connector)
total releases 40most recent commit 3 days ago
Terraform Provider Kafka Connect ⭐ 80
Terraform provider for managing Apache Kafka Connect
total releases 3most recent commit 5 months ago
Kafka Connect Twitter ⭐ 75
Kafka Connect Sink/Source for Twitter
most recent commit 3 years ago
Kafka Connect Protobuf Converter ⭐ 74
Protobuf converter plugin for Kafka Connect
total releases 4most recent commit 3 years ago
Kafka Connect Mq Source ⭐ 73
This repository contains a Kafka Connect source connector for copying data from IBM MQ into Apache Kafka.
most recent commit 2 months ago
Springboot Kafka Connect Jdbc Streams ⭐ 73
The main goal is to play with Kafka Connect and Streams. We have store-api that inserts/updates records in MySQL; Source connectors that monitor inserted/updated records in MySQL and push messages related to those changes to Kafka; Sink connectors that read messages from Kafka and insert documents in ES; Store-streams that listens for messages in Kafka, treats them using Kafka Streams and push new messages back to Kafka.
most recent commit 15 days ago
Kafka Connect Zeebe ⭐ 72
Kafka Connector for Zeebe.io
total releases 5most recent commit 4 days ago
Hello Kafka Streams ⭐ 71
Wikipedia stream-processing demo using Kafka Connect and Kafka Streams.
most recent commit 5 years ago
Kafka Connect Http ⭐ 69
Kafka Connect connector that enables Change Data Capture from JSON/HTTP APIs into Kafka.
total releases 11most recent commit 6 months ago
Kafka Helm Charts ⭐ 68
In-deprecation. For Lenses please check lensesio/lenses-helm-charts. Soon Stream Reactor will also get its own Helm repository.
most recent commit 2 years ago
Oracdc ⭐ 64
Oracle database CDC (Change Data Capture)
most recent commit 17 days ago
Kattlo Cli ⭐ 63
Kattlo CLI Project
most recent commit a year ago
Mirrortool For Kafka Connect ⭐ 63
A Kafka Source connector for Kafka Connect
most recent commit 2 years ago
Ccloud Tools ⭐ 62
Running Tools from Confluent Platform along with your Confluent Cloud™ Cluster
most recent commit 6 months ago
Streaming Ops ⭐ 59
Simulated production environment running Kubernetes targeting Apache Kafka and Confluent components on Confluent Cloud. Managed by declarative infrastructure and GitOps.
most recent commit 6 months ago
Kafka Workshop ⭐ 57
most recent commit 3 years ago
Kafka Connect Blog ⭐ 56
Demo for Kafka Connect with JDBC and HDFS Connectors
most recent commit 2 years ago
Microservices Change Data Capture With Debezium ⭐ 56
Microservices data exchange with change data capture and outbox pattern.
most recent commit 2 years ago
Springboot Kafka Connect Debezium Ksqldb ⭐ 52
The goal of this project is to play with Kafka, Debezium and ksqlDB. For this, we have: research-service that inserts/updates/deletes records in MySQL; Source Connectors that monitor change of records in MySQL and push messages related to those changes to Kafka; Sink Connectors and kafka-research-consumer that listen messages from Kafka and insert/update documents in Elasticsearch; finally, ksqlDB-Server that listens to some topics in Kafka, does some joins and pushes new messages to new topics
most recent commit 14 days ago
Kafka Connect Web ⭐ 51
Web tool for operating kafka connect https://hub.docker.com/r/officialkakao/kafka-conne
most recent commit 3 months ago
Gcs Connector For Apache Kafka ⭐ 49
Aiven's GCS Sink Connector for Apache Kafka®
most recent commit 25 days ago
Kafka Connect Storage Common ⭐ 48
Shared software among connectors that target distributed filesystems and cloud storage.
most recent commit 2 days ago
Jdbc Connector For Apache Kafka ⭐ 46
Aiven's JDBC Sink and Source Connectors for Apache Kafka®
most recent commit 24 days ago
Flink Explore ⭐ 46
基于canal/kafka conenct的mysql/oracle数据实时同步、flink rest api、flink sql以及udf
most recent commit 7 months ago
Kafka Connect Lambda ⭐ 44
A Kafka Connect sink plugin to invoke AWS Lambda functions
most recent commit 8 months ago
Kafka Scala Examples ⭐ 42
Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala
most recent commit 2 months ago
Kafka Connect Elasticsearch Source ⭐ 41
Kafka Connect Elasticsearch Source
most recent commit 9 months ago
Kafka Connect Ftp ⭐ 41
A Kafka Connect Source for FTP servers - Monitors files on an FTP server and feeds changes into Kafka
total releases 3most recent commit a year ago
Kafka Example ⭐ 40
Example Node.js kafka setup
most recent commit a year ago
Kafka Junit ⭐ 39
Enables you to start and stop a fully-fledged embedded Kafka cluster from within JUnit and provides a rich set of convenient accessors and fault injectors through a lean API. Supports working against external clusters as well.
dependent packages 1total releases 21most recent commit 4 days ago
Kryptonite For Kafka ⭐ 38
Kryptonite for Kafka is a client-side 🔒 field level 🔓 crypto library for Apache Kafka® currently focused on Kafka Connect data integration use cases and ksqlDB stream processing scenarios. It's an ! UNOFFICIAL ! community project
most recent commit 2 months ago
Ns4kafka ⭐ 36
Namespaces on top of Kafka Broker, Kafka Connect and Schema Registry
most recent commit 24 days ago
Http Connector For Apache Kafka ⭐ 35
Apache Kafka Connect sink connector for HTTP
most recent commit 25 days ago
Microservices Observability ⭐ 34
🎉 Microservices Observability - Log Aggregation, Distributed Tracking, Metrics
most recent commit 5 years ago
Kafka Sink Azure Kusto ⭐ 33
Kafka sink for Kusto
most recent commit 12 days ago
Registryless Avro Converter ⭐ 33
An avro converter for Kafka Connect without a Schema Registry
most recent commit 2 years ago
Kafka Connect Dynamodb ⭐ 33
A Kafka Connect Source Connector for DynamoDB
most recent commit 3 months ago
Kafka Connect Solr ⭐ 32
Kafka Connect connector for writing to Solr.
total releases 10most recent commit a year ago
Kafka Connectors Tests ⭐ 32
Test suite for Kafka Connect connectors based on Landoop's Coyote and docker.
most recent commit 3 years ago
Common Kafka ⭐ 32
Common utilities for Apache Kafka
dependent packages 1total releases 7most recent commit 3 months ago
S3 Connector For Apache Kafka ⭐ 32
Aiven's S3 Sink Connector for Apache Kafka®
most recent commit 24 days ago
Kafka Connect Aws Lambda ⭐ 31
most recent commit a year ago
Connect ⭐ 31
CLI tool and Go client library for the Kafka Connect REST API
most recent commit 3 years ago
Kafka Elasticsearch Sink ⭐ 30
most recent commit 5 years ago
Kafka Source Connector ⭐ 29
This repository contains a sample project that can be used to start off your own source connector for Kafka Connect.
most recent commit 10 months ago
Schema Registry Transfer Smt ⭐ 28
Kafka Connect Transform to copy Avro schemas between Schema Registries
most recent commit 2 years ago
Kafka Connect Jenkins ⭐ 28
Kafka Connect Connector for Jenkins Open Source Continuous Integration Tool
most recent commit 3 years ago
Kafka Compose ⭐ 28
🎼 Docker compose files for various kafka stacks
most recent commit 5 years ago
Sequelize Kafka Connect ⭐ 28
💎 nodejs kafka connect connector for MySQL, Postgres, SQLite and MSSQL
dependent packages 1total releases 27most recent commit a year agonpm sequelize-kafka-connect} Downloads
Transforms For Apache Kafka Connect ⭐ 28
Aiven's collection of Single Message Transformations (SMTs) for Apache Kafka Connect
most recent commit 25 days ago
Kafka Connect Redis ⭐ 28
Kafka Connect connector for Redis
total releases 2most recent commit 5 months ago
Logminer Kafka Connect ⭐ 27
CDC Kafka Connect source for Oracle Databases leveraging Oracle Logminer
most recent commit 5 months ago
Football Events ⭐ 27
Event-Driven microservices with Kafka Streams
most recent commit 4 years ago
Kafka Connect Dynamodb ⭐ 27
Kafka Connector for DynamoDB [unmaintained]
most recent commit 3 years ago
Connect Utils ⭐ 27
Utility project for working with Kafka Connect.
dependent packages 7total releases 127most recent commit 5 months ago
Kafka Connect Cosmosdb ⭐ 27
Kafka Connect connectors for Azure Cosmos DB
most recent commit 10 days ago
Kafka Connect Mongo ⭐ 27
Kafka mongo connector (deeply inspired by https://github.com/DataReply/kafka-connect-mongodb
most recent commit 3 years ago
Kafka Connect Mq Sink ⭐ 26
This repository contains a Kafka Connect sink connector for copying data from Apache Kafka into IBM MQ.
most recent commit 2 months ago
Kafka Connect Redis ⭐ 26
📕 Kafka Connect source and sink connector for Redis
most recent commit 6 months ago
1-100 of 375 projects
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,090,060)
Python  (836,862)
Java  (396,315)
Php  (289,821)
Typescript  (266,127)
C Plus Plus  (245,644)
Ruby  (222,621)
C  (186,064)
Shell  (175,562)
C Sharp  (169,379)
Golang  (163,592)
Swift  (66,730)
Rust  (61,591)
R  (59,598)
Objective C  (57,116)
Dart  (56,061)
Kotlin  (49,101)
Lua  (35,607)
Matlab  (31,776)
Perl  (30,633)
Language  (29,988)
Scala  (28,906)
Haskell  (20,613)
Powershell  (19,524)
Clojure  (19,265)
Bash  (18,860)
Coffeescript  (17,224)
Elixir  (16,943)
Assembly  (15,003)
Processing  (13,286)
Julia  (13,275)
Basic  (10,702)
Emacs Lisp  (10,558)
Flow  (10,532)
Erlang  (9,072)
Solidity  (8,893)
Groovy  (8,490)
Scheme  (8,419)
Ocaml  (6,797)
Pascal  (6,570)
Hack  (6,461)
Lisp  (6,345)
Fortran  (5,644)
Elm  (5,505)
Common Lisp  (5,379)
Dlang  (4,763)
Shell Script  (4,727)
Python Library  (4,474)
Crystal  (4,402)
Scripting  (4,218)
Top Projects
Freecodecamp ⭐ 353,860
996.icu ⭐ 263,876
Free Programming Books ⭐ 249,820
Coding Interview University ⭐ 234,090
Awesome ⭐ 220,672
Developer Roadmap ⭐ 212,635
Public Apis ⭐ 209,615
Vue ⭐ 199,611
System Design Primer ⭐ 197,601
React ⭐ 195,230
Tensorflow ⭐ 167,934
Build Your Own X ⭐ 165,260
Bootstrap ⭐ 159,657
You Dont Know Js ⭐ 159,180
Cs Notes ⭐ 156,901
Javascript Algorithms ⭐ 151,359
Ohmyzsh ⭐ 150,386
Python ⭐ 145,251
Flutter ⭐ 145,242
Awesome Python ⭐ 142,001
Gitignore ⭐ 138,733
Linux ⭐ 138,490
Vscode ⭐ 136,934
Javaguide ⭐ 127,508
Javascript ⭐ 127,377
Computer Science ⭐ 123,917
Python 100 Days ⭐ 123,512
Youtube Dl ⭐ 113,542
Fucking Algorithm ⭐ 110,396
The Art Of Command Line ⭐ 109,914
React Native ⭐ 105,024
Go ⭐ 104,049
Awesome Selfhosted ⭐ 103,828
Electron ⭐ 103,793
30 Seconds Of Code ⭐ 102,805
D3 ⭐ 101,796
Create React App ⭐ 97,104
Axios ⭐ 95,834
Free Programming Books Zh_cn ⭐ 94,901
Next.js ⭐ 93,062
Kubernetes ⭐ 92,328
Node ⭐ 90,542
Awesome Go ⭐ 88,320
Three.js ⭐ 85,553
Deno ⭐ 85,410
Terminal ⭐ 85,389
Typescript ⭐ 84,486
Angular ⭐ 84,020
Ant Design ⭐ 81,977
Nodebestpractices ⭐ 81,676
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.