Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for kafka etl
etl
x
kafka
x
50 search results found
Benthos
⭐
7,564
Fancy stream processing made operationally mundane
Go Streams
⭐
1,656
A lightweight stream processing library for Go
Peerdb
⭐
1,315
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Zdh_web
⭐
379
大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台,包含数据采集,调度,权限,审批
Conduit
⭐
321
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
Replicadb
⭐
304
ReplicaDB is open source tool for database replication, designed for efficiently transferring bulk data between relational and non-relational databases
Kafka Connect File Pulse
⭐
289
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
Storagetapper
⭐
269
StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service
Synch
⭐
268
Sync data from the other DB to ClickHouse(cluster)
Feldera
⭐
199
Feldera Continuous Analytics Platform
Eel Sdk
⭐
140
Big Data Toolkit for the JVM
Kafka Connect
⭐
102
equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨
Datacater
⭐
80
The developer-friendly ETL platform for transforming data in real-time. Based on Apache Kafka® and Kubernetes®.
Skaetl
⭐
55
Open Source ETL designed for and dedicated to Log processing and transformation
Getl
⭐
51
A tool for developing and testing ETL and ELT processes for automating the capture, delivery and processing of information in data warehouses on the MicroFocus Vertica platform.
Mydataharbor
⭐
50
🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数
Etl Engine
⭐
47
etl engine 轻量级 跨平台 流批一体ETL引擎 数据抽取-转换-装载 ETL engine lightweight cross platform batch flow integration ETL engine data extraction transformation loading
Fhir River
⭐
38
Live ETL pipeline to standardize Health Data into FHIR.
Etl Light
⭐
38
A light Kafka to HDFS/S3 ETL library based on Apache Spark
Flinkproj
⭐
36
Flink 案例开发数据清洗、数据报表
Sequelize Kafka Connect
⭐
28
💎 nodejs kafka connect connector for MySQL, Postgres, SQLite and MSSQL
Datayoga
⭐
27
streaming data pipeline platform
Examples
⭐
25
This repository will contain examples of use cases that utilize Decodable streaming solution
Wasp
⭐
25
WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.
Estuary
⭐
24
基于Akka实现的数据实时流式同步的应用,支持高可用
Nodestream
⭐
23
A Fast, Declarative, and Extensible ETL Framework for Graph Databases.
Bandar Log
⭐
20
Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.
Cda Client
⭐
19
Cloud Data Access client
Jun_bigdata
⭐
18
jun_bigdata大数据平台服务框架。实现了Kafka实时数据过滤、清洗、转换、消费,实现了Sp SQL对Redis、MongoDB等非关系型数据库的数据的读写;集成了规则引擎,可基于规则引擎实现客
Bigquery Kafka Connect
⭐
17
☁️ nodejs kafka connect connector for Google BigQuery
Bigdata Tech Index
⭐
16
Big Data Technology Index
Mqtt To Kafka Bridge
⭐
15
Move your messages from MQTT to Apache Kafka in real-time 🚀
Kafka Connect Datagen
⭐
14
A Kafka Connect source connector that generates data for tests
Ifood Data Engineering Test
⭐
13
Infoq Kafka Ksql
⭐
12
Code samples to go with InfoQ article
Camus Compressor
⭐
12
Camus Compressor merges files created by Camus and saves them in a compressed format.
Social Media Analysis
⭐
11
Social Media Analysis, scalable solution, flexible deployment that analyses social media contents
Glue Streaming Etl Demo
⭐
9
AWS serverless etl and streaming demo
Eigenflow
⭐
9
ETL orchestration platform with recoverability and process monitoring features
Kafka Sqlreader Datax
⭐
8
A delta ETL flow trigger by BINLOG in kafka messages.
Kafka_extract
⭐
8
导出指定时间范围的Kafka Topic数据
Openmrs Etl
⭐
7
openmrs - mysql - debezium - kafka - spark - scala
Greenplum Streamsets
⭐
7
Greenplum with Streamsets
Spark Kafka Simple Consumer Receiver
⭐
7
Vx Log
⭐
6
A data acquisition client based on Nxlog
Spark Structured Streaming Kafka
⭐
5
Spark Structured Streaming + Kafka + Delta pipeline.
Etl Elasticsearch App
⭐
5
Extract Transform Load (ETL) pipeline through debezium (cdc), corresponding connector, kafka and kafka-connect, for repliacting the data in replica DB and into Elasticsearch, for real time streaming and event processing and data visualization through kibana. #etl #debezium #kafka #kafka-connect #mySQL #elasticsearch #kibana #ELK stack
Etlexpress
⭐
5
ETL元数据注册,表达式注册
Stock Market Real Time Data Pipeline With Apache Kafka And Cassandra
⭐
5
A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.
Prensio
⭐
5
Simple change data capture tool for mysql and kafka. It taps into mysql binlog events, runs the transformation logic on them and produces kafka events
Related Searches
Java Kafka (3,237)
Kafka Zookeeper (1,229)
Docker Kafka (1,191)
Python Kafka (1,133)
Spark Kafka (979)
Scala Kafka (969)
Golang Kafka (919)
Apache Kafka (836)
Python Etl (814)
Stream Kafka (790)
1-50 of 50 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.