Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Data Kafka Open Source Projects

Open source projects categorized as Data Kafka
Cookbook ⭐ 12,557
The Data Engineering Cookbook
most recent commit 3 months ago
Debezium ⭐ 9,534
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
dependent packages 56total releases 175most recent commit 3 months ago
Arroyo ⭐ 2,914
Distributed stream processing engine in Rust
total releases 2most recent commit 3 months ago
Bottledwater Pg ⭐ 1,517
Change data capture from PostgreSQL into Kafka
most recent commit 10 months ago
Killrweather ⭐ 1,174
KillrWeather is a reference application (work in progress) showing how to easily integrate streaming and batch data processing with Apache Spark Streaming, Apache Cassandra, Apache Kafka and Akka for fast, streaming computations on time series data in asynchronous event-driven environments.
most recent commit 7 years ago
Bds ⭐ 1,046
Blockchain data parsing and persisting results
total releases 1most recent commit 4 years ago
Stream Reactor ⭐ 960
A collection of open source Apache 2.0 Kafka Connector maintained by Lenses.io.
dependent packages 1total releases 1most recent commit 3 months ago
Brooklin ⭐ 875
An extensible distributed system for reliable nearline data streaming at scale
most recent commit 3 months ago
Dataengineeringproject ⭐ 644
Example end to end data engineering project.
most recent commit a year ago
Metrictank ⭐ 628
metrics2.0 based, multi-tenant timeseries store for Graphite and friends.
dependent packages 5total releases 17most recent commit 8 months ago
Awesome Kafka ⭐ 549
A list about Apache Kafka
most recent commit 7 months ago
Clickhouse_sinker ⭐ 477
Easily load data from kafka to ClickHouse
total releases 39most recent commit 3 months ago
Agile_data_code_2 ⭐ 435
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
most recent commit a year ago
Zdh_web ⭐ 379
大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台，包含数据采集,调度,权限,审批
most recent commit 3 months ago
Datafaker ⭐ 377
Datafaker is a large-scale test data and flow test data generation tool. Datafaker fakes data and inserts to varied data sources. 测试数据生成工具
total releases 53most recent commit 3 years ago
Cryptostore ⭐ 358
A scalable storage service for cryptocurrency data
total releases 16most recent commit 8 months ago
Old Argo Dataflow ⭐ 269
Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines.
dependent packages 4total releases 350most recent commit 4 months ago
Gimel ⭐ 230
Big Data Processing Framework - Unified Data API or SQL on Any Storage
most recent commit a year ago
Azkarra Streams ⭐ 168
🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.
dependent packages 5total releases 14most recent commit 2 years ago
Voluble ⭐ 153
Intelligent data generator for Apache Kafka. Generates streams of realistic data with support for cross-topic relationships, tombstoning, configurable rates, and more.
total releases 2most recent commit 7 months ago
Ingestion ⭐ 148
Flume - Ingestion, an Apache Flume distribution
most recent commit 7 years ago
Lenses Docker ⭐ 148
❤for real-time DataOps - where the application and data fabric blends - Lenses
most recent commit 3 months ago
Illuminati ⭐ 111
This is a Platform that collects all the data accuring in your Application and shows the data in real time by using Kibana or other tools.
dependent packages 1total releases 3most recent commit a year ago
The 10 Most Depended On Data Kafka Open Source Projects
Debezium ⭐ 9,534
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
dependent packages 56total releases 175latest release November 16, 2023most recent commit 3 months ago
Metrictank ⭐ 628
metrics2.0 based, multi-tenant timeseries store for Graphite and friends.
dependent packages 5total releases 17latest release November 26, 2021most recent commit 8 months ago
Connectorbase ⭐ 6
A framework for Kafka to produce and consume business data.
dependent packages 5total releases 55latest release January 03, 2023most recent commit 10 months ago
Old Argo Dataflow ⭐ 269
Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines.
dependent packages 4total releases 350latest release July 25, 2022most recent commit 4 months ago
Datayoga ⭐ 27
streaming data pipeline platform
dependent packages 3total releases 34latest release November 26, 2022most recent commit 5 months agonpm @datayoga-io/shared} Downloads
Log4js Logstash Kafka ⭐ 7
A simple log appender for log4js that sends the data to logstash by kafka.
dependent packages 2total releases 3latest release September 04, 2016most recent commit 8 years agonpm log4js-logstash-kafka} Downloads
Eth Exporter ⭐ 13
A library for building data extraction jobs for ETH events
dependent packages 2total releases 2latest release September 11, 2019most recent commit 9 months agonpm @santiment-network/eth-exporter} Downloads
Py Avro Schema ⭐ 24
Generate Apache Avro schemas for Python types including standard library data-classes and Pydantic data models.
dependent packages 1total releases 39latest release November 22, 2023most recent commit 5 months agopypi py-avro-schema} Downloads
The 10 Latest Releases In Data Kafka Open Source Projects
Beavers ⭐ 13
Python stream processing for analytics
total releases 10latest release November 27, 2023most recent commit 3 months ago
Py Avro Schema ⭐ 24
Generate Apache Avro schemas for Python types including standard library data-classes and Pydantic data models.
dependent packages 1total releases 39latest release November 22, 2023most recent commit 5 months agopypi py-avro-schema} Downloads
Debezium ⭐ 9,534
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
dependent packages 56total releases 175latest release November 16, 2023most recent commit 3 months ago
Arroyo ⭐ 2,914
Distributed stream processing engine in Rust
total releases 2latest release October 17, 2023most recent commit 3 months ago
Kanadi ⭐ 32
Kanadi is a Nakadi client for Scala
total releases 39latest release September 15, 2023most recent commit 3 months ago
Connectorbase ⭐ 6
A framework for Kafka to produce and consume business data.
dependent packages 5total releases 55latest release January 03, 2023most recent commit 10 months ago
Datayoga ⭐ 27
streaming data pipeline platform
dependent packages 3total releases 34latest release November 26, 2022most recent commit 5 months agonpm @datayoga-io/shared} Downloads
Clickhouse_sinker ⭐ 477
Easily load data from kafka to ClickHouse
total releases 39latest release July 26, 2022most recent commit 3 months ago
Popular Data Storage Categories
Database
Mysql
Redis
Mongodb
Postgresql
Firebase
Elasticsearch
Backup
Sqlite
Archive
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.