Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Pipeline Kafka Open Source Projects

Open source projects categorized as Pipeline Kafka
Go Streams ⭐ 1,656
A lightweight stream processing library for Go
dependent packages 8total releases 19most recent commit 3 months ago
Firebolt ⭐ 664
Golang framework for streaming ETL, observability data pipeline, and event processing apps
total releases 15most recent commit 4 months ago
Netdiscovery ⭐ 557
NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。
most recent commit 3 years ago
Koober ⭐ 301
most recent commit 6 years ago
File.d ⭐ 270
A blazing fast tool for building data pipelines: read, process and output events. Our community: https://t.me/file_d_community
total releases 85most recent commit 3 months ago
Old Argo Dataflow ⭐ 269
Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines.
dependent packages 4total releases 350most recent commit 4 months ago
Dolphinbeat ⭐ 153
A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.
most recent commit 5 years ago
Scrapy_demo ⭐ 150
all kinds of scrapy demo
most recent commit a year ago
Flow Pipeline ⭐ 140
A set of tools and examples to run a flow-pipeline (sFlow, NetFlow)
total releases 2most recent commit a year ago
Qstreaming ⭐ 89
A simplified, lightweight ETL pipeline framework for build stream/batch processing applications on top of Apache Spark
total releases 5most recent commit 3 years ago
Data Processing Pipeline ⭐ 59
Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra
most recent commit 7 years ago
Datapipeline ⭐ 57
Real time stock data pipeline --play with Kafka, Cassandra, Spark, Redis, Node.js, Zookeeper
most recent commit 7 years ago
Ank ⭐ 56
Python data pipeline
total releases 11most recent commit a year ago
Data Stream Development With Apache Spark Kafka And Spring Boot ⭐ 54
Data Stream Development with Apache Spark, Kafka and Spring Boot by Packt Publishing
most recent commit a year ago
Til ⭐ 51
Today I Learned
most recent commit a year ago
Teraslice ⭐ 50
Scalable data processing pipelines in JavaScript
dependent packages 31total releases 129most recent commit 3 months agonpm @terascope/utils} Downloads
Mydataharbor ⭐ 50
🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数
total releases 6most recent commit a year ago
Bpmn.ai ⭐ 49
Machine learning around business processes
most recent commit 3 years ago
Typestream ⭐ 48
Open Source streaming platform. Write and run typed data pipelines with a minimal, familiar syntax.
most recent commit 3 months ago
Hyperdrive ⭐ 41
Extensible streaming ingestion pipeline on top of Apache Spark
dependent packages 1total releases 8most recent commit a year ago
Scrapy Distributed ⭐ 40
A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.
total releases 8most recent commit a year ago
Neverwinterdp_legacy ⭐ 31
NeverwinterDP - The Data Pipeline for Hadoop and Data Systems
most recent commit 8 years ago
Minipipe ⭐ 30
Minipipe: a minimal end-to-end data pipeline
most recent commit 8 years ago
The 8 Most Depended On Pipeline Kafka Open Source Projects
Teraslice ⭐ 50
Scalable data processing pipelines in JavaScript
dependent packages 31total releases 129latest release September 27, 2023most recent commit 3 months agonpm @terascope/utils} Downloads
Go Streams ⭐ 1,656
A lightweight stream processing library for Go
dependent packages 8total releases 19latest release October 17, 2022most recent commit 3 months ago
Connectorbase ⭐ 6
A framework for Kafka to produce and consume business data.
dependent packages 5total releases 55latest release January 03, 2023most recent commit 10 months ago
Old Argo Dataflow ⭐ 269
Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines.
dependent packages 4total releases 350latest release July 25, 2022most recent commit 4 months ago
Datayoga ⭐ 27
streaming data pipeline platform
dependent packages 3total releases 34latest release November 26, 2022most recent commit 5 months agonpm @datayoga-io/shared} Downloads
Frizzle ⭐ 12
The magic message bus
dependent packages 2total releases 3latest release March 21, 2019most recent commit 5 years ago
Kafka Pipeline ⭐ 5
A robust, easy to use kafka message consumer helps you managing message offsets in correct way.
dependent packages 1total releases 31latest release December 18, 2019most recent commit 4 years agonpm kafka-pipeline} Downloads
Hyperdrive ⭐ 41
Extensible streaming ingestion pipeline on top of Apache Spark
dependent packages 1total releases 8latest release November 20, 2020most recent commit a year ago
The 10 Latest Releases In Pipeline Kafka Open Source Projects
Kpops ⭐ 12
Deploy Kafka pipelines to Kubernetes
total releases 63latest release October 24, 2023most recent commit 3 months ago
Teraslice ⭐ 50
Scalable data processing pipelines in JavaScript
dependent packages 31total releases 129latest release September 27, 2023most recent commit 3 months agonpm @terascope/utils} Downloads
Eventstream ⭐ 13
🚀 Eventstream pipeline to preprocess and resend from some source to some storage
total releases 14latest release April 02, 2023most recent commit a year ago
Firebolt ⭐ 664
Golang framework for streaming ETL, observability data pipeline, and event processing apps
total releases 15latest release March 23, 2023most recent commit 4 months ago
Connectorbase ⭐ 6
A framework for Kafka to produce and consume business data.
dependent packages 5total releases 55latest release January 03, 2023most recent commit 10 months ago
Datayoga ⭐ 27
streaming data pipeline platform
dependent packages 3total releases 34latest release November 26, 2022most recent commit 5 months agonpm @datayoga-io/shared} Downloads
Go Streams ⭐ 1,656
A lightweight stream processing library for Go
dependent packages 8total releases 19latest release October 17, 2022most recent commit 3 months ago
Old Argo Dataflow ⭐ 269
Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines.
dependent packages 4total releases 350latest release July 25, 2022most recent commit 4 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.