Awesome Open Source

Programming Languages

Search results for pipeline kafka

61 search results found

Go Streams ⭐ 1,656

A lightweight stream processing library for Go

Firebolt ⭐ 664

Golang framework for streaming ETL, observability data pipeline, and event processing apps

Netdiscovery ⭐ 557

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

A blazing fast tool for building data pipelines: read, process and output events. Our community: https://t.me/file_d_community

Old Argo Dataflow ⭐ 269

Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines.

Dolphinbeat ⭐ 153

A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.

Scrapy_demo ⭐ 150

all kinds of scrapy demo

Flow Pipeline ⭐ 140

A set of tools and examples to run a flow-pipeline (sFlow, NetFlow)

Qstreaming ⭐ 89

A simplified, lightweight ETL pipeline framework for build stream/batch processing applications on top of Apache Spark

Data Processing Pipeline ⭐ 59

Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra

Datapipeline ⭐ 57

Real time stock data pipeline --play with Kafka, Cassandra, Spark, Redis, Node.js, Zookeeper

Python data pipeline

Data Stream Development With Apache Spark Kafka And Spring Boot ⭐ 54

Data Stream Development with Apache Spark, Kafka and Spring Boot by Packt Publishing

Today I Learned

Teraslice ⭐ 50

Scalable data processing pipelines in JavaScript

Mydataharbor ⭐ 50

🇨🇳 MyDataHarbor是一个致力于解决任意数据源到任意数据源的分布式、高扩展性、高性能、事务级的数

Machine learning around business processes

Typestream ⭐ 48

Open Source streaming platform. Write and run typed data pipelines with a minimal, familiar syntax.

Hyperdrive ⭐ 41

Extensible streaming ingestion pipeline on top of Apache Spark

Scrapy Distributed ⭐ 40

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Neverwinterdp_legacy ⭐ 31

NeverwinterDP - The Data Pipeline for Hadoop and Data Systems

Minipipe ⭐ 30

Minipipe: a minimal end-to-end data pipeline

Datayoga ⭐ 27

streaming data pipeline platform

Pipeline Gnmi ⭐ 24

A Model-Driven Telemetry collector based on the open-source tool pipeline

Hazelcast Jet Contrib ⭐ 19

Extension modules for Hazelcast Jet

Crcdemos ⭐ 19

Red Hat CodeReady Containers (Minishift equivalent for OpenShift 4.2 or newer) - step-by-step demo guides

Kahpp Oss ⭐ 18

Kafka Streams made easy with a YAML file

Twitter Stream ⭐ 18

Twitter-Kafka Data Pipeline

yet another databus that transfer/transform pipeline data between plugins

Real Time Stock Analyzer ⭐ 16

Bigdata Pipeline

Apachekafka ⭐ 16

A curated re-sources list for awesome Apache Kafka

Knative On Ocp4 ⭐ 15

Tutorial to learn Knative on OCP4 Cluster

Chronos Pipeline ⭐ 13

A data pipeline for processing event data

Eventstream ⭐ 13

🚀 Eventstream pipeline to preprocess and resend from some source to some storage

Off_broadway_kafka ⭐ 12

Deploy Kafka pipelines to Kubernetes

Pipelines Twitter Demo ⭐ 12

Example project which simulates an interesting analytics use case using MemSQL Pipelines.

Sdc Api Tool ⭐ 12

A set of utilities to help with management of Streamsets pipelines.

Nyc_taxi_pipeline ⭐ 12

Design/Implement stream/batch architecture on NYC taxi data | #DE

The magic message bus

Frizzle for Apache Kafka

Snowplow Pipeline ⭐ 11

End-to-end Snowplow Analytics Pipeline for real time events

Dev Guide Sp Kafka Bq ⭐ 10

code for talk developers guide for realtime pipeline with snowplow kafka and bigquery

Tms Demo ⭐ 10

Kafka pipeline demo

Optimizing Public Transportation ⭐ 10

A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.

Trendingtopics ⭐ 9

Discover what is trending anywhere in the world. An end-to-end data pipeline using big data tools on AWS.

A Stream Processor written in Golang that support pluggable tasks

Eigenflow ⭐ 9

ETL orchestration platform with recoverability and process monitoring features

Ingestion Ws Kafka Hdfs ⭐ 8

Example of ingestion pipeline realizing flow: WebSocket -> Kafka -> HDFS

Telemetry Staging Ansible ⭐ 8

All in one orchestrated ecosystem to experiment with Cisco XR Model Driven Telemetry

Traffic Mirroring ⭐ 8

Replication Processor ⭐ 7

Control Plane for Kafka Data Pipelines

Streaming Pipeline ⭐ 7

A real-time text classification based on Kafka and Spark.

Openmrs Etl ⭐ 7

openmrs - mysql - debezium - kafka - spark - scala

Am Pipeline ⭐ 7

Simple data pipeline showing how to create full text search over some dataset

Docker Streamsets Kafka Minecraft ⭐ 7

Visualize Apache logs in Minecraft using Docker, Streamsets Data Collector, Spigot and Kafka .

Os Scrapy Kafka Pipeline ⭐ 7

Kafka Twitter Fanout ⭐ 7

Part of a data processing pipeline example using Apache Kafka on Heroku

Newsrecommendation ⭐ 6

Connectorbase ⭐ 6

A framework for Kafka to produce and consume business data.

Streamingpipeline ⭐ 6

Stream processing pipeline with apache beam, druid and superset

Real Time Stock Streaming Pipeline ⭐ 6

Fantasysportsleagues ⭐ 6

Implementation of a website that tracks fantasy sports leagues.

Realtime Market Data Pipeline ⭐ 6

A real-time financial data streaming pipeline and visualization platform using Apache Kafka, Cassandra, and Bokeh.

Literate Garbanzo ⭐ 6

Network Pulse: A distributed, fault-tolerant big data pipeline that performs graph analysis over unbounded data streams

Stock Market Real Time Data Pipeline With Apache Kafka And Cassandra ⭐ 5

A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.

Kafka Pipeline ⭐ 5

A robust, easy to use kafka message consumer helps you managing message offsets in correct way.

Kafka Twitter Aggregate ⭐ 5

Part of a data processing pipeline example using Apache Kafka on Heroku

Iot_sensor_analytics ⭐ 5

Geode Demo ⭐ 5

Related Searches

Python Pipeline (4,255)

Java Kafka (3,237)

Javascript Pipeline (1,369)

Kafka Zookeeper (1,229)

Docker Kafka (1,191)

Pipeline Jenkins (1,150)

Shell Pipeline (1,143)

Python Kafka (1,133)

Docker Pipeline (1,018)

Spark Kafka (979)

1-61 of 61 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.