Awesome Open Source

Programming Languages

Search results for scala kafka

381 search results found

Kafka Streams Scala ⭐ 46

Thin Scala wrapper for the Kafka Streams API

Flink Explore ⭐ 46

基于canal/kafka conenct的mysql/oracle数据实时同步、flink rest api、flink sql以及udf

Conduktor Coding Challenge ⭐ 46

Want to work with us? Here is a mini-coding challenge you can try :)

Fdp Modelserver ⭐ 45

An umbrella project for multiple implementations of model serving

Twitterstream ⭐ 45

Twitter Streaming API Example with Kafka Streams in Scala

Cloudbowl Microservice Game ⭐ 45

Scala wrapper for kafka consumer and producer

Awesome Recommendation Engine ⭐ 43

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.

Kafka Offset Monitor Graphite ⭐ 43

Graphite reporter for Kafka Offset Monitor.

Kafka Cryptocoin ⭐ 42

Kafka producer for data collection from cryptocurrency exchanges

Kafka Scala Examples ⭐ 42

Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala

Hello Play Kafka ⭐ 41

Kafka_training ⭐ 41

Basic getting started with Kafka examples

Kafka Connect Ftp ⭐ 41

A Kafka Connect Source for FTP servers - Monitors files on an FTP server and feeds changes into Kafka

Hyperdrive ⭐ 41

Extensible streaming ingestion pipeline on top of Apache Spark

Standalone alternatives to Kafka Connect Connectors

Secret Provider ⭐ 39

Open Source Secret Provider plugin for the Kafka Connect framework

Rmlstreamer ⭐ 38

The RMLStreamer executes RML rules to generate high quality Linked Data from multiple originally (semi-)structured data sources in a streaming way.

Etl Light ⭐ 38

A light Kafka to HDFS/S3 ETL library based on Apache Spark

Real Time Stream Processing Engine ⭐ 37

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Xxhadoop ⭐ 37

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Udp Kafka Bridge ⭐ 36

Simple daemon to pass UDP messages to Kafka

Spark Kafka 0 8 Sql ⭐ 36

Spark Structured Streaming Kafka 0.8 Source Implementation

Litemall Dw ⭐ 36

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；

Toketi Kafka Connect Iothub ⭐ 35

Kafka Connect IoT Hub is a Kafka source connector for pumping data from Azure IoT Hub to Kafka.

Kafka Streams ⭐ 34

Kafka Configurator ⭐ 33

Kafka Topic Configurator

Common Kafka ⭐ 33

Common utilities for Apache Kafka

Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for streaming/messaging system.

Ticket Booking Aecor ⭐ 33

Sample application for "Aecor — Purely functional event sourcing in Scala" series.

Kafka Message Scheduler ⭐ 32

Scheduler for low-frequency and long-term scheduling of delayed messages to Kafka topics.

Zipkin Mesos Framework ⭐ 32

Zipkin Mesos Framework

Kafka Reassign Optimizer ⭐ 32

Kafka Partitions Re-Assignment Optimizer in scala

Kanadi is a Nakadi client for Scala

Linkerd Zipkin ⭐ 30

linkerd telemeter plugins for writing trace data to zipkin

Burrower ⭐ 30

A small project to report offset lag for Kafka Consumer Groups via Burrow.

Stream Loader ⭐ 30

Components for building stream loaders from Kafka to arbitrary storages

Kafka Spark Streaming Druid ⭐ 29

Takes a kafka stream into spark, apply transformations and sink into Druid. Everything Dockerised.

Spark Secure Kafka App ⭐ 29

Sample Spark Streaming application for secure consumption from Kafka

Flink Analysis Of Electronic Commerce ⭐ 29

Flink 电商指标分析系统

Kafka Examples ⭐ 29

Kafka Examples repository.

Rts_practice ⭐ 28

Adenium Normalizer

Almaren Framework ⭐ 28

The Almaren Framework provides a simplified consistent minimalistic layer over Apache Spark. While still allowing you to take advantage of native Apache Spark features. You can still combine it with standard Spark code.

Reactive Kafka Scala Example ⭐ 28

reactive-kafka examples in scala

Kafka Streams Circe ⭐ 27

Generic Serdes with Circe for Kafka Streams

Akka_streams_tutorial ⭐ 27

A collection of runnable and self-contained examples inspired by various akka-streams (pekko-streams) and Alpakka (Pekko connectors) docs, tutorials and blogs

KNet is a comprehensive .NET suite for Apache Kafka providing all features: Producer, Consumer, Admin, Streams, Connect, backends (ZooKeeper and Kafka).

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Circe Kafka ⭐ 25

Implicit conversion of Encoder and Decoder into Serializer/Deserializer/Serde

Trafficteach ⭐ 25

大数据项目:车流量监控

基于Akka实现的数据实时流式同步的应用,支持高可用

Plant Simulator ⭐ 24

Power Plant simulator service that can ramp up and down power producing units

Affinity ⭐ 24

Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka

Event Sourcing Kafka Streams ⭐ 24

Demo code from my talk @ Codemotion Milan 2018 - "Building event sourced systems with Kafka Streams"

Recommendsystem ⭐ 24

电影推荐系统

Real Time Recommender ⭐ 24

Real time CF recommender system

Flink_training ⭐ 23

A collection of examples to help show different ways to managing state in Apache Flink

Summingbird Hybrid Example ⭐ 23

A self-contained example of summingbird running in hybrid mode

Marseille ⭐ 23

A real time streaming implementation of markov chain based fraud detection

Scala Kafka Twitter ⭐ 23

Example integration of Kafka, Avro & Spark-Streaming on live Twitter feed

Location Based Restaurants Recommendation System ⭐ 23

Big Data Management and Analysis Final Project

Kafka Streams Plumber ⭐ 22

Plumber, for your dirtiest Kafka streaming jobs

Kafka Spark Streaming ⭐ 22

Project for reading data from kafka and writing to kafka and HBase with kerberos

Kafka Connect Common ⭐ 21

Common components used across the datamountaineer kafka connect connectors

Activator Reactive Kafka Scala ⭐ 21

Activator template for Reactive Kafka

Typesafe Kafka Streams ⭐ 21

A started draft of a typesafe - scala - compatible API

Sparktwitterstreamanalysis ⭐ 21

A Spark Streaming App to analyze the popular hashtags based on keywords

Spark Kafka Streaming ⭐ 21

Custom Spark Kafka consumer based on Kafka SimpleConsumer API.

Scala Kafka Protobuf ⭐ 21

PoC using scala that defines single-message protobuf API per Kafka topic

Sample Kafkasparkcassandra ⭐ 21

Introductory sample scala app using Apache Spark Streaming to accept data from Kafka and write a summary to Cassandra.

Bandar Log ⭐ 20

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Hello Kafka Salesforce ⭐ 20

Dendrites ⭐ 20

Scala library for Reactive streaming Microservices, CQRS, Event Sourcing, Event Logging, & message-driven apps.

Kafka Application4s ⭐ 20

Freestyle Kafka ⭐ 20

Freestyle Kafka

Sparkstreaming Algebird Algorithms Demo ⭐ 19

Cda Client ⭐ 19

Cloud Data Access client

Spark Streaming With Google Cloud Example ⭐ 19

an example of integrating Spark Streaming with Google Pub/Sub and Google Datastore

Redis Kafka Streams State Store

Kafka Flow ⭐ 18

library for reliable processing records received from kafka

Sparknlp Elasticsearch ⭐ 17

Twitter sentiment analysis using Spark and Stanford CoreNLP and visualization using elasticsearch and kibana

Divolte Examples ⭐ 17

Usage examples for Divolte collector

Spark Kafka Avro ⭐ 17

POC: Spark consumer for bottledwater-pg Kafka Avro topics

Incubator Pekko Connectors Kafka ⭐ 17

Apache Pekko Kafka Connector - Pekko-Connectors is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Apache Pekko.

Bigdata Workshop Es ⭐ 17

Workshop Big Data en Español

Kafka Streams ⭐ 17

Oh you know, just a coupla, two, tree Kafka Streams in Scala

Kafka Jdbc Connector ⭐ 16

Simple way to copy data from relational databases into kafka.

Es Cqrs Shopping Cart ⭐ 16

A resilient and scalable shopping cart system designed using Event Sourcing (ES) and Command Query Responsibility Segregation (CQRS)

A set of reactive libraries to enable stateful stream processing & event sourcing using only Kafka as a data store.

Kafka 0.11 Examples ⭐ 16

Code snippets that demonstrate how to leverage the new Kafka 0.11 APIs

Java_spark ⭐ 16

Spark 2.x 案例操作：Scala版本与 Java1.8lambda版代码示例。涵盖Spark核心技术操作SparkCore、SparkSql

Exactly Once Streams ⭐ 16

An engineering report on using transactions in Kafka 0.11.0.0

小白大数据学习笔记 ⭐

Sync3k Server ⭐ 15

Zio_front ⭐ 15

ZIO frontend for the Clover Group AI platform

Kafka Scalathon ⭐ 15

Kafka demos at Scalathon

Related Searches

Scala Sbt (4,178)

Scala Spark (3,279)

Java Kafka (3,237)

Scala Akka (2,120)

Java Scala (1,794)

Scala Play Framework (1,309)

Kafka Zookeeper (1,229)

Docker Kafka (1,191)

Python Kafka (1,133)

Plugin Scala (1,079)

101-200 of 381 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.