Awesome Open Source

Programming Languages

Search results for scala kafka

381 search results found

Embedded Kafka ⭐ 15

Embedded Kafka for testing and quick prototyping.

Spark Sql Kafka Offset Committer ⭐ 15

Kafka offset committer for structured streaming query

Kafka S3 Connector ⭐ 14

Bigdata Learning ⭐ 14

大数据学习，主要涉及Kafka、ZooKeeper、Hive、HBase、Spark

A native Kafka protocol proxy for Apache Kafka

Java Core ⭐ 14

learning tests -- os, network, mysql, programming, design pattern, java tech, kafka etc

Kafka Streams Scala Examples ⭐ 14

Sqlalarm ⭐ 14

Big data smart alarm by sql

Fdp Sample Applications ⭐ 14

All sample applications for Fast Data Platform

Kafka Streams Workshop ⭐ 14

Examples and exercises for Kafka Streams workshop

Kafka Akka Http And Akka Streams Integration ⭐ 14

An example showing how to integrate Apache Kafka with Akka Streams and Akka HTTP.

Aiqiyi Sparkstreaming ⭐ 14

SparkStreaming爱奇艺实时流统计及可视化展示

Minikube for big data with Scala and Spark

Akka Stream Kafka Template.g8 ⭐ 14

Template for Akka Streams & Kafka. Default impl: mirror a topic onto another one

Motherbase ⭐ 14

Tinytelematics ⭐ 14

Track your vehicle's live location offline by using little more than a Raspberry Pi & a gps dongle, without expensive subscription services.

Logeventsprocessingspark ⭐ 13

real time log event processing using spark, kafka & cassandra

Spark Demos ⭐ 13

Spark(multi versions) + Streaming/Hive/SQL/UDF Demos

Spark Http Stream ⭐ 13

spark structured streaming via HTTP communication

Spark Playground ⭐ 13

Playground for experimenting with Apache Spark

Kafka Streams Examples ⭐ 13

Kafka Connect Mongodb ⭐ 13

MongoDB sink connector for Kafka Connect

Wow Spark ⭐ 13

🔆 spark自学手册，包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake，以及scala基础练习，还有一些例

Bigdata News ⭐ 12

基于Spark2.2新闻网大数据实时系统项目

My Vertx Realtime Module ⭐ 12

Baryon is a library for building Spark Streaming applications that consume data from Kafka.

Kafka Tweet Producer ⭐ 12

Stream tweets into Kafka

Sparkatscale ⭐ 12

Kafka Manager ⭐ 12

Kafka Manager - A tool for managing Apache Kafka.

Kafka Streams Consumer Offsets To Json ⭐ 12

A Kafka Streams process to convert __consumer_offsets to a JSON-readable topic

Nyc_taxi_pipeline ⭐ 12

Design/Implement stream/batch architecture on NYC taxi data | #DE

Spark Stream Kudu ⭐ 12

Kafka, Spark Streaming, Kudu integration examples

Example Kafkastreams ⭐ 12

Kafka Streams DSL vs Processor API

Kafcache ⭐ 11

Kafka Streams + Memcached (e.g. AWS ElasticCache) for low-latency in-memory lookups

Framework based on eventsourcing ideas (Protobuf, scalameta, Kafka, immutable model)

Stream MySQL binary logs and consume them with Scala actors (RabbitMQ, Kafka).

Shopping Cart Scala ⭐ 11

Lagom Scala shopping cart sample application

Spark Example ⭐ 11

Spark1.6和spark2.2的示例，包含kafka,flume,structuredstrea

Rx Kafka ⭐ 11

A Scala library to create RxScala observables and observers from Kafka consumers and producers

Kafka Connect Telegram ⭐ 11

Kafka-connect telegram connector

Haystack Trends ⭐ 11

Kafka consumer & producer for scalaz-stream

Spark_streaming_aggregation ⭐ 11

Event aggregation with spark streaming

Spark Streaming Kafka Example ⭐ 11

An example project using Spark Streaming with Kafka message and Avro serialization

Kafka_data_viewer ⭐ 11

Tool that providing ability to access kafka data - query items in topics and kafka metadata

Kafka Websocket Proxy ⭐ 10

WebSocket proxy that allows clients to produce and consume messages from topics in Apache Kafka. (mirror of https://gitlab.com/kpmeen/kafka-websocket-proxy)

Fake Data Pipeline ⭐ 10

Data Generators -> Kafka -> Spark Streaming -> PostgreSQL -> Grafana

Confluent Platform Spark Streaming ⭐ 10

Working example of consuming Avro data from Kafka with Spark Streaming

Kafkaplayground ⭐ 10

Playground used to learn and experiment with Apache Kafka 🚀

Structured Streaming Application ⭐ 10

Structured Streaming is a reference application showing how to easily integrate structured streaming Apache Spark Structured Streaming, Apache Cassandra and Apache Kafka for fast, structured streaming computations on data.

Twittertrends ⭐ 10

Get Twitter trends with twitter4j, stream it to a Kafka topic, save it to MongoDB and visualize in Google Maps

Haystack Traces ⭐ 10

Components that handle spans, buffers them, writes to ElasticSearch/Cassandra, and provides API to access them .

Minikaf is a minimal implementation of Publish / Subscriber for in memory communication.

Zio Kafka Streams ⭐ 10

Kafka Streams for Scala with ZIO

Kafka Scala Examples ⭐ 10

Contains code samples for using Apache Kafka from Scala

A small project to allow publishing data to Apache Kafka, Apache Pulsar or any other target system

Nagios Plugin Kafka ⭐ 10

Kafka Scala API CLI / Advanced Nagios Plugin, with Kerberos support (uses Kafka 0.9+ native Java API)

Akka Kafka Processor ⭐ 10

Akka cluster to work with kafka streams

Fp Microservice ⭐ 10

A purely functional microservice template in Scala

Spark Kafka Sink ⭐ 9

A Kafka metric sink for Apache Spark

Bigdatademo ⭐ 9

The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big data project relates to Hadoop ecosystem

Eigenflow ⭐ 9

ETL orchestration platform with recoverability and process monitoring features

Kafkatophoenix ⭐ 9

Kafka Akka Stream Play Demo ⭐ 9

Demo / Exploration of Play Framework + Reactive Kafka + EventSource

Activator Kafka Scala Producer Consumer.g8 ⭐ 9

This is an activator project for showcasing how to read & write data from Kafka-cluster using Scala Producer & Consumer API.

Biggis Landuse ⭐ 9

Land use update detection

Ftp Kafka Converters ⭐ 9

Blog on Kafka Connect [ FTP -> KAFKA ]

Telecom Streaming ⭐ 9

Telecom scenarios implemented with streaming techniques

Big Data Pipeline ⭐ 9

Bigdata Examples ⭐ 9

bigdata examples about spark and flink

Reliable at-least-once Ethereum to Kafka bridge in Scala

Kaltura's next generation Analytics solution based on Spark, Cassandra and Kafka

Fdp Beam Modelserver ⭐ 9

Model serving using Beam

Reactive Roulette ⭐ 9

Reactive web-based roulette application built on Lagom framework

Kafka messages non-blocking reprocessor and delayed producer service

Sqs Kafka Connect ⭐ 9

Kafka connect source connector for SQS (public repo)

Kafkakewl ⭐ 9

Manages kafka topics/ACLs in a declarative way

Mikasa_ol ⭐ 8

Mikasa Recommendation System. Twitter Data Analyzer

Teleporter ⭐ 8

Reactive Streams distributed datapipeline for data process. Now support kafka,jdbc,kudu,elasticsearch,hdfs.etc

Iot Trucking App Spark Structured Streaming ⭐ 8

IoT Trucking App with Spark Structured Streaming

Real Time Monitoring System ⭐ 8

本项目主要用于搭建一个基于docker的实时监控系统，涉及的大数据相关组件有Filebeat，Kaf Design组件库和Echarts进行开发

Fast Data Examples ⭐ 8

Adtech Dash ⭐ 8

A Scalable Ad Classification Pipeline, REST API, and Visualization, using Apache Spark, Apache Kafka, Apache HBase, Scalatra, Amazon Web Services, Highcharts

stream-processing framework, developed on top of akka-actor with builtin simple and reliable backpressure mechanism

Lambda_poc ⭐ 8

example lambda architecture using Kafka, Spark, Cassandra, Hadoop

This test program uses structured streaming of spark, receive message that is json type from kafka, then get counts of DNS for every people In one minute. (I think one source Ip addr is one people). Finally, the result will insert to mysql database.

Kafka Scala Api ⭐ 8

Samples for using Kafka within Spark Streaming and Akka Actors, Akka Streams

Kafka Streams Workshops ⭐ 8

Spark Adhoc Kafka ⭐ 7

This is a datasource implementation for quick query in Kafka with Spark

🤓 Examples Advanced 🧐 Projects Akka 🚀 ZIO ⚡️ Algorithms 😼 Cats

Flinkfrauddetection ⭐ 7

Music Store ⭐ 7

A simple CRUD rest application with HTTP4S, Slick, Kafka and Elastic Search

Roowhoo_dashboard ⭐ 7

Kafka active consumers dashboard

Xke Ratatouille ⭐ 7

💊Poison pills and Kafka Streams demo🍛🐀

Kafka Streams Scala ⭐ 7

A fluent Scala API for kafka-streams

Scalable Websocket System ⭐ 7

An example for scalable web socket system using Scala, Play Framework, Akka, Akka Http, Kafka, Cassandra, WebSocket

Gd Workshop ⭐ 7

Codefeedr ⭐ 7

CodeFeedr core infrastructure

Spark Streaming Kafka 010 Demo ⭐ 7

Related Searches

Scala Sbt (4,178)

Scala Spark (3,279)

Java Kafka (3,237)

Scala Akka (2,120)

Java Scala (1,794)

Scala Play Framework (1,309)

Kafka Zookeeper (1,229)

Docker Kafka (1,191)

Python Kafka (1,133)

Plugin Scala (1,079)

201-300 of 381 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.