Awesome Open Source

Programming Languages

Search results for scala kafka

313 search results found

Bigdata Notes ⭐ 14,872

大数据入门指南 ⭐

Cmak ⭐ 11,908

CMAK is a tool for managing Apache Kafka clusters

Bigdataguide ⭐ 2,355

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Kafka Streams Examples ⭐ 2,248

Demo applications and code examples for Apache Kafka's Streams API.

Szt Bigdata ⭐ 2,055

深圳地铁大数据客流分析系统🚇🚄🌟

Movie_recommend ⭐ 1,441

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

Alpakka Kafka ⭐ 1,416

Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

Filodb ⭐ 1,409

Distributed Prometheus time series database

Alpakka ⭐ 1,259

Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

Stream Reactor ⭐ 960

A collection of open source Apache 2.0 Kafka Connector maintained by Lenses.io.

Mirror of Apache Samza

Kafka Storm Starter ⭐ 729

[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Pkpmspark ⭐ 697

awesome 三维数据挖掘数据分析 & 推荐

Freestyle ⭐ 615

A cohesive & pragmatic framework of FP centric Scala libraries

Nussknacker ⭐ 564

Low-code tool for automating actions on real time data | Stream processing for the users.

Real Time Analytics and Data Pipelines based on Spark Streaming

Greyhound ⭐ 471

Greyhound - Rich Kafka client library

MySQL binary log consumer with the ability to act on changed rows and publish changes to different systems with emphasis on Apache Kafka.

Learndoc ⭐ 370

🔥🚀架构师的成长之路-博客-导图

Scala Kafka Client ⭐ 354

Scala helper modules for operating the Apache Kafka client library (0.9.x - 2.1.0)

Embedded Kafka ⭐ 352

A library that provides an in-memory Kafka instance to run your tests against.

Zio Kafka ⭐ 322

A Kafka client for ZIO and ZIO Streams

Kafka-based message queue

Every Single Day I Tldr ⭐ 311

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Scalatest Embedded Kafka ⭐ 290

A library that provides an in-memory Kafka instance to run your tests against.

Sparkstreaming ⭐ 253

Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志

Kafka Exactly Once ⭐ 245

Apache Kafka Poc And Notes ⭐ 232

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Azure Event Hubs Spark ⭐ 225

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Flink Notes ⭐ 223

flink学习笔记

Avro SerDe for Apache Spark structured APIs.

Trifecta ⭐ 211

Trifecta is a web-based and CLI tool that simplifies inspecting Kafka messages and Zookeeper data. Additionally, the CLI tool provides the capability to import/export data to/from ElasticSearch and MongoDB.

Kafka Streams Scala ⭐ 191

Thin Scala wrapper around Kafka Streams Java API

Kafka With Akka Streams Kafka Streams Tutorial ⭐ 191

Code samples for the Lightbend tutorial on writing microservices with Akka Streams, Kafka Streams, and Kafka

Mockedstreams ⭐ 182

Scala DSL for Unit-Testing Processing Topologies in Kafka Streams

Spark Kafka Writer ⭐ 177

Write your Spark data to Kafka seamlessly

Spark Streaming With Kafka ⭐ 161

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

Kafka Rx ⭐ 160

reactive kafka client

Aliyun Emapreduce Datasources ⭐ 157

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Bigdata Playground ⭐ 154

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Kafka Example In Scala ⭐ 145

a kafka producer and consumer example in scala and java

Eel Sdk ⭐ 140

Big Data Toolkit for the JVM

Spark Kafka ⭐ 136

Low level integration of Spark and Kafka

Logvision ⭐ 136

分布式实时日志分析与入侵检测系统

Kafka Serialization ⭐ 121

Lego bricks to build Apache Kafka serializers and deserializers

Example Spark Kafka ⭐ 118

Apache Spark and Apache Kafka integration example

Spark Atlas Connector ⭐ 112

A Spark Atlas connector to track data lineage in Apache Atlas

Embedded Kafka Schema Registry ⭐ 106

A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.

Kafka Connect Sap ⭐ 101

Kafka Connect SAP is a set of connectors, using the Apache Kafka Connect framework for reliably connecting Kafka with SAP systems

Learning Spark ⭐ 94

Practical examples of using Apache Spark in several different use cases

Blog Spark Streaming Log Aggregation ⭐ 91

Example of use of Spark Streaming with Kafka

Kafkastreams4s ⭐ 90

Kafka Streams for Scala. Integrates KafkaStreams with the cats-effect ecosystem

A distributed fake data generator based in Akka.

Qstreaming ⭐ 89

A simplified, lightweight ETL pipeline framework for build stream/batch processing applications on top of Apache Spark

Reactive Kafka Microservice Template ⭐ 84

An example of a microservice template which uses akka/reactive-kafka to stream JSON messages

A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.

Kafka Connect Twitter ⭐ 75

Kafka Connect Sink/Source for Twitter

Kafka Connect Cassandra ⭐ 75

Kafka Connect Cassandra Connector. This project includes source/sink connectors for Cassandra to/from Kafka.

Fs2 Kafka ⭐ 75

Kafka client for functional streams for scala (fs2)

Kafka Streams Query ⭐ 71

Library offering http based query on top of Kafka Streams Interactive Queries

Kafka Streams Workshop ⭐ 71

Jruby Kafka ⭐ 69

Spark Structured Streaming ⭐ 66

Spark structured streaming with Kafka data source and writing to Cassandra

Intro To Akka Streams ⭐ 65

Lambda Arch Spark ⭐ 63

Awesome Gatling ⭐ 62

A collection of resources covering different aspects of Gatling load testing tool usage.

Ksql Jdbc Driver ⭐ 59

JDBC driver for Apache Kafka

Gatling Kafka ⭐ 59

A Gatling stress test plugin for Apache Kafka protocol

Experiments in Streaming

Busfloatingdata ⭐ 59

Showcase for IoT Platform Blog

Recommendmoteur ⭐ 57

电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎

Gatling Kafka Plugin ⭐ 56

Plugin for support Kafka in Gatling

Model Serving Tutorial ⭐ 53

Code and presentation for Strata Model Serving tutorial

Spark Cep ⭐ 51

Spark CEP is an extension of Spark Streaming to support SQL-based query processing

A high-throughput, distributed, publish-subscribe messaging system

Today I Learned

Kafka Http ⭐ 51

Kafka http endpoint

Scala Api Template ⭐ 50

Example Scala API to bootstrap new projects

Sparkonkudu ⭐ 48

Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.

Kafka Streams Scala ⭐ 46

Thin Scala wrapper for the Kafka Streams API

Conduktor Coding Challenge ⭐ 46

Want to work with us? Here is a mini-coding challenge you can try :)

Flink Explore ⭐ 46

基于canal/kafka conenct的mysql/oracle数据实时同步、flink rest api、flink sql以及udf

Cloudbowl Microservice Game ⭐ 45

Fdp Modelserver ⭐ 45

An umbrella project for multiple implementations of model serving

Twitterstream ⭐ 45

Twitter Streaming API Example with Kafka Streams in Scala

Awesome Recommendation Engine ⭐ 43

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.

Kafka Offset Monitor Graphite ⭐ 43

Graphite reporter for Kafka Offset Monitor.

Kafka Scala Examples ⭐ 42

Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala

Hyperdrive ⭐ 41

Extensible streaming ingestion pipeline on top of Apache Spark

Hello Play Kafka ⭐ 41

Kafka_training ⭐ 41

Basic getting started with Kafka examples

Etl Light ⭐ 38

A light Kafka to HDFS/S3 ETL library based on Apache Spark

Rmlstreamer ⭐ 38

The RMLStreamer executes RML rules to generate high quality Linked Data from multiple originally (semi-)structured data sources in a streaming way.

Xxhadoop ⭐ 37

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Real Time Stream Processing Engine ⭐ 37

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Spark Kafka 0 8 Sql ⭐ 36

Spark Structured Streaming Kafka 0.8 Source Implementation

Litemall Dw ⭐ 36

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；

Toketi Kafka Connect Iothub ⭐ 35

Kafka Connect IoT Hub is a Kafka source connector for pumping data from Azure IoT Hub to Kafka.

Related Searches

Scala Sbt (4,178)

Scala Spark (3,279)

Java Kafka (3,237)

Scala Akka (2,120)

Java Scala (1,794)

Scala Play Framework (1,309)

Kafka Zookeeper (1,229)

Docker Kafka (1,191)

Python Kafka (1,133)

Plugin Scala (1,079)

1-100 of 313 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2025 Awesome Open Source. All rights reserved.