Awesome Open Source

Programming Languages

Search results for scala kafka

639 search results found

Kafka ⭐ 25,106

Mirror of Apache Kafka

Bigdata Notes ⭐ 13,291

大数据入门指南 ⭐️

Cmak ⭐ 11,384

CMAK is a tool for managing Apache Kafka clusters

Kafka Streams Examples ⭐ 2,165

Demo applications and code examples for Apache Kafka's Streams API.

Bigdataguide ⭐ 2,026

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Szt Bigdata ⭐ 1,702

深圳地铁大数据客流分析系统🚇🚄🌟

Movie_recommend ⭐ 1,441

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

Alpakka Kafka ⭐ 1,405

Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

Filodb ⭐ 1,384

Distributed Prometheus time series database

Geomesa ⭐ 1,313

GeoMesa is a suite of tools for working with big geo-spatial data in a distributed fashion.

Alpakka ⭐ 1,253

Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

Killrweather ⭐ 1,174

KillrWeather is a reference application (work in progress) showing how to easily integrate streaming and batch data processing with Apache Spark Streaming, Apache Cassandra, Apache Kafka and Akka for fast, streaming computations on time series data in asynchronous event-driven environments.

Stream Reactor ⭐ 936

Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.

Mirror of Apache Samza

Kafka Storm Starter ⭐ 729

[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Pkpmspark ⭐ 697

awesome 三维数据挖掘数据分析 & 推荐

Freestyle ⭐ 615

A cohesive & pragmatic framework of FP centric Scala libraries

Kafka Lag Exporter ⭐ 585

Monitor Kafka Consumer Group Latency with Kafka Lag Exporter

Real Time Analytics and Data Pipelines based on Spark Streaming

Greyhound ⭐ 471

Greyhound - Rich Kafka client library

Nussknacker ⭐ 436

A visual tool to define and run real-time decision algorithms.

Apache Kafka on Apache Mesos

MySQL binary log consumer with the ability to act on changed rows and publish changes to different systems with emphasis on Apache Kafka.

Learndoc ⭐ 370

🔥🚀架构师的成长之路-博客-导图

Flink Local Train ⭐ 366

flink入门到项目实践

Scala Kafka Client ⭐ 354

Scala helper modules for operating the Apache Kafka client library (0.9.x - 2.1.0)

Embedded Kafka ⭐ 324

A library that provides an in-memory Kafka instance to run your tests against.

Kafka Security Manager ⭐ 317

Manage your Kafka ACL at scale

Zio Kafka ⭐ 309

A Kafka client for ZIO and ZIO Streams

Kafka-based message queue

Every Single Day I Tldr ⭐ 304

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Scalatest Embedded Kafka ⭐ 290

A library that provides an in-memory Kafka instance to run your tests against.

Sparkstreaming ⭐ 253

Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志

Kafka Exactly Once ⭐ 245

Apache Kafka Poc And Notes ⭐ 232

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Azure Event Hubs Spark ⭐ 225

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Flink Notes ⭐ 223

flink学习笔记

Trifecta ⭐ 211

Trifecta is a web-based and CLI tool that simplifies inspecting Kafka messages and Zookeeper data. Additionally, the CLI tool provides the capability to import/export data to/from ElasticSearch and MongoDB.

Avro SerDe for Apache Spark structured APIs.

Akka Persistence Kafka ⭐ 206

A replicated Akka Persistence journal backed by Apache Kafka

Akka Kafka ⭐ 193

Kafka consumer lag-checking application for monitoring, written in Scala and Akka HTTP; a wrap around the Kafka consumer group command. Integrations with Cloudwatch and Datadog. Authentication recently added

Kafka Streams Scala ⭐ 191

Thin Scala wrapper around Kafka Streams Java API

Kafka With Akka Streams Kafka Streams Tutorial ⭐ 191

Code samples for the Lightbend tutorial on writing microservices with Akka Streams, Kafka Streams, and Kafka

Mockedstreams ⭐ 182

Scala DSL for Unit-Testing Processing Topologies in Kafka Streams

Spark Kafka Writer ⭐ 177

Write your Spark data to Kafka seamlessly

Spark Streaming With Kafka ⭐ 161

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

Kafka Rx ⭐ 160

reactive kafka client

Aliyun Emapreduce Datasources ⭐ 157

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Bigdata Playground ⭐ 154

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Spark Structured Streaming Examples ⭐ 153

Spark Structured Streaming / Kafka / Cassandra / Elastic

Kafka Example In Scala ⭐ 145

a kafka producer and consumer example in scala and java

Eel Sdk ⭐ 140

Big Data Toolkit for the JVM

Spark Kafka ⭐ 136

Low level integration of Spark and Kafka

Logvision ⭐ 136

分布式实时日志分析与入侵检测系统

Kafka Serialization ⭐ 124

Lego bricks to build Apache Kafka serializers and deserializers

Monix Kafka ⭐ 122

Monix integration with Kafka

Example Spark Kafka ⭐ 118

Apache Spark and Apache Kafka integration example

Spark Atlas Connector ⭐ 112

A Spark Atlas connector to track data lineage in Apache Atlas

Yelper_recommendation_system ⭐ 108

Yelper recommendation system

Samza Hello Samza ⭐ 99

Mirror of Apache Samza

Embedded Kafka Schema Registry ⭐ 96

A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.

Kafka Journal ⭐ 94

Event sourcing journal implementation using Kafka as main storage

Learning Spark ⭐ 94

Practical examples of using Apache Spark in several different use cases

Kukulcan ⭐ 91

A REPL for Apache Kafka

Blog Spark Streaming Log Aggregation ⭐ 91

Example of use of Spark Streaming with Kafka

Kafkastreams4s ⭐ 90

Kafka Streams for Scala. Integrates KafkaStreams with the cats-effect ecosystem

Qstreaming ⭐ 89

A simplified, lightweight ETL pipeline framework for build stream/batch processing applications on top of Apache Spark

A distributed fake data generator based in Akka.

Kafka Connect Sap ⭐ 88

Kafka Connect SAP is a set of connectors, using the Apache Kafka Connect framework for reliably connecting Kafka with SAP systems

Reactive Kafka Microservice Template ⭐ 84

An example of a microservice template which uses akka/reactive-kafka to stream JSON messages

A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.

Functional programming with Kafka and Scala

Kafka Connect Cassandra ⭐ 75

Kafka Connect Cassandra Connector. This project includes source/sink connectors for Cassandra to/from Kafka.

Kafka Connect Twitter ⭐ 75

Kafka Connect Sink/Source for Twitter

Fs2 Kafka ⭐ 75

Kafka client for functional streams for scala (fs2)

Kafka Streams Query ⭐ 71

Library offering http based query on top of Kafka Streams Interactive Queries

Kafka Streams Workshop ⭐ 71

Jruby Kafka ⭐ 69

Spark Structured Streaming ⭐ 66

Spark structured streaming with Kafka data source and writing to Cassandra

User Guide Smack ⭐ 66

[Cloudframeworks]SMACK Big Data Architecture - user guide ／ [云框架]SMACK大数据架构-用户指南

Intro To Akka Streams ⭐ 65

Lambda Arch Spark ⭐ 63

Finagle Kafka ⭐ 61

An Apache Kafka client in Netty and Finagle.

Ksql Jdbc Driver ⭐ 59

JDBC driver for Apache Kafka

Busfloatingdata ⭐ 59

Showcase for IoT Platform Blog

Gatling Kafka ⭐ 59

A Gatling stress test plugin for Apache Kafka protocol

Experiments in Streaming

Recommendmoteur ⭐ 57

电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎

Gatling Kafka Plugin ⭐ 56

Plugin for support Kafka in Gatling

Kafka Serde Scala ⭐ 55

Implicitly converts typeclass encoders to kafka Serializer, Deserializer, Serde.

Model Serving Tutorial ⭐ 53

Code and presentation for Strata Model Serving tutorial

Awesome Gatling ⭐ 53

A collection of resources covering different aspects of Gatling load testing tool usage.

Kafka Http ⭐ 51

Kafka http endpoint

Today I Learned

Spark Cep ⭐ 51

Spark CEP is an extension of Spark Streaming to support SQL-based query processing

A high-throughput, distributed, publish-subscribe messaging system

Related Searches

Scala Sbt (4,178)

Scala Spark (3,279)

Java Kafka (3,237)

Scala Akka (2,117)

Java Scala (1,794)

Scala Play Framework (1,309)

Kafka Zookeeper (1,229)

Docker Kafka (1,106)

Python Kafka (1,097)

Plugin Scala (1,080)

1-100 of 639 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2023 Awesome Open Source. All rights reserved.