Awesome Open Source

Programming Languages

Search results for scala kafka

381 search results found

Kafka ⭐ 26,687

Mirror of Apache Kafka

Bigdata Notes ⭐ 14,872

大数据入门指南 ⭐

Cmak ⭐ 11,670

CMAK is a tool for managing Apache Kafka clusters

Bigdataguide ⭐ 2,355

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Kafka Streams Examples ⭐ 2,248

Demo applications and code examples for Apache Kafka's Streams API.

Szt Bigdata ⭐ 2,055

深圳地铁大数据客流分析系统🚇🚄🌟

Movie_recommend ⭐ 1,441

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

Alpakka Kafka ⭐ 1,418

Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

Filodb ⭐ 1,409

Distributed Prometheus time series database

Geomesa ⭐ 1,355

GeoMesa is a suite of tools for working with big geo-spatial data in a distributed fashion.

Alpakka ⭐ 1,259

Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

Killrweather ⭐ 1,174

KillrWeather is a reference application (work in progress) showing how to easily integrate streaming and batch data processing with Apache Spark Streaming, Apache Cassandra, Apache Kafka and Akka for fast, streaming computations on time series data in asynchronous event-driven environments.

Stream Reactor ⭐ 960

A collection of open source Apache 2.0 Kafka Connector maintained by Lenses.io.

Mirror of Apache Samza

Kafka Storm Starter ⭐ 729

[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Pkpmspark ⭐ 697

awesome 三维数据挖掘数据分析 & 推荐

Freestyle ⭐ 615

A cohesive & pragmatic framework of FP centric Scala libraries

Nussknacker ⭐ 564

Low-code tool for automating actions on real time data | Stream processing for the users.

Real Time Analytics and Data Pipelines based on Spark Streaming

Greyhound ⭐ 471

Greyhound - Rich Kafka client library

Apache Kafka on Apache Mesos

MySQL binary log consumer with the ability to act on changed rows and publish changes to different systems with emphasis on Apache Kafka.

Learndoc ⭐ 370

🔥🚀架构师的成长之路-博客-导图

Flink Local Train ⭐ 366

flink入门到项目实践

Scala Kafka Client ⭐ 354

Scala helper modules for operating the Apache Kafka client library (0.9.x - 2.1.0)

Embedded Kafka ⭐ 352

A library that provides an in-memory Kafka instance to run your tests against.

Zio Kafka ⭐ 322

A Kafka client for ZIO and ZIO Streams

Kafka-based message queue

Every Single Day I Tldr ⭐ 311

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Scalatest Embedded Kafka ⭐ 290

A library that provides an in-memory Kafka instance to run your tests against.

Sparkstreaming ⭐ 253

Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志

Kafka Exactly Once ⭐ 245

Apache Kafka Poc And Notes ⭐ 232

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Azure Event Hubs Spark ⭐ 225

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Flink Notes ⭐ 223

flink学习笔记

Avro SerDe for Apache Spark structured APIs.

Trifecta ⭐ 211

Trifecta is a web-based and CLI tool that simplifies inspecting Kafka messages and Zookeeper data. Additionally, the CLI tool provides the capability to import/export data to/from ElasticSearch and MongoDB.

Akka Persistence Kafka ⭐ 206

A replicated Akka Persistence journal backed by Apache Kafka

Akka Kafka ⭐ 193

Kafka consumer lag-checking application for monitoring, written in Scala and Akka HTTP; a wrap around the Kafka consumer group command. Integrations with Cloudwatch and Datadog. Authentication recently added

Kafka With Akka Streams Kafka Streams Tutorial ⭐ 191

Code samples for the Lightbend tutorial on writing microservices with Akka Streams, Kafka Streams, and Kafka

Kafka Streams Scala ⭐ 191

Thin Scala wrapper around Kafka Streams Java API

Mockedstreams ⭐ 182

Scala DSL for Unit-Testing Processing Topologies in Kafka Streams

Spark Kafka Writer ⭐ 177

Write your Spark data to Kafka seamlessly

Spark Streaming With Kafka ⭐ 161

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

Kafka Rx ⭐ 160

reactive kafka client

Aliyun Emapreduce Datasources ⭐ 157

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Bigdata Playground ⭐ 154

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Spark Structured Streaming Examples ⭐ 153

Spark Structured Streaming / Kafka / Cassandra / Elastic

Kafka Example In Scala ⭐ 145

a kafka producer and consumer example in scala and java

Eel Sdk ⭐ 140

Big Data Toolkit for the JVM

Logvision ⭐ 136

分布式实时日志分析与入侵检测系统

Spark Kafka ⭐ 136

Low level integration of Spark and Kafka

Monix Kafka ⭐ 122

Monix integration with Kafka

Kafka Serialization ⭐ 121

Lego bricks to build Apache Kafka serializers and deserializers

Example Spark Kafka ⭐ 118

Apache Spark and Apache Kafka integration example

Spark Atlas Connector ⭐ 112

A Spark Atlas connector to track data lineage in Apache Atlas

Yelper_recommendation_system ⭐ 108

Yelper recommendation system

Kafka Journal ⭐ 106

Event sourcing journal implementation using Kafka as main storage

Embedded Kafka Schema Registry ⭐ 106

A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.

Kafka Connect Sap ⭐ 101

Kafka Connect SAP is a set of connectors, using the Apache Kafka Connect framework for reliably connecting Kafka with SAP systems

Samza Hello Samza ⭐ 99

Mirror of Apache Samza

Learning Spark ⭐ 94

Practical examples of using Apache Spark in several different use cases

Blog Spark Streaming Log Aggregation ⭐ 91

Example of use of Spark Streaming with Kafka

Kukulcan ⭐ 91

A REPL for Apache Kafka

Kafkastreams4s ⭐ 90

Kafka Streams for Scala. Integrates KafkaStreams with the cats-effect ecosystem

A distributed fake data generator based in Akka.

Qstreaming ⭐ 89

A simplified, lightweight ETL pipeline framework for build stream/batch processing applications on top of Apache Spark

Functional programming with Kafka and Scala

Reactive Kafka Microservice Template ⭐ 84

An example of a microservice template which uses akka/reactive-kafka to stream JSON messages

A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.

Kafka Connect Twitter ⭐ 75

Kafka Connect Sink/Source for Twitter

Fs2 Kafka ⭐ 75

Kafka client for functional streams for scala (fs2)

Kafka Connect Cassandra ⭐ 75

Kafka Connect Cassandra Connector. This project includes source/sink connectors for Cassandra to/from Kafka.

Kafka Streams Query ⭐ 71

Library offering http based query on top of Kafka Streams Interactive Queries

Kafka Streams Workshop ⭐ 71

Jruby Kafka ⭐ 69

Spark Structured Streaming ⭐ 66

Spark structured streaming with Kafka data source and writing to Cassandra

User Guide Smack ⭐ 66

[Cloudframeworks]SMACK Big Data Architecture - user guide ／ [云框架]SMACK大数据架构-用户指南

Intro To Akka Streams ⭐ 65

Lambda Arch Spark ⭐ 63

Awesome Gatling ⭐ 62

A collection of resources covering different aspects of Gatling load testing tool usage.

Finagle Kafka ⭐ 61

An Apache Kafka client in Netty and Finagle.

Ksql Jdbc Driver ⭐ 59

JDBC driver for Apache Kafka

Busfloatingdata ⭐ 59

Showcase for IoT Platform Blog

Gatling Kafka ⭐ 59

A Gatling stress test plugin for Apache Kafka protocol

Experiments in Streaming

Opa Kafka Plugin ⭐ 57

Open Policy Agent (OPA) plug-in for Kafka authorization

Recommendmoteur ⭐ 57

电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎

Gatling Kafka Plugin ⭐ 56

Plugin for support Kafka in Gatling

Kafka Serde Scala ⭐ 56

Implicitly converts typeclass encoders to kafka Serializer, Deserializer, Serde.

Model Serving Tutorial ⭐ 53

Code and presentation for Strata Model Serving tutorial

Kafka Http ⭐ 51

Kafka http endpoint

A high-throughput, distributed, publish-subscribe messaging system

Spark Cep ⭐ 51

Spark CEP is an extension of Spark Streaming to support SQL-based query processing

Today I Learned

Scala Api Template ⭐ 50

Example Scala API to bootstrap new projects

Sparkonkudu ⭐ 48

Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.

Related Searches

Scala Sbt (4,178)

Scala Spark (3,279)

Java Kafka (3,237)

Scala Akka (2,120)

Java Scala (1,794)

Scala Play Framework (1,309)

Kafka Zookeeper (1,229)

Docker Kafka (1,191)

Python Kafka (1,133)

Plugin Scala (1,079)

1-100 of 381 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.