Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Scala Kafka Avro Open Source Projects

Open source projects categorized as Scala Kafka Avro
Kafka Storm Starter ⭐ 729
[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
most recent commit 2 years ago
Mypipe ⭐ 390
MySQL binary log consumer with the ability to act on changed rows and publish changes to different systems with emphasis on Apache Kafka.
most recent commit 8 years ago
Abris ⭐ 215
Avro SerDe for Apache Spark structured APIs.
dependent packages 5total releases 17most recent commit 8 months ago
Trifecta ⭐ 211
Trifecta is a web-based and CLI tool that simplifies inspecting Kafka messages and Zookeeper data. Additionally, the CLI tool provides the capability to import/export data to/from ElasticSearch and MongoDB.
most recent commit 5 years ago
Bigdata Playground ⭐ 154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
most recent commit 5 years ago
Eel Sdk ⭐ 140
Big Data Toolkit for the JVM
dependent packages 17total releases 103most recent commit 3 years ago
Kafka Serialization ⭐ 121
Lego bricks to build Apache Kafka serializers and deserializers
most recent commit 7 months ago
Kafka Connect Twitter ⭐ 75
Kafka Connect Sink/Source for Twitter
most recent commit 5 years ago
Spark Structured Streaming ⭐ 66
Spark structured streaming with Kafka data source and writing to Cassandra
most recent commit 4 years ago
Kafka Serde Scala ⭐ 56
Implicitly converts typeclass encoders to kafka Serializer, Deserializer, Serde.
total releases 16most recent commit 4 months ago
Kafka Scala Examples ⭐ 42
Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala
most recent commit 2 years ago
Tamer ⭐ 41
Standalone alternatives to Kafka Connect Connectors
total releases 24most recent commit 3 months ago
Etl Light ⭐ 38
A light Kafka to HDFS/S3 ETL library based on Apache Spark
most recent commit 7 years ago
Kafka Message Scheduler ⭐ 32
Scheduler for low-frequency and long-term scheduling of delayed messages to Kafka topics.
most recent commit 3 months ago
Affinity ⭐ 24
Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka
dependent packages 29total releases 57most recent commit 4 years ago
Scala Kafka Twitter ⭐ 23
Example integration of Kafka, Avro & Spark-Streaming on live Twitter feed
most recent commit 9 years ago
Dendrites ⭐ 20
Scala library for Reactive streaming Microservices, CQRS, Event Sourcing, Event Logging, & message-driven apps.
total releases 3most recent commit 6 years ago
Spark Kafka Avro ⭐ 17
POC: Spark consumer for bottledwater-pg Kafka Avro topics
most recent commit 4 years ago
Spark Streaming Kafka Example ⭐ 11
An example project using Spark Streaming with Kafka message and Avro serialization
most recent commit 9 years ago
Confluent Platform Spark Streaming ⭐ 10
Working example of consuming Avro data from Kafka with Spark Streaming
most recent commit 8 years ago
Datagen ⭐ 10
A small project to allow publishing data to Apache Kafka, Apache Pulsar or any other target system
most recent commit 4 years ago
Zio Kafka Streams ⭐ 10
Kafka Streams for Scala with ZIO
most recent commit 3 years ago
Avro4s Schema Registry Kafka Streams Demo ⭐ 7
Demo application for Avro4s/Schema Registry/Kafka Streams integration
most recent commit 7 years ago
The 4 Most Depended On Scala Kafka Avro Open Source Projects
Affinity ⭐ 24
Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka
dependent packages 29total releases 57latest release June 09, 2021most recent commit 4 years ago
Eel Sdk ⭐ 140
Big Data Toolkit for the JVM
dependent packages 17total releases 103latest release February 11, 2019most recent commit 3 years ago
Abris ⭐ 215
Avro SerDe for Apache Spark structured APIs.
dependent packages 5total releases 17latest release October 06, 2020most recent commit 8 months ago
Schemakeeper ⭐ 6
Schemakeeper - yet another schema registry for Avro, Thrift and Protobuf schemas
dependent packages 3total releases 3latest release August 01, 2021most recent commit 2 years ago
The 7 Latest Releases In Scala Kafka Avro Open Source Projects
Kafka Serde Scala ⭐ 56
Implicitly converts typeclass encoders to kafka Serializer, Deserializer, Serde.
total releases 16latest release November 01, 2023most recent commit 4 months ago
Tamer ⭐ 41
Standalone alternatives to Kafka Connect Connectors
total releases 24latest release November 10, 2022most recent commit 3 months ago
Schemakeeper ⭐ 6
Schemakeeper - yet another schema registry for Avro, Thrift and Protobuf schemas
dependent packages 3total releases 3latest release August 01, 2021most recent commit 2 years ago
Affinity ⭐ 24
Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka
dependent packages 29total releases 57latest release June 09, 2021most recent commit 4 years ago
Abris ⭐ 215
Avro SerDe for Apache Spark structured APIs.
dependent packages 5total releases 17latest release October 06, 2020most recent commit 8 months ago
Eel Sdk ⭐ 140
Big Data Toolkit for the JVM
dependent packages 17total releases 103latest release February 11, 2019most recent commit 3 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.