Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Scala Avro Open Source Projects

Open source projects categorized as Scala Avro
Hudi ⭐ 4,901
Upserts, Deletes And Incremental Processing on Big Data.
dependent packages 58total releases 21most recent commit 3 months ago
Adam ⭐ 966
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
dependent packages 17total releases 14most recent commit 3 months ago
Kafka Storm Starter ⭐ 729
[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
most recent commit 2 years ago
Avro4s ⭐ 711
Avro schema generation and serialization / deserialization for Scala
dependent packages 43total releases 41most recent commit 3 months ago
Bijection ⭐ 658
Reversible conversions between types
dependent packages 67total releases 23most recent commit 6 months ago
Sparklearning ⭐ 573
Learning Apache spark,including code and data .Most part can run local.
most recent commit 2 years ago
Spark Avro ⭐ 535
Avro Data Source for Apache Spark
dependent packages 39total releases 8most recent commit 5 years ago
Shc ⭐ 484
The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.
most recent commit 4 years ago
Mypipe ⭐ 390
MySQL binary log consumer with the ability to act on changed rows and publish changes to different systems with emphasis on Apache Kafka.
most recent commit 8 years ago
Ratatool ⭐ 333
A tool for data sampling, data generation, and data diffing
dependent packages 7total releases 36most recent commit 3 months ago
Mu Haskell ⭐ 311
Mu (μ) is a purely functional framework for building micro services.
most recent commit a year ago
Abris ⭐ 215
Avro SerDe for Apache Spark structured APIs.
dependent packages 5total releases 17most recent commit 8 months ago
Trifecta ⭐ 211
Trifecta is a web-based and CLI tool that simplifies inspecting Kafka messages and Zookeeper data. Additionally, the CLI tool provides the capability to import/export data to/from ElasticSearch and MongoDB.
most recent commit 5 years ago
Avrohugger ⭐ 198
Generate Scala case class definitions from Avro schemas
dependent packages 6total releases 60most recent commit 4 months ago
Magnolify ⭐ 155
A collection of Magnolia add-on modules
dependent packages 13total releases 28most recent commit 3 months ago
Bigdata Playground ⭐ 154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
most recent commit 5 years ago
Kebs ⭐ 153
Scala library to eliminate boilerplate
dependent packages 13total releases 2most recent commit 3 months ago
Spark Bigquery ⭐ 149
Google BigQuery support for Spark, SQL, and DataFrames
total releases 6most recent commit 4 years ago
Eel Sdk ⭐ 140
Big Data Toolkit for the JVM
dependent packages 17total releases 103most recent commit 3 years ago
Coulomb ⭐ 139
coulomb: unit analysis for Scala
dependent packages 8total releases 9most recent commit 3 months ago
Sbt Avrohugger ⭐ 129
sbt plugin for generating Scala sources for Apache Avro schemas and protocols.
total releases 10most recent commit 4 months ago
Kafka Serialization ⭐ 121
Lego bricks to build Apache Kafka serializers and deserializers
most recent commit 7 months ago
Scalavro ⭐ 119
A reflection-based Avro library in Scala.
dependent packages 2total releases 6most recent commit 7 years ago
The 10 Most Depended On Scala Avro Open Source Projects
Bijection ⭐ 658
Reversible conversions between types
dependent packages 67total releases 23latest release September 13, 2017most recent commit 6 months ago
Hudi ⭐ 4,901
Upserts, Deletes And Incremental Processing on Big Data.
dependent packages 58total releases 21latest release November 11, 2023most recent commit 3 months ago
Avro4s ⭐ 711
Avro schema generation and serialization / deserialization for Scala
dependent packages 43total releases 41latest release May 19, 2019most recent commit 3 months ago
Spark Avro ⭐ 535
Avro Data Source for Apache Spark
dependent packages 39total releases 8latest release October 30, 2017most recent commit 5 years ago
Affinity ⭐ 24
Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka
dependent packages 29total releases 57latest release June 09, 2021most recent commit 4 years ago
Eel Sdk ⭐ 140
Big Data Toolkit for the JVM
dependent packages 17total releases 103latest release February 11, 2019most recent commit 3 years ago
Magnolify ⭐ 155
A collection of Magnolia add-on modules
dependent packages 13total releases 28latest release October 26, 2023most recent commit 3 months ago
Kebs ⭐ 153
Scala library to eliminate boilerplate
dependent packages 13total releases 2latest release November 13, 2023most recent commit 3 months ago
Shapeless Datatype ⭐ 67
Shapeless utilities for common data types
dependent packages 9total releases 12latest release September 12, 2019most recent commit 3 months ago
The 10 Latest Releases In Scala Avro Open Source Projects
Ratatool ⭐ 333
A tool for data sampling, data generation, and data diffing
dependent packages 7total releases 36latest release November 22, 2023most recent commit 3 months ago
Kebs ⭐ 153
Scala library to eliminate boilerplate
dependent packages 13total releases 2latest release November 13, 2023most recent commit 3 months ago
Hudi ⭐ 4,901
Upserts, Deletes And Incremental Processing on Big Data.
dependent packages 58total releases 21latest release November 11, 2023most recent commit 3 months ago
Sbt Avrohugger ⭐ 129
sbt plugin for generating Scala sources for Apache Avro schemas and protocols.
total releases 10latest release November 01, 2023most recent commit 4 months ago
Kafka Serde Scala ⭐ 56
Implicitly converts typeclass encoders to kafka Serializer, Deserializer, Serde.
total releases 16latest release November 01, 2023most recent commit 4 months ago
Magnolify ⭐ 155
A collection of Magnolia add-on modules
dependent packages 13total releases 28latest release October 26, 2023most recent commit 3 months ago
Coulomb ⭐ 139
coulomb: unit analysis for Scala
dependent packages 8total releases 9latest release September 30, 2023most recent commit 3 months ago
Sbt Avro ⭐ 28
sbt plugin for compiling Avro schemas, similar to sbt-protobuf
total releases 2latest release August 21, 2023most recent commit 3 months ago
Savro ⭐ 9
Some Avro operations in Scala
total releases 12latest release July 27, 2023most recent commit 9 months ago
Tamer ⭐ 41
Standalone alternatives to Kafka Connect Connectors
total releases 24latest release November 10, 2022most recent commit 3 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.