The Top 23 Avro Open Source Projects

Open source projects categorized as Avro

Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.

total releases 9most recent commit 5 months ago

AWS Glue Schema Registry Client library provides serializers / de-serializers for applications to integrate with AWS Glue Schema Registry Service. The library currently supports Avro, JSON and Protobuf data formats. See https://docs.aws.amazon.com/glue/latest/dg/schema- to get started.

dependent packages 7total releases 21most recent commit 3 months ago

Confluent Kafka Certification ⭐ 108

This repos is to keep all the relevant informations for Confluent Certified Developer for Apache Kafka (CCDAK)

most recent commit 7 months ago

Jr ⭐ 104

JR: streaming quality random data from the command line

total releases 21most recent commit 4 months ago

Elastic Git ⭐ 103

Store data in Git, find it in Elasticsearch.

dependent packages 1total releases 36most recent commit 6 years ago

Schema Registry Plugin ⭐ 103

Gradle plugin to interact with Confluent Schema-Registry.

most recent commit 3 months ago

Avro Builder ⭐ 103

Ruby DSL to create Avro schemas

dependent packages 2total releases 26most recent commit 3 months ago

Parser Js ⭐ 101

AsyncAPI parser for Javascript (browser-compatible too).

dependent packages 69total releases 149most recent commit 4 months ago

Json Schema Avro ⭐ 99

Avro to JSON Schema, and back

dependent packages 2total releases 5most recent commit 5 years ago

Kspp ⭐ 97

A high performance/ real-time C++ Kafka streams framework (C++17)

most recent commit 2 years ago

Kaufmann_ex ⭐ 91

Kafka backed service library.

total releases 2most recent commit 7 months ago

Avroconvert ⭐ 90

Rapid Avro serializer for C# .NET

dependent packages 10total releases 67most recent commit 3 months ago

Schemer ⭐ 89

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

total releases 15most recent commit 4 years ago

Avrora ⭐ 87

A convenient Elixir library to work with Avro schemas and Confluent® Schema Registry

dependent packages 2total releases 40most recent commit 4 months ago

Avro Schema Registry ⭐ 87

Implementation of the Confluent Schema Registry API as a Rails application

most recent commit 3 months ago

Camus ⭐ 87

Mirror of Linkedin's Camus

most recent commit 10 months ago

Fluent Kafka Streams Tests ⭐ 86

Fluent Kafka Streams Test with Java

dependent packages 5total releases 33most recent commit 3 months ago

Avromatic ⭐ 84

Generate Ruby models from Avro schemas

dependent packages 1total releases 86most recent commit 3 months ago

Wrangler ⭐ 83

Wrangler Transform: A DMD system for transforming Big Data

dependent packages 4total releases 23most recent commit 3 months ago

Springboot Kafka Connect Jdbc Streams ⭐ 82

Project goal: Explore Kafka, Kafka Connect, and Kafka Streams. Components: store-api: Inserts/updates MySQL records. Source Connectors: Monitor MySQL changes, push messages to Kafka. Sink Connectors: Listen to Kafka, insert/update Elasticsearch docs. store-streams: Listens to Kafka, processes with Kafka Streams, pushes new messages to Kafka.

most recent commit 7 months ago

Avro ⭐ 82

Haskell Avro Encoding and Decoding Native Support (no RPC)

total releases 54most recent commit 5 months ago

Schema_registry_converter ⭐ 82

A crate to convert bytes to something more useable and the other way around in a way Compatible with the Confluent Schema Registry. Supporting Avro, Protobuf, Json schema, and both async and blocking.

dependent packages 2total releases 14most recent commit 5 months ago

cargo schema_registry_converter} Downloads

Messenger Kafka ⭐ 79

Simple Kafka transport for Symfony Messenger.

total releases 17most recent commit 3 months ago

The 10 Most Depended On Avro Open Source Projects

Scalavro ⭐ 119

A reflection-based Avro library in Scala.

dependent packages 2total releases 6latest release December 16, 2013most recent commit 7 years ago

Pub Sub Api Node Client ⭐ 49

A node client for the Salesforce Pub/Sub API

dependent packages 1total releases 15latest release October 07, 2023most recent commit 4 months ago

npm salesforce-pubsub-api-client} Downloads

Elastic Git ⭐ 103

Store data in Git, find it in Elasticsearch.

dependent packages 1total releases 36latest release March 07, 2016most recent commit 6 years ago

Confluent Avro Py ⭐ 18

An Avro SerDe implementation that integrates with the confluent schema registry and serializes and deserializes data according to the defined confluent wire format

dependent packages 1total releases 6latest release May 21, 2020most recent commit 4 years ago

Schema Salad D ⭐ 5

Salad validator library written in D

dependent packages 1total releases 48latest release July 27, 2023most recent commit 8 months ago

Avro Compatibility ⭐ 34

A user friendly API for checking for and reporting on Avro schema incompatibilities.

dependent packages 1total releases 3latest release September 03, 2019most recent commit 4 years ago

Avromatic ⭐ 84

Generate Ruby models from Avro schemas

dependent packages 1total releases 86latest release March 09, 2023most recent commit 3 months ago

Php Kafka Lib ⭐ 48

PHP Kafka producer / consumer library with PHP Avro support, based on php-rdkafka

dependent packages 1total releases 16latest release December 30, 2022most recent commit a year ago

packagist jobcloud/php-kafka-lib} Downloads

Supermodel Cli ⭐ 6

Boring data modeling

dependent packages 1total releases 53latest release October 21, 2018most recent commit 5 years ago

Rec Avro ⭐ 8

Avro schema and data converters supporting storing arbitrary nested python data structures.

dependent packages 1total releases 4latest release April 15, 2019most recent commit 3 years ago

The 10 Latest Releases In Avro Open Source Projects

Javro ⭐ 23

Javro is an interface allowing you to write Avro schemas with ease, to validate it, and to preview it into JSON format with samples.

dependent packages 3total releases 3latest release April 09, 2021most recent commit 3 years ago

Cdt ⭐ 6

Awesome cli for Devs 🚀

dependent packages 2total releases 20latest release March 31, 2021most recent commit 10 months ago

Noproto ⭐ 335

Flexible, Fast & Compact Serialization with RPC

total releases 41latest release March 26, 2021most recent commit a year ago

Darwin ⭐ 22

Avro Schema Evolution made easy

dependent packages 7total releases 15latest release March 16, 2021most recent commit 2 years ago

Libserdes ⭐ 63

Avro Serialization/Deserialization C/C++ library with Confluent schema-registry support

dependent packages 1total releases 1latest release March 03, 2021most recent commit 3 months ago

Kafka Avro ⭐ 79

Node.js bindings for librdkafka with Avro schema serialization.

dependent packages 6total releases 46latest release March 01, 2021most recent commit 3 years ago

Avrohugger ⭐ 198

Generate Scala case class definitions from Avro schemas

dependent packages 6total releases 60latest release February 13, 2021most recent commit 3 months ago

Avro Rs ⭐ 160

Avro client library implementation in Rust

dependent packages 23total releases 24latest release January 29, 2021most recent commit 2 years ago

Avrocado ⭐ 21

Avrocado is a convenience library to handle Avro in Golang

total releases 7latest release December 21, 2020most recent commit 3 years ago

Adam ⭐ 966

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

dependent packages 17total releases 14latest release December 16, 2020most recent commit 3 months ago

Popular Data Processing Categories