Awesome Open Source

Programming Languages

Search results for schema avro

334 search results found

Schema Registry ⭐ 1,964

Confluent Schema Registry for Kafka

Avro for JavaScript ⚡️

Avro schema generation and serialization / deserialization for Scala

Marmaray ⭐ 444

Generic Data Ingestion & Dispersal Library for Hadoop

MySQL binary log consumer with the ability to act on changed rows and publish changes to different systems with emphasis on Apache Kafka.

Noproto ⭐ 335

Flexible, Fast & Compact Serialization with RPC

Gogen Avro ⭐ 323

Generate Go code to serialize and deserialize Avro schemas

A fast Go Avro codec

Json Avro Converter ⭐ 237

JSON to Avro conversion tool designed to make migration to Avro easier.

Avro SerDe for Apache Spark structured APIs.

Srclient ⭐ 191

Golang Client for Schema Registry

Avrohugger ⭐ 186

Generate Scala case class definitions from Avro schemas

DBeam exports SQL tables into Avro files using JDBC and Apache Beam

Dataclasses Avroschema ⭐ 168

Generate Avro Schemas from Python classes. Serialize/Deserialize python instances with avro schemas

Avro support for kotlinx.serialization

Avro Rs ⭐ 160

Avro client library implementation in Rust

Kafka Avro Course ⭐ 156

Learn the Confluent Schema Registry & REST Proxy

Kafka Connect Bigquery ⭐ 151

DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigq A Kafka Connect BigQuery sink connector

Schema Repo ⭐ 150

The Schema Repo is a RESTful web service for storing and serving mappings between schema identifiers and schema definitions.

Kafka Connect Mongodb ⭐ 148

**Unofficial / Community** Kafka Connect MongoDB Sink Connector -> integrated 2019 into the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

Avro_turf ⭐ 148

A library that makes it easier to use the Avro serialization format from Ruby.

Kafka Rest Node ⭐ 144

Node.js client for the Kafka REST proxy

☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

Python Schema Registry Client ⭐ 137

Python Rest Client to interact against Schema Registry confluent server

Kafka Serialization ⭐ 124

Lego bricks to build Apache Kafka serializers and deserializers

Confluent Schema Registry ⭐ 122

is a library that makes it easier to interact with the Confluent schema registry

Go Avro ⭐ 122

Apache Avro for Golang

Kafka Connect Datagen ⭐ 121

Connector that generates data for demos

Scalavro ⭐ 119

A reflection-based Avro library in Scala.

Avrodoc ⭐ 119

Documentation tool for Avro schemas

Python Avro Json Serializer ⭐ 118

Serializes data into a JSON format using AVRO schema.

Pandavro ⭐ 117

Apache Avro <-> pandas DataFrame

Schema Registry ⭐ 112

A CLI and Go client for Kafka Schema Registry. This repository is deprecated and no longer maintained.

Avro Hadoop Starter ⭐ 111

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Abracad ⭐ 110

A Clojure library for de/serializing Clojure data structures with Avro.

Elastic Git ⭐ 103

Store data in Git, find it in Elasticsearch.

Json Schema Avro ⭐ 99

Avro to JSON Schema, and back

Avro Builder ⭐ 98

Ruby DSL to create Avro schemas

Dotnet Avro ⭐ 98

An Avro implementation for .NET

Parser Js ⭐ 96

AsyncAPI parser for Javascript (browser-compatible too).

Confluent Kafka Certification ⭐ 92

This repos is to keep all the relevant informations for Confluent Certified Developer for Apache Kafka (CCDAK)

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

Aws Glue Schema Registry ⭐ 88

AWS Glue Schema Registry Client library provides serializers / de-serializers for applications to integrate with AWS Glue Schema Registry Service. The library currently supports Avro, JSON and Protobuf data formats. See https://docs.aws.amazon.com/glue/latest/dg/schema- to get started.

Schema Registry Plugin ⭐ 87

Gradle plugin to interact with Confluent Schema-Registry.

Kaufmann_ex ⭐ 86

Kafka backed service library.

Avro Schema Registry ⭐ 85

Implementation of the Confluent Schema Registry API as a Rails application

Xk6 Kafka ⭐ 85

k6 extension to load test Apache Kafka with support for various serialization formats, SASL, TLS, compression, Schema Registry client and beyond

Haskell Avro Encoding and Decoding Native Support (no RPC)

Avromatic ⭐ 79

Generate Ruby models from Avro schemas

Kafka Avro ⭐ 79

Node.js bindings for librdkafka with Avro schema serialization.

A convenient Elixir library to work with Avro schemas and Confluent® Schema Registry

Schema_registry_converter ⭐ 67

A crate to convert bytes to something more useable and the other way around in a way Compatible with the Confluent Schema Registry. Supporting Avro, Protobuf, Json schema, and both async and blocking.

Djangoevents ⭐ 64

Framework for building Kafka and avro based apps in typescript

Faust Docker Compose Example ⭐ 62

Faust dockerized application

Avro Parquet Spark Example ⭐ 61

An example of using Avro and Parquet in Spark SQL

Libserdes ⭐ 60

Avro Serialization/Deserialization C/C++ library with Confluent schema-registry support

An Avro Library that emphasizes testability and ease of use.

Haivvreo ⭐ 59

Hive + Avro. Serde for working with Avro in Hive

Xml Avro ⭐ 58

Generate Avro schema and Avro binary from XSD schema and XML

Avro Scala Macro Annotations ⭐ 57

Compile-time tools for working with Avros in Scala

Insulator ⭐ 56

A client UI to inspect Kafka topics, consume, produce and much more

Avro Schema ⭐ 55

Apache Avro schema tools for Tarantool

Framework to work with Kafka, Avro and ActiveRecord

Json2avro ⭐ 53

Fast JSON to Avro converter

Lancaster ⭐ 53

Apache Avro library for Clojure and ClojureScript

Avro codec and code generation for Go

Avro Serde Php ⭐ 44

Avro Serialisation/Deserialisation (SerDe) library for PHP 7.3+ & 8.0 with a Symfony Serializer integration

Avro Schema Generator ⭐ 43

Library for generating avro schema files (.avsc) based on DB tables structure

Kafka Scala Examples ⭐ 42

Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala

Apache Avro encoder/decoder

Intellij Avro Parquet Plugin ⭐ 40

A Tool Window plugin for IntelliJ that displays Avro and Parquet files and their schemas in JSON.

Schema Registry Php Client ⭐ 40

A PHP 8+ API client for the Confluent Schema Registry REST API based on Guzzle 7 - http://docs.confluent.io/current/schema-registry/d

Schema Evolution Samples ⭐ 39

Samples for different schema evolution options

A protocol on top of CBOR that provides protobuf-like functionality

Schema Registry Transfer Smt ⭐ 38

Kafka Connect Transform to copy Avro schemas between Schema Registries

Bdg Formats ⭐ 38

Open source formats for scalable genomic processing systems using Avro. Apache 2 licensed.

Kafka Connect Cosmosdb ⭐ 35

Kafka Connect connectors for Azure Cosmos DB

Avro Schema Generator ⭐ 34

Tool which generates Avro schemas and Java bindings from XML schemas.

Registryless Avro Converter ⭐ 33

An avro converter for Kafka Connect without a Schema Registry

Kafka Message Scheduler ⭐ 31

Scheduler for low-frequency and long-term scheduling of delayed messages to Kafka topics.

Goavro translates between Go native types and binary and textual Avro data

Xml Avro ⭐ 30

Convert XSD -> AVSC and XML -> AVRO

Columnify ⭐ 29

Make record oriented data to columnar format.

Apache AVRO for go

Avro To Typescript ⭐ 27

Compile Apache Avro schema files to TypeScript classes

Parquet Flinktacular ⭐ 26

How to use Parquet in Flink

Go Kafka Avro ⭐ 26

A library provides consumer/producer to work with kafka, avro and schema registry

Rsgen Avro ⭐ 26

Command line and library for generating Rust types from Avro schemas

Iow Hadoop Streaming ⭐ 26

Set of hadoop input/output formats for use in combination with hadoop streaming

Data_pipeline_avro_util ⭐ 26

Provides a Pythonic interface for reading and writing Avro schemas

Spring Schema Registry ⭐ 26

The purpose of this module is to solve the problem of multiple keystores using Spring Boot + Kafka + Schema Registry + SSL and Spring Schema Resgistry Test

Go Kafka Avro ⭐ 26

Library to work with Apache Kafka using Avro serialization format

Json To Avro Schema Generator ⭐ 25

This will help you to generate AVRO schema from JSON schema.

Avro Schema Parser ⭐ 24

An AsyncAPI schema parser for Avro 1.x schemas.

Avro Schema Registry ⭐ 24

Confluent Schema Registry implementation in javascript to easily serialize and deserialize kafka messages

Avro_validator ⭐ 24

A pure python avro schema validator

Kafkacli ⭐ 24

CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry)

Pulsar Io Kafka ⭐ 24

Pulsar IO Kafka Connector

Related Searches

Javascript Schema (3,675)

Json Schema (2,319)

Python Schema (1,858)

Database Schema (1,615)

Graphql Schema (1,491)

Typescript Schema (1,337)

Java Schema (1,113)

Schema Validation (945)

Php Schema (908)

Types Schema (800)

1-100 of 334 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2023 Awesome Open Source. All rights reserved.