Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for java avro
avro
x
java
x
191 search results found
Hudi
⭐
4,901
Upserts, Deletes And Incremental Processing on Big Data.
Avro
⭐
2,691
Apache Avro is a data serialization system.
Parquet Mr
⭐
2,296
Apache Parquet
Schema Registry
⭐
2,092
Confluent Schema Registry for Kafka
Dataflowtemplates
⭐
1,060
Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
Adam
⭐
966
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
Marmaray
⭐
444
Generic Data Ingestion & Dispersal Library for Hadoop
Iceberg
⭐
409
Iceberg is a table format for large, slow-moving tabular data
Avro Rpc Quickstart
⭐
403
Apache Avro RPC Quick Start.
Ml Ease
⭐
326
ADMM based large scale logistic regression
Mongo Kafka
⭐
315
MongoDB Kafka Connector
Gradle Avro Plugin
⭐
309
A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.
Jackson Dataformats Binary
⭐
296
Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile
Kafka Connect File Pulse
⭐
289
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
Divolte Collector
⭐
275
Divolte Collector
Bigdata File Viewer
⭐
269
A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.
Json Wikipedia
⭐
244
Json Wikipedia, contains code to convert the Wikipedia xml dump into a json/avro dump
Rumble
⭐
194
⛈️ RumbleDB 1.21.0 "Hawthorn blossom" 🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more
Dbeam
⭐
179
DBeam exports SQL tables into Avro files using JDBC and Apache Beam
Kafka Avro Course
⭐
176
Learn the Confluent Schema Registry & REST Proxy
Kafka Connect Datagen
⭐
161
Connector that generates data for demos
Kafka Connect Bigquery
⭐
151
DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigq A Kafka Connect BigQuery sink connector
Schema Repo
⭐
150
The Schema Repo is a RESTful web service for storing and serving mappings between schema identifiers and schema definitions.
Kafka Connect Mongodb
⭐
148
**Unofficial / Community** Kafka Connect MongoDB Sink Connector -> integrated 2019 into the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
Avro Hadoop Starter
⭐
111
Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.
Aws Glue Schema Registry
⭐
109
AWS Glue Schema Registry Client library provides serializers / de-serializers for applications to integrate with AWS Glue Schema Registry Service. The library currently supports Avro, JSON and Protobuf data formats. See https://docs.aws.amazon.com/glue/latest/dg/schema- to get started.
Confluent Kafka Certification
⭐
108
This repos is to keep all the relevant informations for Confluent Certified Developer for Apache Kafka (CCDAK)
Json Schema Avro
⭐
99
Avro to JSON Schema, and back
Camus
⭐
87
Mirror of Linkedin's Camus
Fluent Kafka Streams Tests
⭐
86
Fluent Kafka Streams Test with Java
Wrangler
⭐
83
Wrangler Transform: A DMD system for transforming Big Data
Springboot Kafka Connect Jdbc Streams
⭐
82
Project goal: Explore Kafka, Kafka Connect, and Kafka Streams. Components: store-api: Inserts/updates MySQL records. Source Connectors: Monitor MySQL changes, push messages to Kafka. Sink Connectors: Listen to Kafka, insert/update Elasticsearch docs. store-streams: Listens to Kafka, processes with Kafka Streams, pushes new messages to Kafka.
Hdfs2cass
⭐
75
Hadoop mapreduce job to bulk load data into Cassandra
Havrobase
⭐
75
Use Avro to store all your values in HBase instead of regular columns
Storm Graphite
⭐
74
An Apache Storm IMetricsConsumer that forwards Storm's built-in metrics to a Graphite server for real-time graphing, visualization, and operational dashboards.
Avro Util
⭐
69
Collection of utilities to allow writing java code that operates across a wide range of avro versions.
Springboot Kafka Connect Debezium Ksqldb
⭐
65
Experiment with Kafka, Debezium, and ksqlDB. research-service: Performs MySQL record manipulation. Source Connectors: Monitor MySQL changes, push messages to Kafka. Sink Connectors and kafka-research-consumer: Listen to Kafka, insert/update Elasticsearch. ksqlDB-Server: Listens to Kafka, performs joins, and pushes new messages to new Kafka topics.
Haivvreo
⭐
59
Hive + Avro. Serde for working with Avro in Hive
Ecommerce App
⭐
59
eCommerce application is a platform where customers can find products, shop around using a cart, check out the products and initiate payments. It is used for the didactic purpose only, as a support project for my training at https://www.ionutbalosin.com/training
Xml Avro
⭐
58
Generate Avro schema and Avro binary from XSD schema and XML
Kadmin
⭐
58
Web Based Kafka Consumer and Producer
Avro Kafka Storm
⭐
57
Avro Kafka and Strom integration
Kafka Connect Elasticsearch Source
⭐
55
Kafka Connect Elasticsearch Source
Tablasco
⭐
52
Tablasco is a JUnit rule for comparing tables and Spark module for comparing large data sets
Spark Compaction
⭐
52
File compaction tool that runs on top of the Spark framework.
Kafka Connect Rest
⭐
48
Kafka Connect REST connector
Kotlin Kafka And Kafka Streams Examples
⭐
46
Kafka with KafkaReactor and Kafka Streams Examples in Kotlin
Java 11 Examples
⭐
46
JDK 11 examples and demo projects.
Kafka Connect Cosmosdb
⭐
43
Kafka Connect connectors for Azure Cosmos DB
Avro Schema Generator
⭐
43
Library for generating avro schema files (.avsc) based on DB tables structure
Intellij Avro Parquet Plugin
⭐
40
A Tool Window plugin for IntelliJ that displays Avro and Parquet files and their schemas in JSON.
Kafka Spark Hbase Example
⭐
39
Schema Evolution Samples
⭐
39
Samples for different schema evolution options
Kafka Examples
⭐
39
Practical examples with Apache Kafka®
Kafka Sink Azure Kusto
⭐
39
Kafka sink for Kusto
Gameanalytics
⭐
39
A fully-managed pipeline for game analytics
Spring Advanced Marhshallers And Service Exporters
⭐
38
a repository to explore some alternative service exporters and marshallers for use in Spring
Pipelines
⭐
37
Pipelines for data processing (GBIF and LivingAtlases)
Avro Fastserde
⭐
35
Fast Apache Avro serialization/deserialization library
Avro Schema Generator
⭐
34
Tool which generates Avro schemas and Java bindings from XML schemas.
Avro Maven Plugin
⭐
34
Maven 2 Plugin for processing Apache Avro files. Avro is a subproject of Apache Hadoop.
Registryless Avro Converter
⭐
33
An avro converter for Kafka Connect without a Schema Registry
Kafka Connect Hbase
⭐
33
Kafka Connect to Hbase
Avro2parquet
⭐
33
Hadoop MapReduce tool to convert Avro data files to Parquet format.
Arvo2parquet
⭐
30
Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.
Colossal Pipe
⭐
30
The Colossal Pipe framework for map/reduce processing.
Avro Json
⭐
29
Utilities for converting to and from JSON from Avro records via Hadoop streaming or Hive.
Kafka Tool Avro
⭐
27
Avro plugin for Kafka Tool
Flink Perf
⭐
27
Flink performance tests
Parquet Flinktacular
⭐
26
How to use Parquet in Flink
Avro Utils
⭐
26
Utilities to use Avro files from Hadoop Map/Reduce jobs and Streaming
Crunch Lib
⭐
26
Useful reusable pipeline components for Crunch jobs
Iow Hadoop Streaming
⭐
26
Set of hadoop input/output formats for use in combination with hadoop streaming
Kafka Questdb Connector
⭐
26
QuestDB connector for Kafka
Spring Schema Registry
⭐
26
The purpose of this module is to solve the problem of multiple keystores using Spring Boot + Kafka + Schema Registry + SSL and Spring Schema Resgistry Test
Rpc_reactive
⭐
25
Examples and explanations of how RPC systems works.
Osky Sample
⭐
25
OpenSky sample data
Json To Avro Schema Generator
⭐
25
This will help you to generate AVRO schema from JSON schema.
Kafka To Avro Writer
⭐
25
Kafka to Avro Writer based on Apache Beam. It's a generic solution that reads data from multiple kafka topics and stores it on in cloud storage in Avro format.
Spring Kafka Event Sourcing Sampler
⭐
24
Showcases how to build a small Event-sourced application using Spring Boot, Spring Kafka, Apache Avro and Apache Kafka
Spring Cloud Stream Event Sourcing Testcontainers
⭐
24
Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an event informing this change is sent to Kafka. Also, we will implement another application that listens to those events and saves them in Cassandra. Finally, we will use Testcontainers for end-to-end testing.
Pulsar Io Kafka
⭐
24
Pulsar IO Kafka Connector
Json Schema Validator Demo
⭐
24
Webapp demonstrating JSON Schema validation hosted on Heroku
Rust Avro
⭐
23
An implementation of Avro for Rust.
Hbase Tohdfs
⭐
23
Reads a HBase table and writes the out as Text, Seq, Avro, or Parquet
Kafka Avro Without Registry
⭐
22
Test Spring Kafka application (using Avro as a serialization mechanism) without the need for Confluent Schema Registry
Beadledom
⭐
22
A simple, composable framework for building RESTful services
Workflowgs
⭐
20
Archive and manage your Sony RAW images
Dataflowtemplates
⭐
20
Convenient Dataflow pipelines for transforming data between cloud data sources
Vulcan
⭐
20
Asynchronous, high-throughput Avro writer in Java
Avroschemaregistryconverttoesmapping
⭐
20
AvroSchemaRegistryConvertToESMapping
Sparkonalog
⭐
19
Examples of Integrating Spark Streaming, Flume, and HBase to solve Streaming problems
Spark
⭐
18
SPARQL client API and a high-speed protocol implementation
Protobuf To Avro
⭐
18
dynamically parse protobuf message then convert to avro
Ravine
⭐
18
A bridge between synchronous HTTP workload and event-driven landscapes powered by Apache Kafka.
Apicurio Registry Examples
⭐
18
Example applications using the Apicurio Registry.
Avro Json Decoder
⭐
17
JSON decoder for AVRO that infers default values
Avrocount
⭐
15
Count records in Avro files efficiently
Avro Schema Support
⭐
15
IntelliJ plugin for Avro IDL files
Kafka Connect Solr
⭐
15
Kafka connector for Solr Sink
Related Searches
Java Spring (21,350)
Java Plugin (12,518)
Java Spring Boot (11,982)
Java Video Game (8,093)
Java Gradle (8,072)
Java Docker (6,180)
Java Database (6,015)
Java Mysql (5,954)
Java Sdk (5,864)
Javascript Java (5,468)
1-100 of 191 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.