Awesome Open Source

Programming Languages

The Top 23 Java Avro Open Source Projects

Open source projects categorized as Java Avro

Categories > Data Processing > Avro

Categories > Programming Languages > Java

Upserts, Deletes And Incremental Processing on Big Data.

dependent packages 58total releases 21most recent commit 3 months ago

Apache Avro is a data serialization system.

dependent packages 1,481total releases 151most recent commit 3 months ago

Parquet Mr ⭐ 2,296

dependent packages 208total releases 17most recent commit 3 months ago

Schema Registry ⭐ 2,092

Confluent Schema Registry for Kafka

most recent commit 3 months ago

Dataflowtemplates ⭐ 1,060

Cloud Dataflow Google-provided templates for solving in-Cloud data tasks

most recent commit 3 months ago

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

dependent packages 17total releases 14most recent commit 3 months ago

Marmaray ⭐ 444

Generic Data Ingestion & Dispersal Library for Hadoop

most recent commit 2 years ago

Iceberg ⭐ 409

Iceberg is a table format for large, slow-moving tabular data

most recent commit 3 years ago

Avro Rpc Quickstart ⭐ 403

Apache Avro RPC Quick Start.

most recent commit 7 months ago

Ml Ease ⭐ 326

ADMM based large scale logistic regression

most recent commit 4 years ago

Mongo Kafka ⭐ 315

MongoDB Kafka Connector

dependent packages 3total releases 20most recent commit 3 months ago

Gradle Avro Plugin ⭐ 309

A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.

dependent packages 2total releases 13most recent commit 4 months ago

Jackson Dataformats Binary ⭐ 296

Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile

dependent packages 583total releases 123most recent commit 3 months ago

Kafka Connect File Pulse ⭐ 289

🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka

dependent packages 5total releases 5most recent commit 5 months ago

Divolte Collector ⭐ 275

Divolte Collector

most recent commit 3 years ago

Bigdata File Viewer ⭐ 269

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

most recent commit 6 months ago

Json Wikipedia ⭐ 244

Json Wikipedia, contains code to convert the Wikipedia xml dump into a json/avro dump

most recent commit 2 years ago

⛈️ RumbleDB 1.21.0 "Hawthorn blossom" 🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

total releases 4most recent commit a year ago

DBeam exports SQL tables into Avro files using JDBC and Apache Beam

total releases 41most recent commit 3 months ago

Kafka Avro Course ⭐ 176

Learn the Confluent Schema Registry & REST Proxy

most recent commit 5 months ago

Kafka Connect Datagen ⭐ 161

Connector that generates data for demos

most recent commit 5 months ago

Kafka Connect Bigquery ⭐ 151

DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigq A Kafka Connect BigQuery sink connector

dependent packages 2total releases 18most recent commit 4 years ago

Schema Repo ⭐ 150

The Schema Repo is a RESTful web service for storing and serving mappings between schema identifiers and schema definitions.

dependent packages 3total releases 3most recent commit 4 years ago

The 10 Most Depended On Java Avro Open Source Projects

Apache Avro is a data serialization system.

dependent packages 1,481total releases 151latest release September 17, 2023most recent commit 3 months ago

Jackson Dataformats Binary ⭐ 296

Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile

dependent packages 583total releases 123latest release November 15, 2023most recent commit 3 months ago

Parquet Mr ⭐ 2,296

dependent packages 208total releases 17latest release May 12, 2023most recent commit 3 months ago

Upserts, Deletes And Incremental Processing on Big Data.

dependent packages 58total releases 21latest release November 11, 2023most recent commit 3 months ago

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

dependent packages 17total releases 14latest release December 16, 2020most recent commit 3 months ago

Aws Glue Schema Registry ⭐ 109

AWS Glue Schema Registry Client library provides serializers / de-serializers for applications to integrate with AWS Glue Schema Registry Service. The library currently supports Avro, JSON and Protobuf data formats. See https://docs.aws.amazon.com/glue/latest/dg/schema- to get started.

dependent packages 7total releases 21latest release October 07, 2023most recent commit 3 months ago

Kafka Connect File Pulse ⭐ 289

🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka

dependent packages 5total releases 5latest release July 05, 2023most recent commit 5 months ago

Fluent Kafka Streams Tests ⭐ 86

Fluent Kafka Streams Test with Java

dependent packages 5total releases 33latest release November 10, 2023most recent commit 3 months ago

Wrangler ⭐ 83

Wrangler Transform: A DMD system for transforming Big Data

dependent packages 4total releases 23latest release September 01, 2023most recent commit 3 months ago

Schema Repo ⭐ 150

The Schema Repo is a RESTful web service for storing and serving mappings between schema identifiers and schema definitions.

dependent packages 3total releases 3latest release June 16, 2015most recent commit 4 years ago

The 10 Latest Releases In Java Avro Open Source Projects

Jackson Dataformats Binary ⭐ 296

Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile

dependent packages 583total releases 123latest release November 15, 2023most recent commit 3 months ago

Upserts, Deletes And Incremental Processing on Big Data.

dependent packages 58total releases 21latest release November 11, 2023most recent commit 3 months ago

Fluent Kafka Streams Tests ⭐ 86

Fluent Kafka Streams Test with Java

dependent packages 5total releases 33latest release November 10, 2023most recent commit 3 months ago

Gradle Avro Plugin ⭐ 309

A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.

dependent packages 2total releases 13latest release October 10, 2023most recent commit 4 months ago

Aws Glue Schema Registry ⭐ 109

AWS Glue Schema Registry Client library provides serializers / de-serializers for applications to integrate with AWS Glue Schema Registry Service. The library currently supports Avro, JSON and Protobuf data formats. See https://docs.aws.amazon.com/glue/latest/dg/schema- to get started.

dependent packages 7total releases 21latest release October 07, 2023most recent commit 3 months ago

Apache Avro is a data serialization system.

dependent packages 1,481total releases 151latest release September 17, 2023most recent commit 3 months ago

Wrangler ⭐ 83

Wrangler Transform: A DMD system for transforming Big Data

dependent packages 4total releases 23latest release September 01, 2023most recent commit 3 months ago

Mongo Kafka ⭐ 315

MongoDB Kafka Connector

dependent packages 3total releases 20latest release August 22, 2023most recent commit 3 months ago

DBeam exports SQL tables into Avro files using JDBC and Apache Beam

total releases 41latest release July 31, 2023most recent commit 3 months ago

Kafka Connect File Pulse ⭐ 289

🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka

dependent packages 5total releases 5latest release July 05, 2023most recent commit 5 months ago

Popular Data Processing Categories

Jupyter Notebook

Categories

Application Programming Interfaces

Artificial Intelligence

Cloud Computing

Command Line Interface

Computer Science

Configuration Management

Content Management

Data Processing

Integrated Development Environments

Learning Resources

Lists Of Projects

Machine Learning

Operating Systems

Package Managers

Programming Languages

Runtime Environments

Software Architecture

Software Development

Software Performance

Software Quality

Text Processing

User Interface Components

Version Control

Web User Interface

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.