Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 17 Java Deduplication Open Source Projects

Open source projects categorized as Java Deduplication
Zingg ⭐ 828
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
total releases 1most recent commit 3 months ago
Duke ⭐ 608
Duke is a fast and flexible deduplication engine written in Java
dependent packages 3total releases 4most recent commit 6 months ago
Sdfs ⭐ 338
Deduplication Based Filesystem
most recent commit a year ago
Elasticsearch Entity Resolution ⭐ 202
Elasticsearch entity resolution plugin based on Duke
most recent commit 7 years ago
Record Linkage Resources ⭐ 82
Resources for tackling record linkage / deduplication / data matching problems
most recent commit 2 years ago
Rocketmqdeduplistener ⭐ 73
RocketMQ消息幂等去重消费者，支持使用MySQL或者Redis做幂等表，开箱即用
most recent commit 3 years ago
Umicollapse ⭐ 44
Accelerating the deduplication and collapsing process for reads with Unique Molecular Identifiers (UMI). Heavily optimized for scalability and orders of magnitude faster than a previous tool.
most recent commit 10 months ago
Dedupe ⭐ 13
Java DSL for (online) deduplication
dependent packages 1total releases 7most recent commit 3 years ago
Duke ⭐ 11
duke deduplication engine mirror
most recent commit 12 years ago
Dedup Estimator ⭐ 11
FS Deduplication/Compression Offline Estimator
most recent commit 3 years ago
Tweet Deduplication ⭐ 10
A stream of deduplicated tweets built using RxJava and Twitter4J
most recent commit 8 years ago
Data Deduplication ⭐ 10
Multiple ways of chunking for data deduplication: Fixed size chunking, Content defined chunking, and File based chunking.
most recent commit 10 years ago
Vertx Sfdc Platformevents ⭐ 8
Salesforce Platform Events Client for vert.x integration
total releases 10most recent commit 5 months ago
Hedera Etl ⭐ 8
ETL scripts for Hedera Hashgraph
most recent commit a year ago
Ratelimit Java ⭐ 7
Rate Limit & Feature Flag Infrastructure as a Service
total releases 5most recent commit 7 years ago
Deduper ⭐ 5
A general purpose deduplication framework
most recent commit 5 years ago
Photo De Duplication ⭐ 5
Using OODT to leverage large scale photo duplication
most recent commit 12 years ago
The 2 Most Depended On Java Deduplication Open Source Projects
Duke ⭐ 608
Duke is a fast and flexible deduplication engine written in Java
dependent packages 3total releases 4latest release February 15, 2014most recent commit 6 months ago
Dedupe ⭐ 13
Java DSL for (online) deduplication
dependent packages 1total releases 7latest release September 28, 2021most recent commit 3 years ago
The 5 Latest Releases In Java Deduplication Open Source Projects
Zingg ⭐ 828
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
total releases 1latest release June 01, 2022most recent commit 3 months ago
Dedupe ⭐ 13
Java DSL for (online) deduplication
dependent packages 1total releases 7latest release September 28, 2021most recent commit 3 years ago
Vertx Sfdc Platformevents ⭐ 8
Salesforce Platform Events Client for vert.x integration
total releases 10latest release November 01, 2018most recent commit 5 months ago
Ratelimit Java ⭐ 7
Rate Limit & Feature Flag Infrastructure as a Service
total releases 5latest release March 06, 2017most recent commit 7 years ago
Duke ⭐ 608
Duke is a fast and flexible deduplication engine written in Java
dependent packages 3total releases 4latest release February 15, 2014most recent commit 6 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.