Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 8 Deduplication Duplicate Detection Open Source Projects

Open source projects categorized as Deduplication Duplicate Detection
Categories > Data Processing > Deduplication
Categories > Duplicate Detection
Duplicut ⭐ 578
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
most recent commit 2 years ago
Deduplicator ⭐ 225
Filter, Sort & Delete Duplicate Files Recursively
total releases 17most recent commit 5 months ago
Py Image Dedup ⭐ 125
CLI utility to find near duplicate images and remove all but the best copy.
total releases 2most recent commit 4 months ago
Yadf ⭐ 39
Yet Another Dupes Finder
total releases 39most recent commit a year ago
Dude ⭐ 33
Duplicates Detector is a cross-platform GUI utility for finding duplicate files, allowing you to delete or link them to save space. Duplicate files are displayed and processed on two synchronized panels for efficient and convenient operation.
most recent commit 3 months ago
Er Evaluation ⭐ 18
An End-to-End Evaluation Framework for Entity Resolution Systems
most recent commit 5 months ago
Dedupe ⭐ 13
Java DSL for (online) deduplication
dependent packages 1total releases 7most recent commit 3 years ago
Dugu ⭐ 13
Find, remove and avoid duplicates with dugu: The Duplicates Guru
most recent commit 4 months ago
The 4 Latest Releases In Deduplication Duplicate Detection Open Source Projects
Deduplicator ⭐ 225
Filter, Sort & Delete Duplicate Files Recursively
total releases 17latest release November 14, 2023most recent commit 5 months ago
Yadf ⭐ 39
Yet Another Dupes Finder
total releases 39latest release February 13, 2023most recent commit a year ago
Dedupe ⭐ 13
Java DSL for (online) deduplication
dependent packages 1total releases 7latest release September 28, 2021most recent commit 3 years ago
Py Image Dedup ⭐ 125
CLI utility to find near duplicate images and remove all but the best copy.
total releases 2latest release December 07, 2020most recent commit 4 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.