Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for duplicate detection
duplicate-detection
x
47 search results found
Duplicut
⭐
578
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
Depp
⭐
259
⚡ Check your npm modules for unused and duplicate dependencies fast
Videohash
⭐
230
Near Duplicate Video Detection (Perceptual Video Hashing) - Get a 64-bit comparable hash-value for any video.
Deduplicator
⭐
225
Filter, Sort & Delete Duplicate Files Recursively
Panako
⭐
164
The Panako acoustic fingerprinting system.
Py Image Dedup
⭐
125
CLI utility to find near duplicate images and remove all but the best copy.
Ostap
⭐
118
CLI tool that fast checks if your bundle contains multiple versions of the same package, only by looking in package.json.
Fast Near Duplicate Image Search
⭐
101
Fast Near-Duplicate Image Search and Delete using pHash, t-SNE and KDTree.
Siftimagesimilarity
⭐
100
Interactive code for image similarity using SIFT algorithm
Mediadc
⭐
87
Nextcloud Media Duplicate Collector application
Audiomatch
⭐
86
Find similar audio files easily
Deplicate
⭐
76
Advanced Duplicate File Finder for Python
Duplo
⭐
68
Duplicates finder for various source code formats.
Near Duplicate Video Detection
⭐
63
Detecting near-duplicate videos by aggregating features from intermediate CNN layers
Removedupes
⭐
63
Remove Duplicate Messages
Cbird
⭐
49
Command-line program for managing a media collection, with focus on Content-Based Image Retrieval (Computer Vision) methods for finding duplicates.
Bugrepo
⭐
48
A collection of publicly available bug reports
Quick Picto Viewer
⭐
48
A uniquely crafted image viewer and editor with options to organize files, and maintain large lists of image files for slideshows, dupes detection or other purposes.
Apollo
⭐
48
Advanced similarity and duplicate source code proof of concept for our research efforts.
Zoplicate
⭐
43
A plugin that does one thing only: Detect and manage duplicate items in Zotero.
Twly
⭐
39
Wanna get DRY? Static analysis tool for detecting repeat code.
Yadf
⭐
39
Yet Another Dupes Finder
Gemini
⭐
38
Advanced similarity and duplicate source code at scale.
Qthashsum
⭐
38
File Checksum Integrity Verifier & Duplicate File Finder written in C++ Qt
Phpcloc
⭐
33
🚀 Cloc & duplicate code checker tool
Dude
⭐
33
Duplicates Detector is a cross-platform GUI utility for finding duplicate files, allowing you to delete or link them to save space. Duplicate files are displayed and processed on two synchronized panels for efficient and convenient operation.
Snowman
⭐
25
Welcome to Snowman App – a Data Matching Benchmark Platform.
Openstaticanalyzer
⭐
24
OpenStaticAnalyzer is a source code analyzer tool, which can perform deep static analysis of the source code of complex systems.
Demystify
⭐
23
Engine for analysis of Siegfried export files and DROID CSV. The tool has three purposes, break the export into its components and store them within a SQLite database; create additional columns to augment the output where useful; and query the SQLite database, outputting results in a readable form useful for analysis by researchers and archivists within digital preservation departments in memory institutions. The tool will find duplicates, unidentified files, blacklisted objects, character encod
Simages
⭐
19
Find duplicates and similar images in a folder
Vidupe
⭐
19
Vidupe is a program that can find duplicate and similar video files. V1.211 released on 2019-09-18, Windows exe here:
Er Evaluation
⭐
18
An End-to-End Evaluation Framework for Entity Resolution Systems
Ndf
⭐
18
Duplicate file finder written in Nim
Duplicate Finder
⭐
16
This Python packages identifies duplicate files in a folder of interest.
Duplicate Img Detection
⭐
15
A basic duplicate image detection service using perceptual image hash functions and nearest neighbor search, implemented using faiss, fastapi, and imagehash
Dugu
⭐
13
Find, remove and avoid duplicates with dugu: The Duplicates Guru
Dedupe
⭐
13
Java DSL for (online) deduplication
Copydetector
⭐
10
基于springboot和Google开源simhash算法实现的作业查重/抄袭检测/文本相似度分析 Ref: https://github.com/ALuShu/checksystem
Dupe_eraser
⭐
9
A command-line tool which automate the deletion of duplicate files based on their hash or perceptual-hash.
Pycleaner
⭐
8
Securely wipe files or folders and clean duplicated files
Duplicate File Remover
⭐
7
Command line utility to remove exact duplicate files.
Findm
⭐
6
Findm is a python script to find duplicate file copies in a given directory.
Uniqueimages
⭐
6
A node command line tool which can be used to find duplicate images in a directory even if the images differ in resolution, contrast, brightness or color.
Phash Gif
⭐
5
Perceptual GIF hashing for easily finding near-duplicate GIFs.
Dupknock
⭐
5
Python tool to help you knockout duplicate entries from multiple files and generate the final output
Duplihere
⭐
5
Copy & Paste finder for structured text files.
Spacesavers
⭐
5
Optimizing diskspace on Biowulf
1-47 of 47 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.