Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for duplicates
duplicates
x
77 search results found
Czkawka
⭐
13,745
Multi functional app to find duplicates, empty folders, similar images etc.
Jscpd
⭐
3,285
Copy/paste detector for programming source code.
Rmlint
⭐
1,692
Extremely fast tool to remove duplicates and other lint from your filesystem
Yarn Deduplicate
⭐
1,352
Deduplication tool for yarn.lock files
Duplicate Image Finder
⭐
363
difPy - Python package for finding duplicate or similar images within folders
Python Hashes
⭐
221
Interesting (non-cryptographic) hashes implemented in pure Python.
Synt
⭐
180
Find similar functions and classes in your JavaScript/TypeScript code
Dejavu
⭐
153
Quickly detect already witnessed data.
Redux Dataloader
⭐
138
Loads async data for Redux apps focusing on preventing duplicated requests and dealing with async dependencies.
Django Clone
⭐
108
Controlled Django model instance replication.
Mongoose Beautiful Unique Validation
⭐
107
Plugin for Mongoose that turns duplicate errors into regular Mongoose validation errors
Asynckeyedlock
⭐
104
An asynchronous .NET Standard 2.0 library that allows you to lock based on a key (keyed semaphores), limiting concurrent threads sharing the same key to a specified number, with optional pooling for reducing memory allocations.
Dupd
⭐
96
CLI utility to find duplicate files
Mediadc
⭐
87
Nextcloud Media Duplicate Collector application
Near Duplicate Code Detector
⭐
78
A simple tool for detecting near-duplicate source code
Deplicate
⭐
76
Advanced Duplicate File Finder for Python
Backdown
⭐
70
A deduplicator
Removedupes
⭐
63
Remove Duplicate Messages
Mergician
⭐
53
Uniquely flexible and light-weight utility for cloning and deep (recursive) merging of JavaScript objects. Supports descriptor values, accessor functions, and custom prototypes. Provides advanced options for customizing the clone/merge process.
Es Dedupe
⭐
51
Tool for removing duplicate documents from Elasticsearch
Cbird
⭐
49
Command-line program for managing a media collection, with focus on Content-Based Image Retrieval (Computer Vision) methods for finding duplicates.
Katalog
⭐
48
Katalog is an application to manage catalogs of disks and files to search and get statistics.
Apollo
⭐
48
Advanced similarity and duplicate source code proof of concept for our research efforts.
Ember Data Copyable
⭐
44
Intelligently copy an Ember Data model and all of its relationships
Uniquify
⭐
44
Uniquify is a Telegram bot interface used to remove duplicate media files from a chat
Gemini
⭐
38
Advanced similarity and duplicate source code at scale.
Akin
⭐
36
Rust crate for writing repetitive code easier and faster.
Dude
⭐
33
Duplicates Detector is a cross-platform GUI utility for finding duplicate files, allowing you to delete or link them to save space. Duplicate files are displayed and processed on two synchronized panels for efficient and convenient operation.
Potential Duplicates Bot
⭐
31
A configurable GitHub App which checks for potential issue duplicates using Damerau–Levenshtein distance algorithm.
Ts Clone Node
⭐
30
A library that helps you clone Nodes from a Typescript AST
Gduplicate Finder
⭐
29
GDuplicate Finder - A Groovy way to find duplicates among your computer and network shares!
Duplicator
⭐
26
🧬 Duplicator for ProcessWire. Duplicate, backup and transfer an entire site from one location to another
Android Gradle Plugin Transform Patch
⭐
25
android gradle plugin transform patch
Image Ndd Lsh
⭐
24
Near-duplicate image detection using Locality Sensitive Hashing
Dups
⭐
23
A CLI tool to find/remove duplicate files supporting multi-core and different algorithms (MD5, SHA256, and XXHash).
Vscode Dup Checker
⭐
22
vscode extension to check and dedup duplicate lines
Appendfeaturestolayer
⭐
21
Processing plugin-based provider for QGIS 3 that adds an algorithm for appending/updating features from a source vector layer to an existing target vector layer.
Finddups
⭐
20
Find duplicate files on your computer
Vidupe
⭐
19
Vidupe is a program that can find duplicate and similar video files. V1.211 released on 2019-09-18, Windows exe here:
Duplicatecontactsremover
⭐
19
📒 A simple app to optimize your address book and remove duplicate contacts.
Ndf
⭐
18
Duplicate file finder written in Nim
Funique
⭐
18
⌚️ A faster unique() function
Url Rewrites
⭐
16
Magento 1.x module to target the URL Rewrite issue
Nodups
⭐
14
No dups, no doubts
Indexed String Variation
⭐
13
Experimental JavaScript module to generate all possible variations of strings over an alphabet using an n-ary virtual tree
Dugu
⭐
13
Find, remove and avoid duplicates with dugu: The Duplicates Guru
Bitwarden_find_duplicates
⭐
13
Find duplicate logins based on domain, from bitwarden export. Open source for your safety.
Issue Parser
⭐
12
Parser for Github, GitLab and Bitbucket issues actions, references and mentions
Add Filename Increment
⭐
12
When copying or moving files, it's common for operating systems to automatically add an increment or 'copy' to duplicate file names. This does that for Node.js applications, with automatic platform detection and support for Linux, MacOs, and Windows conventions.
Fsimilar
⭐
12
find/file similar
Duplikaatti
⭐
10
Remove duplicate files.
Dfm
⭐
10
Duplicate File Manager
Stackoverflownotes
⭐
9
SO [r] tag list of dupes, help, links, etc.
Go File Copies
⭐
9
A Go program to get duplicates from specified paths.
Compare Anything
⭐
9
Compares objects and tells you which props are duplicate, and props are only present once.
Dupe_eraser
⭐
9
A command-line tool which automate the deletion of duplicate files based on their hash or perceptual-hash.
Strip Filename Increment
⭐
8
Operating systems commonly add a trailing increment, or the word 'copy', or something similar to duplicate files. This strips those increments. Tested on Windows, MacOS, and Linux.
Stringsduplicates
⭐
8
This is a very simple command line program to find duplicate string labels in .strings files.
Prowide Integrator Examples
⭐
8
Source code examples for "Prowide Integrator"
Dump Deps
⭐
8
Dump NPM package dependencies to display packages with multiple versions.
Lastfm Smart Deduper
⭐
7
JS script that allows you to remove duplicates from your Last.fm scrobbles library.
Duplicatesequence.gml
⭐
7
Make a deep copy of GameMaker sequence asset / struct for editing it in-runtime
Gnome Fs Duplicate Cursor Fix
⭐
7
Fix Ubuntu/GNOME's "duplicate cursor" fractional scaling bug.
Pocket Deduper
⭐
7
Remove duplicates from your Pocket list.
Audiomerge
⭐
7
Merge multiple scattered music collections into one, taking only the best version of duplicates
Findfileconflicts
⭐
6
An elementary OS app
Document Similarity
⭐
6
Using Jaccard-Similarity and Minhashing to determine similarity between two text documents
Compare Similarity
⭐
6
👁 Compare the similarity of two strings
Dupfilter
⭐
6
强大的去重方案实现,归纳整合常见的去重方案,快速集成到项目中。
Fast Duplicate Finder
⭐
6
A python program to locate duplicate files - and do it fast
Finddupe
⭐
6
Enhanced version of finddupe, a duplicate file detector for Windows
Dff
⭐
5
A dead-simple command line tool to find duplicate files on your computer.
Duplihere
⭐
5
Copy & Paste finder for structured text files.
Yara_rules_util
⭐
5
YARA duplicate rule detection and removal. YARA rule index creation. YARA rule file merger.
Removedup
⭐
5
Remove duplicates from parallel corpora
Bridge
⭐
5
A small CLI utility used to find duplicate files
Duplicatefilefinder
⭐
5
This program finds duplicate files in a folder and its subfolders. Duplicates are moved to a separate folder. A few other modes of operation are also planned/available.
1-77 of 77 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.