Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Deduplication

Fast multi-threaded content-dependent chunking deduplication for Buffers in C++ with a reference implementation in Javascript. Ships with extensive tests, a fuzz test and a benchmark.
Stars
38
License
mit
Open Issues
1
Most Recent Commit
4 years ago
Programming Language
JavaScript
Monthly Downloads
npm @ronomon/deduplication Downloads
Dependent Packages
2
Total Releases
12
Latest Release
November 06, 2018
Categories
Repo
Alternatives To Deduplication
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Chronix.server258
4 years ago9apache-2.0Java
The Chronix Server implementation that is based on Apache Solr.
Json Url228npm json-url} Downloads517a year ago21April 21, 20233mitJavaScript
Compress JSON into compact base64 URI-friendly notation
Zchunk22164 months ago17October 05, 202313bsd-2-clauseC
A file format designed for highly efficient deltas while maintaining good compression
Pcompress219
5 years ago26lgpl-3.0C
A Parallelized Data Deduplication and Compression utility
Mtpng192cargo mtpng} Downloads12 years ago9April 22, 202111otherRust
A parallelized PNG encoder in Rust
N5140
5 months ago14bsd-2-clauseJava
Not HDF5
Zstd Codec138npm zstd-codec} Downloads3162 years ago14January 28, 202223mitC++
Zstandard codec for Node.js and Web, powered by Emscripten
Bloscpack105pypi bloscpack} Downloads2333 years ago22March 09, 20187bsd-3-clausePython
Command line interface to and serialization format for Blosc
Advancecomp102
13 years ago1C++
Fork of the AdvanceCOMP re-compression utilities
Png Parser70
a year ago2mitPython
Analyse PNG file format for CTF, python API and CLI
Alternatives To Deduplication
Select To Compare
Json Url ⭐ 228
Compress JSON into compact base64 URI-friendly notation
dependent packages 17total releases 21most recent commit a year agonpm json-url} Downloads
Zchunk ⭐ 221
A file format designed for highly efficient deltas while maintaining good compression
dependent packages 6total releases 17most recent commit 4 months ago
Mtpng ⭐ 192
A parallelized PNG encoder in Rust
dependent packages 1total releases 9most recent commit 2 years agocargo mtpng} Downloads
N5 ⭐ 140
Not HDF5
most recent commit 5 months ago
Zstd Codec ⭐ 138
Zstandard codec for Node.js and Web, powered by Emscripten
dependent packages 16total releases 14most recent commit 2 years agonpm zstd-codec} Downloads
Bloscpack ⭐ 105
Command line interface to and serialization format for Blosc
dependent packages 3total releases 22most recent commit 3 years agopypi bloscpack} Downloads


Suggest An Alternative To deduplication
Alternative Project Comparisons
Deduplication vs Chronix.server
Deduplication vs Json Url
Deduplication vs Zchunk
Deduplication vs Pcompress
Deduplication vs Mtpng
Deduplication vs N5
Deduplication vs Zstd Codec
Deduplication vs Bloscpack
Deduplication vs Advancecomp
Deduplication vs Png Parser
Popular Chunk Projects
Popular Compression Projects
Deepspeed ⭐ 32,358
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dependent packages 87total releases 79latest release December 01, 2023most recent commit 16 days agopypi deepspeed} Downloads
Cyberchef ⭐ 25,521
The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis
dependent packages 5total releases 396latest release July 14, 2023most recent commit 10 days agonpm cyberchef} Downloads
Zstd ⭐ 21,574
Zstandard - Fast real-time compression algorithm
dependent packages 62total releases 19latest release April 12, 2023most recent commit 3 months ago
Squoosh ⭐ 20,339
Make images smaller using best-in-class codecs, right in the browser.
dependent packages 52total releases 12latest release January 03, 2023most recent commit 3 months agonpm @squoosh/lib} Downloads
Popular Text Processing Categories
Tex
Format
Translation
Address
Character
Highlighter
Regular Expression
Formatter
Selector
Localization
Related Searches
Javascript Chunk
Javascript Compression
Compression Chunk
Javascript Deduplication
Compression Deduplication
Javascript Thread Pool
Chunk Deduplication
Chunk Chunking
Javascript Chunking

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Javascript
Compression
Chunk
Thread Pool
Deduplication
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.