Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Deduplication Entity Resolution Open Source Projects

Open source projects categorized as Deduplication Entity Resolution
Categories > Data Processing > Deduplication
Categories > Entity Resolution
Dedupe ⭐ 3,879
🆔 A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
dependent packages 10total releases 174most recent commit 4 months agopypi dedupe} Downloads
Splink ⭐ 939
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
dependent packages 2total releases 119most recent commit 3 months agopypi splink} Downloads
Zingg ⭐ 828
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
total releases 1most recent commit 3 months ago
Recordlinkage ⭐ 808
A powerful and modular toolkit for record linkage and duplicate detection in Python
dependent packages 3total releases 23most recent commit 9 months agopypi recordlinkage} Downloads
Csvdedupe ⭐ 398
🆔 Command line tool for deduplicating CSV files
most recent commit 4 years ago
Data Matching Software ⭐ 329
A list of free data matching and record linkage software.
most recent commit 5 months ago
Dedupe Examples ⭐ 306
🆔 Examples for using the dedupe library
most recent commit 2 years ago
Entity Embed ⭐ 98
PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.
total releases 6most recent commit 2 years ago
Record Linkage Resources ⭐ 82
Resources for tackling record linkage / deduplication / data matching problems
most recent commit 2 years ago
Rltk ⭐ 81
Record Linkage ToolKit (Find and link entities)
dependent packages 5total releases 20most recent commit 3 years agopypi rltk} Downloads
Deduplipy ⭐ 66
Python package for deduplication/entity resolution using active learning
total releases 23most recent commit 7 months ago
Pyjedai ⭐ 47
An open-source library that leverages Python’s data science ecosystem to build powerful end-to-end Entity Resolution workflows.
total releases 12most recent commit 3 months ago
Awesome ⭐ 44
Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
most recent commit 3 months ago
Recordlinkage Annotator ⭐ 34
A browser user interface for manual labeling of record pairs.
most recent commit a year ago
Spark Matcher ⭐ 27
Record matching and entity resolution at scale in Spark
most recent commit 6 months ago
Extending Deep Er ⭐ 18
This project focuses on DeepER, a deep learning framework for entity resolution (record deduplication). It examines how DeepER performs on benchmark datasets under a variety of conditions and also tests a number of extensions designed to improve DeepER's accuracy.
most recent commit 6 years ago
Er Evaluation ⭐ 18
An End-to-End Evaluation Framework for Entity Resolution Systems
most recent commit 5 months ago
Nominally ⭐ 14
A maximum-strength name parser for record linkage.
dependent packages 1total releases 17most recent commit 3 years agopypi nominally} Downloads
Backend ⭐ 11
Backend (Docker & API) for matchID project
most recent commit 3 months ago
Patentsview Evaluation ⭐ 10
Evaluation and benchmarking of PatentsView disambiguation algorithms
most recent commit 3 months ago
Mismo ⭐ 7
The SQL/Ibis powered sklearn of record linkage
most recent commit 3 months ago
Awesome Entity Resolution ⭐ 6
List of entity resolution software and resources.
most recent commit 3 months ago
Deduper ⭐ 5
A general purpose deduplication framework
most recent commit 5 years ago
The 5 Most Depended On Deduplication Entity Resolution Open Source Projects
Dedupe ⭐ 3,879
:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
dependent packages 10total releases 174latest release February 17, 2023most recent commit 4 months agopypi dedupe} Downloads
Rltk ⭐ 81
Record Linkage ToolKit (Find and link entities)
dependent packages 5total releases 20latest release October 06, 2021most recent commit 3 years agopypi rltk} Downloads
Recordlinkage ⭐ 808
A powerful and modular toolkit for record linkage and duplicate detection in Python
dependent packages 3total releases 23latest release July 20, 2023most recent commit 9 months agopypi recordlinkage} Downloads
Splink ⭐ 939
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
dependent packages 2total releases 119latest release November 14, 2023most recent commit 3 months agopypi splink} Downloads
Nominally ⭐ 14
A maximum-strength name parser for record linkage.
dependent packages 1total releases 17latest release May 19, 2021most recent commit 3 years agopypi nominally} Downloads
The 10 Latest Releases In Deduplication Entity Resolution Open Source Projects
Splink ⭐ 939
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
dependent packages 2total releases 119latest release November 14, 2023most recent commit 3 months agopypi splink} Downloads
Recordlinkage ⭐ 808
A powerful and modular toolkit for record linkage and duplicate detection in Python
dependent packages 3total releases 23latest release July 20, 2023most recent commit 9 months agopypi recordlinkage} Downloads
Dedupe ⭐ 3,879
:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
dependent packages 10total releases 174latest release February 17, 2023most recent commit 4 months agopypi dedupe} Downloads
Zingg ⭐ 828
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
total releases 1latest release June 01, 2022most recent commit 3 months ago
Deduplipy ⭐ 66
Python package for deduplication/entity resolution using active learning
total releases 23latest release April 03, 2022most recent commit 7 months ago
Rltk ⭐ 81
Record Linkage ToolKit (Find and link entities)
dependent packages 5total releases 20latest release October 06, 2021most recent commit 3 years agopypi rltk} Downloads
Nominally ⭐ 14
A maximum-strength name parser for record linkage.
dependent packages 1total releases 17latest release May 19, 2021most recent commit 3 years agopypi nominally} Downloads
Qlink ⭐ 5
Entity Resolution and Record Linkage library
total releases 1latest release July 28, 2017most recent commit 7 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.