An open source, high scalability toolkit in Java for Entity Resolution.
-
Updated
Jul 12, 2025 - Java
#
entity-matching
Entity resolution (also known as data matching, data linkage, record linkage, and many other terms) is the task of finding entities in a dataset that refer to the same entity across different data sources (e.g., data files, books, websites, and databases). Entity resolution is necessary when joining different data sets based on entities that may or may not share a common identifier (e.g., database key, URI, National identification number), which may be due to differences in record shape, storage location, or curator style or preference.
Here are 62 public repositories matching this topic...
Entity resolution for Elasticsearch.
elasticsearch identity-resolution entity-resolution elasticsearch-plugin gdpr address-matching entity-matching name-matching
-
Updated
Oct 11, 2025 - Java
PyTorch library for transforming entities like companies, products, etc. into vectors to support scalable Record Linkage / Entity Resolution using Approximate Nearest Neighbors.
python deep-learning record-linkage entity-resolution pytorch embeddings representation-learning deduplication entity-matching data-matching approximate-nearest-neighbors
-
Updated
Nov 18, 2022 - Jupyter Notebook
A convenient way to link, deduplicate, aggregate and cluster data(frames) in Python using deep learning
python nlp deep-learning record-linkage entity-resolution transformers entity-matching sentence-transformers huggingface-transformers
-
Updated
Nov 5, 2025 - Python
Entity Matching Model solves the problem of matching company names between two possibly very large datasets.
-
Updated
Nov 25, 2025 - Python
An open-source library that leverages Python’s data science ecosystem to build powerful end-to-end Entity Resolution workflows.
python machine-learning entity-resolution fuzzy-matching deduplication link-discovery duplicate-detection entity-matching data-matching data-disambigation
-
Updated
Nov 3, 2025 - Python
Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
resolution identity awesome identity-resolution resource dedupe record-linkage entity-resolution entities fuzzy-matching entity disambiguation deduplication entity-linking fuzzymatch entity-matching data-matching senzing de-duplicating senzing-community
-
Updated
Dec 1, 2025 - Python
CLK hash: hash pii for entity matching
hashing record-linkage privacy-enhancing-technologies entity-matching privacy-preserving-record-linkage
-
Updated
May 12, 2025 - Python
MetaSRA: normalized sample-specific metadata for the Sequence Read Archive
natural-language-processing text-mining data-mining bioinformatics rna-seq biology biomedical-informatics annotation-processor ontologies entity-matching
-
Updated
Nov 24, 2025 - Python
Code for the paper "CollaborEM: A Self-supervised Entity Matching Framework Using Multi-features Collaboration". TKDE 2021.
-
Updated
Jul 12, 2022 - Python
Code for the paper "PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching". VLDB 2023.
-
Updated
Sep 21, 2022 - Python
Compound AI toolchain for fast and accurate entity matching, powered by LLMs.
python database ai entity-resolution openai data-integration llama gpt entity-matching data-matching large-language-models llm compound-ai-systems compound-systems
-
Updated
Mar 25, 2025 - Python
Spark Search - high performance advanced search features based on Apache Lucene
-
Updated
Jan 1, 2023 - Scala
Implementation of the paper "Deep Indexed Active Learning for Matching Heterogeneous Entity Representations"
-
Updated
Dec 20, 2021 - Python
Code for the paper "Match, Compare, or Select? An Investigation of Large Language Models for Entity Matching" (COLING 2025)
entity-resolution data-integration entity-matching data-intelligence llm large-language-model compound-ai-systems
-
Updated
Aug 25, 2025 - Python
Alignment, a collaborative, system aided, user driven ontology/vocabulary matching and validation platform.
-
Updated
Mar 29, 2022 - JavaScript
WInte.r is a Java framework for end-to-end data integration. The WInte.r framework implements well-known methods for data pre-processing, schema matching, identity resolution, data fusion, and result evaluation.
conflict-resolution entity-resolution deduplication link-discovery data-fusion entity-matching data-matching conflict-resolver
-
Updated
Jul 12, 2025 - Java
The PyDI framework provides methods for end-to-end data integration. The framework covers all steps of the integration process, including schema matching, data translation, entity matching, and data fusion. The framework offers traditional string-based methods as well as modern LLM- and embedding-based techniques for these tasks.
entity-resolution information-extraction data-integration data-normalization schema-matching data-fusion data-translation entity-matching
-
Updated
Dec 3, 2025 - HTML
JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matching
-
Updated
Nov 15, 2024 - Python
A Winner-Take-All Hashing-Based Unsupervised Model for Entity Resolution Problems. [B. Sc. Thesis]
python nlp machine-learning entity-resolution blocking locality-sensitive-hashing pattern-recognition deduplication link-discovery jedai entity-matching wta optuna prototype-selection
-
Updated
Aug 22, 2022 - Jupyter Notebook
Created by Halbert L. Dunn
Released 1946
- Followers
- 49 followers
- Organization
- entity-resolution
- Website
- github.com/topics/entity-resolution
- Wikipedia
- Wikipedia