Embedding based Encoding Scheme for Privacy Preserving Record Linkage

📅 2025-11-01
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This paper addresses privacy-preserving record linkage (PPRL): the problem of accurately identifying record pairs across distributed databases that refer to the same entity, while provably protecting sensitive raw data. To this end, we propose a novel PPRL method based on *q*-gram embedding and binary encoding. Specifically, *q*-grams are first mapped into a low-dimensional semantic embedding space; subsequently, a learnable quantization strategy transforms these embeddings into compact binary codes, enabling efficient and cryptographically secure similarity computation. The approach significantly improves matching accuracy—particularly for short-string records—and enhances robustness against re-identification and inference attacks. Extensive experiments on multiple real-world datasets demonstrate an average 8.2% improvement in F1-score over state-of-the-art baselines, while satisfying rigorous formal privacy guarantees (e.g., differential privacy or cryptographic security, as instantiated).

Technology Category

Machine Learning: PrivacyData Mining & Knowledge Management: Intelligent Query ProcessingSearch and Optimization: Distributed Search

Application Category

Security and Privacy: Privacy-enhancing technologiesUser Modeling, Personalization and Recommendation: User privacy protection in personalized systemsSearch and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
📝 Abstract
To discover new insights from data, there is a growing need to share information that is often held by different organisations. One key task in data integration is the calculation of similarities between records in different databases to identify pairs or sets of records that correspond to the same real-world entities. Due to privacy and confidentiality concerns, however, the owners of sensitive databases are often not allowed or willing to exchange or share their data with other organisations to allow such similarity calculations. Privacy-preserving record linkage (PPRL) is the process of matching records that refer to the same entity across sensitive databases held by different organisations while ensuring no information about the entities is revealed to the participating parties. In this paper, we study how embedding based encoding techniques can be applied in the PPRL context to ensure the privacy of the entities that are being linked. We first convert individual q-grams into the embedded space and then convert the embedding of a set of q-grams of a given record into a binary representation. The final binary representations can be used to link records into matches and non-matches. We empirically evaluate our proposed encoding technique against different real-world datasets. The results suggest that our proposed encoding approach can provide better linkage accuracy and protect the privacy of individuals against attack compared to state-of-the-art techniques for short record values.
Problem

Research questions and friction points this paper is trying to address.

Matching records across databases without revealing sensitive information
Applying embedding techniques for privacy-preserving record linkage
Converting q-grams to binary representations for secure matching
Innovation

Methods, ideas, or system contributions that make the work stand out.

Embedding-based encoding for privacy-preserving record linkage
Converts q-grams to embedded space then binary representation
Provides better linkage accuracy and privacy protection
🔎 Similar Papers
No similar papers found.
S
Sirintra Vaiwsri
Faculty of Industrial Technology and Management, King Mongkut’s University of Technology North Bangkok, Prachin Buri, 25230, Thailand
T
Thilina Ranbaduge
Data61, Canberra, ACT, 2600, Australia