privacy-preserving data handling

Methods for anonymizing, transforming, or synthesizing datasets and logs so sensitive information is not leaked while enabling sharing and reproducible research. Includes differential-privacy and synthetic-data techniques, plus collection/curation practices that meet ethical and legal requirements.

privacy-preservingdatahandling

12-Month Skill Trend

Momentum and market value over time
Trending
Score
+20 in 12 mo
96
12 mo agoNow
Career
Value
+$12K in 12 mo
$42K/year
12 mo agoNow

Recommended Survey Paper

Quick overview of the field
View more

A Review of Privacy Metrics for Privacy-Preserving Synthetic Data Generation

Jul 15, 2025
FM
Frederik Marinus Trudslev
🏛️ Aalborg University | University of Verona

This paper addresses three core challenges in privacy-preserving synthetic data generation (PP-SDG): opaque privacy loss interpretation, non-transparent risk semantics of the differential privacy parameter ε, and ambiguous, incomparable definitions across diverse privacy metrics (PMs). To resolve these, we systematically survey and, for the first time, formally unify the mathematical definitions of 17 mainstream PMs—explicitly specifying their underlying assumptions, implicit premises, and analytical expressions. Grounded in differential privacy theory, we integrate information-theoretic and statistical inference principles to analyze each PM’s computational model and applicability boundaries. Based on this analysis, we propose the first comprehensive PM taxonomy, rigorously characterized along three dimensions: completeness, consistency, and interpretability. This taxonomy substantially enhances transparency and standardization in privacy risk assessment and provides both a rigorous theoretical foundation and a practical evaluation framework for privacy–utility trade-offs in PP-SDG mechanisms.

Assessing privacy risk with multiple privacy metricsDefining calculations for 17 distinct privacy metricsInterpreting privacy loss in differential privacy mechanisms

Must-Read Papers

Most classic and influential ideas
View more

How to DP-fy Your Data: A Practical Guide to Generating Synthetic Data With Differential Privacy

Dec 02, 2025
NP
Natalia Ponomareva
🏛️ Google Research | NYU | Pontificia Universidad Católica de Chile | Google DeepMind

This study addresses the dual challenges of privacy leakage from real user interaction data in AI training and insufficient representativeness of public datasets. We propose an end-to-end differentially private synthetic data generation framework for multimodal data (images, tabular, and text). Methodologically, it integrates sensitive data preprocessing, adaptive privacy budget allocation, generative-model-driven synthesis, and empirical privacy auditing, supporting both centralized and decentralized deployment. Our key contributions are: (1) the first systematic formulation of a synthetic data generation paradigm that jointly ensures distributional fidelity and rigorous (ε,δ)-differential privacy; (2) substantially improved cross-modal applicability and deployment trustworthiness; and (3) empirical validation demonstrating high data utility—even under stringent privacy constraints (ε ≤ 2)—enabling secure data sharing and reuse as a robust alternative to conventional anonymization techniques.

Generating synthetic data with differential privacy to protect user privacy.Providing strong privacy guarantees for sensitive datasets across various modalities.Unlocking high-quality data from real user interactions while ensuring privacy.

Why Data Anonymization Has Not Taken Off

Sep 12, 2025
MJ
Matthew J. Schneider

Data anonymization remains underutilized in practice due to its strong context dependency—requiring customization across data domains, protection units, scope, and privacy criteria—leading to a lack of general-purpose solutions; moreover, privacy guarantees of mainstream techniques (e.g., differential privacy) vary significantly across applications and are not universally equivalent. Method: Through empirical analysis, we demonstrate tight coupling between anonymization efficacy, business objectives, and data granularity, revealing that single-technique approaches fail to simultaneously ensure privacy and utility—especially under profit-driven enterprise constraints. We propose a synergistic anonymization framework integrating differential privacy, synthetic data generation, and other complementary strategies, with business semantics explicitly guiding technology selection and parameter tuning. Contribution/Results: The framework enhances interpretability and operational adaptability, enabling scalable, goal-oriented privacy engineering—a novel paradigm for practical, context-aware anonymization deployment.

Business profitability requirements demand customized non-scalable anonymization solutionsData anonymization faces complex case-dependent implementation choicesDifferential privacy guarantees vary based on protection scope parameters

Synthetic Data: Revisiting the Privacy-Utility Trade-off

Jul 09, 2024
FJ
F. J. Sarmin
🏛️ University of Manitoba | Concordia University

Recent critiques have challenged the differential privacy guarantees of PATE-GAN and PrivBayes, questioning the validity of their privacy-utility trade-offs. However, these critiques rely on restrictive assumptions—such as synthetic or simplistic data distributions—and limited experimental settings, potentially biasing their conclusions. Method: We propose a more general privacy-utility evaluation framework that integrates privacy game analysis and theoretical verification, and conduct k-anonymity benchmarking experiments on real-world datasets without distributional assumptions. Contribution/Results: Under identical privacy budgets, both PATE-GAN and PrivBayes significantly outperform k-anonymity in statistical utility while maintaining strong differential privacy guarantees. We demonstrate that prior claims of “privacy failure” stem from flawed evaluation premises—specifically, the absence of rigorous privacy accounting and realistic data assumptions. Our empirical analysis refutes these criticisms and establishes synthetic data generation as a robust and effective privacy-enhancing technology.

Challenges synthetic data's privacy-utility trade-off superiority.Identifies breaches in differential privacy guarantees of PATE-GAN and PrivBayes.Reaffirms synthetic data's favorable privacy-utility trade-off in general environments.

This paper addresses the challenge of quantitatively assessing privacy risks—specifically identity and attribute disclosure—in practical synthetic data applications. We propose two interpretable, comparable, percentage-based metrics: RepU (Representation Uniqueness), measuring identity disclosure risk relative to original data, and DiSCO (Distributional Similarity Consistency), measuring attribute disclosure risk. We introduce the first well-defined, reproducible dual-metric evaluation framework, innovatively integrating key matching with target-variable consistency testing, augmented by statistical counting and adaptive thresholding. Crucially, the framework automatically filters out spurious disclosures attributable to domain-specific prior knowledge, substantially reducing false positives. Implemented as an extension to the R package *synthpop*, the method is empirically validated on real-world datasets, demonstrating robustness and practical utility for informed synthetic data release decisions.

Compares disclosure risks between synthetic and original dataEvaluates attribute disclosure risk for target variablesMeasures identity disclosure risk in synthetic data

Differentially Private Data Generation with Missing Data

Oct 17, 2023
SM
Shubhankar Mohapatra
🏛️ University of Waterloo

Existing differential privacy (DP) synthetic data methods suffer substantial utility degradation when input data contain missing values. Method: This paper formally defines the DP synthetic data generation problem under missingness, characterizing how missingness mechanisms—Missing Completely at Random (MCAR), Missing at Random (MAR), and Missing Not at Random (MNAR)—propagate privacy loss and affect theoretical privacy bounds. Building on this analysis, we propose three adaptive synthesis strategies, each tailored to a specific missingness mechanism and privacy budget. Contribution/Results: Our key innovation is integrating missingness mechanism modeling directly into the DP synthetic data framework, enabling joint optimization of privacy protection and data utility. Evaluated on four real-world datasets with natural missingness, our approach achieves significant utility gains—improving downstream machine learning task accuracy by an average of 8.3%—while yielding tighter analytical privacy upper bounds compared to baseline methods.

Generating differentially private synthetic data with missing valuesImproving synthetic data utility under privacy constraintsModeling missing mechanisms for tighter privacy guarantees

Latest Papers

What's happening recently
View more

Current evaluations of synthetic data anonymity are largely confined to the dataset level, overlooking the privacy risks inherent in the generative models themselves and thus failing to meet real-world regulatory compliance requirements. This work addresses this gap by adopting a model-centric perspective, establishing a novel privacy risk assessment framework that explicitly links the GDPR notion of “identifiability” with privacy attacks targeting generative models. Through a comparative analysis of differential privacy (DP) and similarity-based privacy metrics (SBPMs), the study demonstrates that SBPMs are insufficient in mitigating identifiability risks, whereas DP provides stronger, more reliable guarantees. The findings offer a more robust and responsible technical foundation for evaluating privacy and ensuring regulatory compliance in synthetic data systems.

anonymityGDPRgenerative models

This study addresses the challenge of sharing real-world educational data under strict privacy constraints, where existing differentially private synthetic data methods—often reliant on deep learning—are hindered by engineering complexity and limited practicality in small-sample, high-dimensional settings. The authors propose a training-free, two-stage framework: first, leveraging large language models to generate differentially private synthetic data for broad sharing and exploratory analysis; second, enabling on-demand validation of research findings on the original data through a secure remote code submission mechanism. Evaluated on three years of real educational data, the approach achieves synthetic data quality comparable to deep learning baselines while substantially reducing implementation overhead. Case studies show that approximately 36% of findings are reproducible on the真实 data, with the validation process introducing only negligible additional privacy loss.

differentially private synthetic data generationeducational data sharingprivacy constraints

Generative Data Refinement: Just Ask for Better Data

Sep 10, 2025
MJ
Minqi Jiang
🏛️ Google DeepMind

Facing data exhaustion in model training and regulatory constraints on private data usage, this paper proposes the Generative Data Refinement (GDR) framework—the first to leverage pretrained generative models for *conditional synthetic data transformation*. GDR simultaneously achieves web-scale data detoxification, anonymization, and distribution preservation without manual prompt engineering. It safely converts private datasets containing sensitive or harmful content into high-quality, privacy-compliant training corpora while preserving semantic diversity and statistical fidelity. Experimental results demonstrate that GDR significantly outperforms state-of-the-art industrial baselines on both anonymization and detoxification tasks: it successfully purifies high-risk datasets and improves downstream model performance across multiple benchmarks. By enabling scalable, privacy-preserving data curation, GDR establishes a new paradigm for sustainable large language model training—one that reconciles dataset expansion with stringent privacy and safety requirements.

Addressing projected data exhaustion for large modelsMitigating risks from unindexed user-generated contentRefining datasets to remove undesirable content safely

This work addresses the challenge of limited cross-institutional sharing of highly sensitive genomic data, which severely hinders the application of AI in data-scarce domains such as rare diseases. To overcome this barrier, the study proposes a novel framework that synergistically integrates secure multi-party computation (MPC) and differential privacy (DP). This approach simultaneously preserves input privacy—by safeguarding participants’ raw genomic data—and controls output privacy—by bounding information leakage from the synthesized data—enabling high-fidelity generative models to be trained collaboratively across institutions. Experiments on multiple real-world RNA-seq cohorts demonstrate that the resulting synthetic datasets achieve both strong privacy guarantees and high utility, effectively breaking down data silos while maintaining analytical validity.

cross-silodata privacyfederated learning

Existing open-source tools lack a unified infrastructure, making it challenging to efficiently support the diverse modeling choices and privacy requirements inherent in synthetic data generation. This work proposes tidysynthesis, a modular and extensible meta-package that integrates a wide range of statistical modeling and differential privacy techniques through a unified declarative API. For the first time, it enables cross-framework algorithm composition and flexible customization of synthetic data workflows. The system substantially enhances both development efficiency and privacy guarantees, with its completeness, usability, and capacity to handle complex synthesis tasks demonstrated through empirical validation on U.S. Census survey data.

data privacydesign choicesopen source software

Hot Scholars

QW

Qin Wang

ETH Zurich
Domain AdaptationComputer Vision
PM

Pasin Manurangsi

Google Research
Theoretical Computer ScienceDifferential PrivacyApproximation AlgorithmsHardness of Approximation
QY

Qingqing Ye

Assistant Professor, The Hong Kong Polytechnic University
data privacy and securityadversarial machine learning
WN

Wei Ni

FIEEE, AAIA Fellow, Senior Principal Scientist & Conjoint Professor, CSIRO/UNSW
6G security and privacyconnected and trusted intelligenceapplied AI/ML
MC

Mauro Conti

IEEE Fellow - Prof.@University of Padua - Wallenberg WASP Guest.Prof.@Örebro U.- Affiliate Prof.@UW
SecurityPrivacy