privacy impact assessment

Systematic evaluation of privacy risks and trade-offs between privacy and utility—using auditing, differential-privacy methods, and release strategies—to guide dataset curation, synthetic-data design, and responsible public release policies.

privacyimpactassessment

12-Month Skill Trend

Momentum and market value over time
Trending
Score
+20 in 12 mo
96
12 mo agoNow
Career
Value
+$12K in 12 mo
$42K/year
12 mo agoNow

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

Synthetic Data: Revisiting the Privacy-Utility Trade-off

Jul 09, 2024
FJ
F. J. Sarmin
🏛️ University of Manitoba | Concordia University

Recent critiques have challenged the differential privacy guarantees of PATE-GAN and PrivBayes, questioning the validity of their privacy-utility trade-offs. However, these critiques rely on restrictive assumptions—such as synthetic or simplistic data distributions—and limited experimental settings, potentially biasing their conclusions. Method: We propose a more general privacy-utility evaluation framework that integrates privacy game analysis and theoretical verification, and conduct k-anonymity benchmarking experiments on real-world datasets without distributional assumptions. Contribution/Results: Under identical privacy budgets, both PATE-GAN and PrivBayes significantly outperform k-anonymity in statistical utility while maintaining strong differential privacy guarantees. We demonstrate that prior claims of “privacy failure” stem from flawed evaluation premises—specifically, the absence of rigorous privacy accounting and realistic data assumptions. Our empirical analysis refutes these criticisms and establishes synthetic data generation as a robust and effective privacy-enhancing technology.

Challenges synthetic data's privacy-utility trade-off superiority.Identifies breaches in differential privacy guarantees of PATE-GAN and PrivBayes.Reaffirms synthetic data's favorable privacy-utility trade-off in general environments.

This work addresses the challenge non-technical users face in understanding the trade-off between privacy loss parameters and the reliability of statistical inference in differential privacy. By reframing the privacy–utility trade-off within a hypothesis testing framework, the paper introduces the concept of “relative disclosure risk,” which directly links privacy loss parameters to the validity of statistical inference. Through theoretical analysis of how differentially private mechanisms affect the significance of hypothesis tests, the study quantifies the uncertainty introduced by randomization and its effectiveness in mitigating membership inference attacks. The resulting insights yield an actionable guideline for non-expert users to select appropriate privacy mechanisms, thereby promoting transparent deployment and principled configuration of differential privacy in practical applications.

data analysisdifferential privacydisclosure risk

Balancing privacy preservation and data utility remains a critical challenge in sharing sensitive behavioral health data. Method: We propose a high-utility synthetic data generation framework grounded in differential privacy (DP), integrating physiological signals from Oura rings with self-reported survey data and employing an Adaptive Iterative Mechanism (AIM) to produce ε=5-DP-compliant synthetic datasets. Contribution/Results: We introduce a task-oriented utility evaluation framework that quantitatively characterizes the trade-off between privacy budget and statistical/predictive utility across high-dimensional, large-scale behavioral health data. Experiments demonstrate that the synthetic data retain downstream modeling performance—e.g., depression risk prediction—nearly equivalent to the original data, while substantially reducing re-identification risk. To our knowledge, this is the first empirical validation in a real-world behavioral health setting that strong privacy protection (ε ≤ 5) and high data usability can be simultaneously achieved. Our work provides a reproducible technical pathway and evidence-based guidance for secure, privacy-preserving open sharing of sensitive health data.

Balancing privacy and utility in health data sharingEvaluating privacy-utility trade-offs across varying epsilon valuesGenerating differentially private synthetic behavioral health data

This study addresses a fundamental tension between differential privacy and data valuation: the former requires insensitivity to individual records, while the latter demands precise quantification of each data point’s contribution. The work systematically analyzes how mainstream valuation methods—such as Shapley values and influence functions—fail under differential privacy constraints, identifying high-sensitivity components within these algorithms. It proposes design principles for privacy-friendly valuation mechanisms and employs sensitivity analysis alongside privacy-utility trade-off evaluations to reveal the limitations of current approaches in preserving the discriminative power of rare samples. By delineating the feasible boundaries of private data valuation, this research lays a theoretical foundation for developing practical mechanisms that jointly uphold privacy guarantees and valuation utility.

data valuationdifferential privacyheterogeneous data

How to Get Actual Privacy and Utility from Privacy Models: the k-Anonymity and Differential Privacy Families

Oct 13, 2025
JD
Josep Domingo-Ferrer
🏛️ Universitat Rovira i Virgili | CYBERCAT-Center for Cybersecurity Research of Catalonia

Existing mainstream privacy models suffer from fundamental limitations: k-anonymity operates syntactically, rendering it vulnerable to background knowledge attacks and lacking semantic constraints; differential privacy faces a sharp utility–privacy trade-off—small privacy budgets cause severe data distortion, while large budgets degrade privacy guarantees. Method: We propose Semantic k-Anonymity, which formally incorporates domain-specific semantic constraints and dependencies among sensitive attributes to reconstruct the equivalence-class partitioning mechanism—enhancing disclosure resistance without compromising data utility. Contribution/Results: Through rigorous formal modeling, principled semantic constraint design, and empirical risk assessment, we demonstrate that Semantic k-Anonymity achieves more robust privacy protection and higher data utility than conventional k-anonymity and differential privacy in realistic settings, thereby reducing reliance on post-hoc risk evaluation.

Current privacy models require costly empirical risk assessmentsDifferential privacy causes excessive utility loss with small budgetsk-anonymity fails to fully prevent data disclosure risks

Latest Papers

What's happening recently
View more

Practitioners' Perspectives on a Differential Privacy Deployment Registry

Sep 16, 2025
PN
Priyanka Nanayakkara
🏛️ OpenDP | Harvard University

This paper addresses the lack of transparency and reusability in differential privacy (DP) practice by introducing the first public, structured DP deployment registry. Methodologically, it proposes a hierarchical DP deployment description framework spanning use cases, mechanisms, parameters, evaluation methodologies, and governance; designs an interactive platform supporting multidimensional search and visualization; and populates it with 21 real-world deployments. Key contributions include: (1) the first systematic definition of a DP deployment metadata model, enhancing technical interpretability; (2) positioning the registry as an interdisciplinary community hub to foster experience sharing and accountability; and (3) empirically validating its utility for knowledge dissemination and deployment guidance through a user study with 16 practitioners—while identifying critical adoption barriers, including insufficient parameter disclosure and absence of standardized evaluation criteria.

Addressing adoption challenges and opportunities for DP registryCreating a schema for describing differential privacy deploymentsDesigning an interactive registry interface for DP practitioners

"Having Confidence in My Confidence Intervals": How Data Users Engage with Privacy-Protected Wikipedia Data

Dec 06, 2025
HT
Harold Triedman
🏛️ Cornell Tech | Northeastern University | Harvard University | Columbia University | University of Maryland | Fred Hutch Cancer Center | Georgetown University

This study investigates how data users comprehend and respond to statistical noise introduced by privacy-preserving techniques—particularly differential privacy (DP)—focusing on cognitive challenges in constructing confidence intervals and navigating utility–privacy trade-offs. Through scenario-based interviews, we observed users analyzing Wikipedia browsing data perturbed by DP and rounding mechanisms. Results indicate that users prefer simple uncertainty metrics but struggle to robustly construct confidence intervals under compound noise sources; DP-perturbed data, compared to rounded data, more frequently elicits simulation-based inferential practices. Based on these findings, we propose a simulation-driven paradigm for uncertainty assessment and provide empirically grounded, actionable recommendations for privacy-aware data documentation and the design of interactive analytical tools.

Examines misconceptions about differential privacy's utility versus privacy trade-offsExplores how data users perceive privacy-preserving noise in datasetsInvestigates user challenges in computing confidence intervals with noisy data

Financial data sharing faces a fundamental trade-off between privacy preservation and utility retention, as conventional anonymization techniques often fail to meet both regulatory compliance and analytical requirements. This work proposes a “privacy-first” framework that innovatively decouples identity from utility by integrating differentially private synthetic data generation. It introduces two complementary paradigms: direct tabular synthesis for high-fidelity static analysis, and a differentially private seed-driven agent-based modeling (DP-Seeded ABM) approach to simulate dynamic market behaviors and black swan events. By rigorously guaranteeing privacy while preserving analytical utility, the framework overcomes the limitations of static datasets, effectively dismantles institutional barriers to data sharing, and enables compliant cross-organizational research and forward-looking decision-making.

Differential PrivacyFinancial EcosystemsPrivacy-by-Design

This work systematically uncovers an inherent privacy vulnerability in data curation pipelines: even when the final model is trained exclusively on publicly available data, the process of using private data to guide dataset selection can inadvertently leak membership information about the private data. To demonstrate this risk, we propose a novel membership inference attack targeting three distinct stages of the curation pipeline—score computation, subset selection, and final model training—and validate its effectiveness across mainstream data selection algorithms. Furthermore, we design a tailored defense mechanism integrating differential privacy into the curation process. Empirical evaluations show that our approach significantly mitigates information leakage at each stage while preserving utility.

data curationmachine learningmembership inference

How to DP-fy Your Data: A Practical Guide to Generating Synthetic Data With Differential Privacy

Dec 02, 2025
NP
Natalia Ponomareva
🏛️ Google Research | NYU | Pontificia Universidad Católica de Chile | Google DeepMind

This study addresses the dual challenges of privacy leakage from real user interaction data in AI training and insufficient representativeness of public datasets. We propose an end-to-end differentially private synthetic data generation framework for multimodal data (images, tabular, and text). Methodologically, it integrates sensitive data preprocessing, adaptive privacy budget allocation, generative-model-driven synthesis, and empirical privacy auditing, supporting both centralized and decentralized deployment. Our key contributions are: (1) the first systematic formulation of a synthetic data generation paradigm that jointly ensures distributional fidelity and rigorous (ε,δ)-differential privacy; (2) substantially improved cross-modal applicability and deployment trustworthiness; and (3) empirical validation demonstrating high data utility—even under stringent privacy constraints (ε ≤ 2)—enabling secure data sharing and reuse as a robust alternative to conventional anonymization techniques.

Generating synthetic data with differential privacy to protect user privacy.Providing strong privacy guarantees for sensitive datasets across various modalities.Unlocking high-quality data from real user interactions while ensuring privacy.

Hot Scholars

PM

Pasin Manurangsi

Google Research
Theoretical Computer ScienceDifferential PrivacyApproximation AlgorithmsHardness of Approximation
SZ

Shuning Zhang

Tsinghua University
HCIUsable Privacy and SecurityAI
TL

Tianshi Li

Assistant Professor, Northeastern University
Human-Computer InteractionPrivacyHuman-Centered AI Privacy
QY

Qingqing Ye

Assistant Professor, The Hong Kong Polytechnic University
data privacy and securityadversarial machine learning
MC

Mauro Conti

IEEE Fellow - Prof.@University of Padua - Wallenberg WASP Guest.Prof.@Örebro U.- Affiliate Prof.@UW
SecurityPrivacy