pii detection

Designing classifiers and heuristics to detect and characterize personally identifiable information in data and network requests, including pre‑inference query classification to flag presence and complexity of sensitive fields such as health data.

piidetection

12-Month Skill Trend

Momentum and market value over time
Trending
Score
+20 in 12 mo
96
12 mo agoNow
Career
Value
+$12K in 12 mo
$42K/year
12 mo agoNow

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

This study addresses the central challenge in privacy-preserving classification: how to acquire useful individual information while avoiding the disclosure of sensitive attributes. For the first time, we formally integrate the privacy objective into the classification decision process, proving the resulting problem to be NP-complete. To tackle this, we propose an interactive querying framework based on generalized decision trees that optimizes question strategies to reduce uncertainty about the target attribute while constraining the leakage of private information. We develop an efficient heuristic solver combining greedy and genetic algorithms to navigate this trade-off. Experimental results demonstrate that our approach achieves an optimal balance between utility and privacy within acceptable computational time, offering a practical solution for non-intrusive personnel screening and customer data collection scenarios.

data classificationinformation disclosurenon-intrusive selection

Unveiling Privacy Policy Complexity: An Exploratory Study Using Graph Mining, Machine Learning, and Natural Language Processing

Jun 30, 2025
VR
Vijayalakshmi Ramasamy
🏛️ Georgia Southern University | Augusta University

Privacy policies are often lengthy and ambiguous, impeding users’ comprehension of data collection, sharing, and tracking practices—thereby undermining privacy transparency and informed decision-making. To address this, we propose a novel analytical framework integrating graph neural networks, semantic parsing, and interactive visualization. First, we construct a fine-grained semantic graph model from policy text using natural language processing. Second, we apply graph mining alongside t-SNE/PCA for topic clustering and interpretable dimensionality reduction. Finally, an interactive knowledge graph interface enables risk identification and compliance auditing. Our key contribution is the first synergistic application of dynamic graph visualization and graph mining to structured privacy policy analysis. This approach significantly improves textual readability (42% gain in structural clarity) and pattern recognition capability, uncovering cross-platform data-sharing and covert tracking commonalities. The framework provides scalable technical support for regulatory oversight and user empowerment.

Analyzing lengthy privacy policies for transparency using automated toolsEnhancing user understanding through interactive graph visualizationsIdentifying policy themes and compliance risks via graph mining

Privacy Checklist: Privacy Violation Detection Grounding on Contextual Integrity Theory

Aug 19, 2024
HL
Haoran Li
🏛️ The Hong Kong University of Science and Technology | National University of Singapore | Huawei Technologies

Existing privacy research is fragmented across isolated technical domains (e.g., CV, NLP, networking), failing to address real-world, cross-contextual privacy concerns. Method: We propose a human-centered privacy modeling framework grounded in Contextual Integrity (CI) theory—first systematically integrating CI into large language models (LLMs). Our approach constructs the first multi-ontology privacy checklist incorporating social identities, sensitive attributes, and the full HIPAA regulatory framework. Leveraging expert-annotated, multi-source ontology fusion, it extends beyond traditional PII definitions to enable context-aware, human-interpretable privacy assessment. Contribution/Results: Experiments demonstrate LLMs’ efficacy in structured regulatory comprehension and context-sensitive privacy reasoning. Our framework establishes a novel paradigm for generalizable, cross-domain privacy risk identification—bridging theoretical privacy principles with scalable, deployable AI-driven assessment.

Detects privacy violations using Contextual Integrity theory.Develops a checklist covering social identities and regulations.Utilizes large language models for comprehensive privacy analysis.

SoK: Decoding the Enigma of Encrypted Network Traffic Classifiers

Mar 25, 2025
NW
Nimesha Wickramasinghe
🏛️ The University of New South Wales | University of California Irvine

Modern encryption protocols (e.g., TLS 1.3) have rendered traditional network traffic classification (NTC) ineffective, while existing ML-based NTC studies suffer from outdated datasets, flawed assumptions, and methodological biases. Method: We conduct a systematic mapping study (SoK), establishing a taxonomy of NTC design choices and benchmarking practices; we perform the first large-scale empirical validation—348 feature-masking ablation experiments—to rigorously test foundational assumptions, exposing critical flaws such as training on plaintext traffic and overfitting to obsolete datasets. Contribution/Results: We demonstrate that state-of-the-art classifiers consistently fail on real-world encrypted traffic; we propose a reproducible best-practice guideline for NTC evaluation; and we delineate three key future directions: (1) focusing on realistic encrypted scenarios, (2) enabling dynamic dataset curation and updating, and (3) adopting causality-aware, domain-informed feature engineering.

Analyzing ML-based encrypted traffic classification challengesEvaluating classifier performance with empirical evidenceIdentifying outdated datasets and design choice oversights

This study addresses the significant gap between academic research and real-world deployment in network intrusion detection systems (NIDS), which stems from a lack of consensus on the fundamental characteristics of NIDS and consequently leads to inconsistent evaluation benchmarks. Through a systematic survey (SoK), this work formally defines the intrinsic properties of NIDS, critically examines prevailing evaluation methodologies, and employs reproducible case studies to expose the disconnect between theoretical research and operational practice. Building on these insights, the paper proposes foundational principles and concrete recommendations for reframing NIDS research through the lens of security operations, aiming to align academic inquiry more closely with real-world requirements and provide actionable methodological guidance for future work.

baseline scenarioevaluation methodologyNetwork Intrusion Detection Systems

Latest Papers

What's happening recently
View more

Clinical electronic health records (EHRs) contain critical anomalous events that evade detection by rule-based systems—particularly subtle, “apparently normal” events with substantial prognostic impact. Method: We propose an information-theoretic, foundation-model–driven anomaly detection framework that quantifies token- and event-level informativeness via context-aware entropy estimation and event saliency scoring. Contribution/Results: This work pioneers the integration of information theory into clinical event detection, overcoming reliance on handcrafted rules. By coupling informativeness scoring with interpretable attribution techniques, it provides event-level explanations for prognostic models. Experiments demonstrate that high-informativeness events identified by our method significantly improve downstream outcome prediction (average AUC gain of 0.08), while low-informativeness events can be safely pruned without performance degradation—validating the clinical utility and decision-support value of informativeness as a biomarker.

Detecting anomalous events in electronic health recordsInterpreting prognostic models using informativeness metricsPredicting downstream patient outcomes effectively

Individuals and organizations lack systematic awareness of interdependent privacy risks, hindering proactive mitigation of cascading data breaches. Method: Leveraging over 5,000 real-world identity theft cases, we construct the first empirically grounded identity attribute ecosystem graph model, explicitly representing disclosure dependencies among personally identifiable information (PII) as a directed graph; we then propose a graph neural network (GNN)-based privacy risk prediction framework to quantitatively assess cascading leakage pathways—i.e., from single-attribute exposure to multi-attribute compromise. Contribution/Results: Experiments demonstrate that our approach significantly outperforms conventional feature-engineering models in both predictive accuracy and interpretability. It provides a theoretically grounded, practically deployable tool for pre-incident privacy risk forecasting, enabling actionable early warnings and supporting privacy-by-design strategies.

Assessing likelihood of further disclosures after compromiseModeling relationships between exposed personal data attributesPredicting privacy risks from personal data exposure

Incorporating Taxonomies of Cyber Incidents Into Detection Networks for Improved Detection Performance

Aug 13, 2025
RW
Ryan Warnick
🏛️ Microsoft Security Research | Microsoft

This work addresses the precision-recall trade-off in network intrusion detection, arising from the inherent diversity of cyber threats. Methodologically, we propose a novel detection framework that deeply integrates a cybersecurity incident taxonomy into the architectural design of detection networks. Guided by the taxonomy’s hierarchical semantic structure, we jointly leverage ontology-based analysis and controlled simulations to systematically identify the optimal operational equilibrium for detection strategies. Our key contribution is the first principled elevation of taxonomies from static labeling tools to structural priors embedded within detection models—explicitly encoding semantic relationships and evolutionary pathways among threat behaviors. Empirical evaluation across multiple public benchmark datasets demonstrates substantial improvements in holistic detection performance (average F1-score gain of 12.7%). Moreover, our analysis uncovers fundamental theoretical limits on detection set construction and establishes an interpretable pathway for performance optimization.

Leverage taxonomies to optimize cyber threat detection performanceProve optimal detection strategy under precision-recall trade-offsStudy detection networks for interconnected threat behavior analysis

Towards Contextual Sensitive Data Detection

Dec 02, 2025
LT
Liang Telkamp
🏛️ University of Amsterdam | Centrum Wiskunde & Informatica

Existing sensitive data detection methods predominantly focus on personally identifiable information (PII), overlooking the contextual dependency of data sensitivity. This paper proposes a novel context-aware paradigm for sensitive data detection, introducing— for the first time—type contextualization and domain contextualization mechanisms. The approach integrates semantic type identification, document-level contextual modeling, sensitive rule retrieval, and large language model (LLM)-driven reasoning into an end-to-end detection framework. Evaluated on non-standard data domains—such as humanitarian datasets—the method achieves a 94% recall in type contextualization, outperforming commercial tools by 31 percentage points. Domain contextualization significantly enhances adaptability to complex, real-world scenarios. Furthermore, LLM-generated interpretive explanations substantially improve inter-annotator agreement during manual review. Collectively, this work advances sensitive data detection by grounding sensitivity assessment in rich, multi-granular contextual signals rather than static, syntax-driven patterns.

Applying domain-specific rules for sensitivity detection in non-standard datasetsDetecting sensitive data in open datasets using contextual awarenessReducing false positives in sensitive data detection through semantic analysis

Sensitivity, Specificity, and Consistency: A Tripartite Evaluation of Privacy Filters for Synthetic Data Generation

Oct 02, 2025
AK
Adil Koeken
🏛️ Technical University of Munich | TUM University Hospital

This study identifies critical flaws in current post-hoc privacy filters applied to synthetic chest X-ray data: they exhibit high sensitivity to real images but suffer from low specificity and poor consistency, failing reliably to detect near-duplicate samples generated from training data—thereby introducing false security guarantees. To address this, we propose the first tripartite evaluation framework for synthetic medical imaging, systematically assessing filters along three dimensions—sensitivity, specificity, and consistency—on both real and synthetic images. Empirical evaluation demonstrates that existing methods cannot robustly prevent training-data leakage and fall short of clinical-grade privacy assurance requirements. Our work not only quantifies key technical bottlenecks in privacy filtering but also establishes a new benchmark for privacy assessment of synthetic medical data, providing both theoretical foundations and practical standards for designing next-generation, robust, and verifiable healthcare privacy-preserving technologies.

Evaluating effectiveness of privacy filters for synthetic medical data generationIdentifying limitations in protecting patient privacy from synthetic duplicatesTesting specificity and consistency of post-hoc privacy filtering techniques

Hot Scholars

AK

Aymen Khaleel

Post-Doctoral Fellow, Ruhr-Universität-Bochum
Wireless communicationsMIMORIS-based systemsNOMA
SS

Savio Sciancalepore

Assistant Professor at Eindhoven University of Technology
IoT SecurityMobile SecurityWireless Security
RM

Ricardo Mendes

Huawei Technologies Düsseldorf GmbH
Privacy-Preserving AILocation PrivacyUbiquitous Computing
AF

Ahmed Frikha

Cerebras Systems Inc.
Generative MLDomain GeneralizationContinual LearningMultimodal Learning
DK

Diego Kreutz

Federal University of Pampa (UNIPAMPA)
AutoML&XAI&AML for CybersecurityNetwork SecurityMalware & Attack DetectionBlockchains