Perturbation-based Inference for Extreme Value Index

📅 2025-12-09
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
To address unreliable extreme value index (EVI) inference caused by scarcity of tail data, this paper proposes a perturbation-based synthetic exceedance generation method: controlled noise is injected into exceedances above a high threshold, followed by generalized Pareto distribution (GPD) modeling and construction of a consistent pivotal statistic. Innovatively, the perturbation mechanism is integrated with differential privacy guarantees; when GPD approximation error is substantial, a refined perturbation strategy is further introduced to enhance robustness. Experiments demonstrate that the proposed method significantly outperforms existing EVI inference approaches in terms of confidence interval coverage, width control, and resilience to model misspecification. It establishes a novel paradigm for reliable extreme-value analysis under sparse tail regimes.

Technology Category

Machine Learning: Calibration & Uncertainty QuantificationReasoning under Uncertainty: Other Foundations of Reasoning under UncertaintyGame Theory and Economic Paradigms: Imperfect Information

Application Category

Security and Privacy: Large-scale security measurementsUser Modeling, Personalization and Recommendation: User privacy protection in personalized systemsEconomics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI
📝 Abstract
The extreme value index (EVI) characterizes the tail behavior of a distribution and is crucial for extreme value theory. Inference on the EVI is challenging due to data scarcity in the tail region. We propose a novel method for constructing confidence intervals for the EVI using synthetic exceedances generated via perturbation. Rather than perturbing the entire sample, we add noise to exceedances above a high threshold and apply the generalized Pareto distribution (GPD) approximation. Confidence intervals are derived by simulating the distribution of pivotal statistics from the perturbed data. We show that the pivotal statistic is consistent, ensuring the proposed method provides consistent intervals for the EVI. Additionally, we demonstrate that the perturbed data is differentially private. When the GPD approximation is inadequate, we introduce a refined perturbation method. Simulation results show that our approach outperforms existing methods, providing robust and reliable inference.
Problem

Research questions and friction points this paper is trying to address.

Estimates extreme value index with data scarcity
Constructs confidence intervals using perturbed exceedances
Ensures differential privacy in tail inference
Innovation

Methods, ideas, or system contributions that make the work stand out.

Perturbing exceedances above threshold for EVI inference
Using GPD approximation with synthetic data generation
Ensuring differential privacy in perturbed data analysis
Y
Yiwei Tang
Department of Statistics and Data Science, Fudan University
J
Judy Huixia Wang
Department of Statistics, Rice University
D
Deyuan Li
Department of Statistics and Data Science, Fudan University