Asymptotic theory and statistical inference for the samples problems with heavy-tailed data using the functional empirical process

📅 2025-12-07
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
Classical empirical processes fail under heavy-tailed or skewed distributions where moments (e.g., mean or variance) do not exist. To address this, we propose the trimmed functional empirical process (TFEP) framework, which relaxes the conventional finite-variance requirement. Under mild regularity conditions, TFEP converges weakly to a Gaussian process, enabling novel asymptotic theory for one-sample and two-sample hypothesis tests as well as confidence intervals. Our methodology integrates extreme-order-statistic trimming, functional empirical process analysis, and Monte Carlo simulation, supporting robust inference for trimmed means, variances, and their ratios. Empirical evaluations demonstrate that TFEP substantially outperforms classical functional empirical processes and normal approximation methods under Pareto and Cauchy distributions—yielding more accurate confidence interval coverage. We further validate its practical utility through application to real-world income data analysis.

Technology Category

Machine Learning: Calibration & Uncertainty QuantificationGame Theory and Economic Paradigms: Behavioral Game TheoryReasoning under Uncertainty: Other Foundations of Reasoning under Uncertainty

Application Category

Security and Privacy: Large-scale security measurementsGraph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphsWeb Mining and Content Analysis: Robustness and generalizability of Web mining methods
📝 Abstract
This paper introduces the Trimmed Functional Empirical Process (TFEP) as a robust framework for statistical inference when dealing with heavy-tailed or skewed distributions, where classical moments such as the mean or variance may be infinite or undefined. Standard approaches including the classical Functional Empirical Process (FEP), break down under such conditions, especially for distributions like Pareto, Cauchy, low degree of freedom Student-t, due to their reliance on finite-variance assumptions to guarantee asymptotic convergence. The TFEP approach addresses these limitations by trimming a controlled proportion of extreme order statistics, thereby stabilizing the empirical process and restoring asymptotic Gaussian behavior. We establish the weak convergence of the TFEP under mild regularity conditions and derive new asymptotic distributions for one-sample and twosample problems. These theoretical developments lead to robust confidence intervals for truncated means, variances, and their differences or ratios. The efficiency and reliability of the TFEP are supported by extensive Monte Carlo experiments and an empirical application to Senegalese income data. In all scenarios, the TFEP provides accurate inference where both Gaussian-based methods and the classical FEP break down. The methodology thus offers a powerful and flexible tool for statistical analysis in heavy-tailed and non-standard environments.
Problem

Research questions and friction points this paper is trying to address.

Develops robust inference for heavy-tailed data using trimmed empirical process
Addresses breakdown of classical methods under infinite variance conditions
Establishes weak convergence and asymptotic distributions for one- and two-sample problems
Innovation

Methods, ideas, or system contributions that make the work stand out.

Trimmed Functional Empirical Process for heavy-tailed data
Trimming extreme order statistics stabilizes empirical process
Enables robust inference with asymptotic Gaussian behavior
🔎 Similar Papers
2024-08-20IEEE Signal Processing LettersCitations: 1
A
Abdoulaye Camara
S
Saliou Diouf
M
Moumouni Diallo
G
Gane Samb Lo