New flexible versions of extended generalized Pareto model for count data

📅 2024-09-27
📈 Citations: 1
✨ Influential: 0
📄 PDF
🤖 AI Summary
Existing discrete distributions—such as Poisson, negative binomial, and their zero-inflated variants—struggle to model heavy-tailed integer-valued data, while the discrete generalized Pareto distribution (DGPD) suffers from sensitivity to high threshold selection and reliance on asymptotic tail approximations. To address these limitations, this paper proposes three flexible extensions of the DGPD: a full-support variant, a zero-inflated full-support variant, and a low-threshold tail-focused variant. Built upon a generalized Pareto discretization framework, these models integrate zero-inflation mechanisms and parameter-tunable structures, thereby eliminating dependence on arbitrary threshold choices and asymptotic assumptions. Parameter estimation is performed via maximum likelihood, and extensive simulation studies alongside real-data experiments demonstrate substantial improvements in overall goodness-of-fit and tail characterization. Across three benchmark scenarios, the proposed models reduce average estimation error by 18%–32% relative to standard baselines, consistently outperforming existing approaches.

Technology Category

Reasoning under Uncertainty: Relational Probabilistic ModelsSearch and Optimization: Mixed Discrete/Continuous SearchConstraint Satisfaction and Optimization: Mixed Discrete/Continuous Optimization

Application Category

Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphsUser Modeling, Personalization and Recommendation: Practical large-scale studies of user experienceWeb Mining and Content Analysis: Models for Web evolution
📝 Abstract
Accurate modeling is essential in integer-valued real phenomena, including the distribution of entire data, zero-inflated (ZI) data, and discrete exceedances. The Poisson and Negative Binomial distributions, along with their ZI variants, are considered suitable for modeling the entire data distribution, but they fail to capture the heavy tail behavior effectively alongside the bulk of the distribution. In contrast, the discrete generalized Pareto distribution (DGPD) is preferred for high threshold exceedances, but it becomes less effective for low threshold exceedances. However, in some applications, the selection of a suitable high threshold is challenging, and the asymptotic conditions required for using DGPD are not always met. To address these limitations, extended versions of DGPD are proposed. These extensions are designed to model one of three scenarios: first, the entire distribution of the data, including both bulk and tail and bypassing the threshold selection step; second, the entire distribution along with ZI; and third, the tail of the distribution for low threshold exceedances. The proposed extensions offer improved estimates across all three scenarios compared to existing models, providing more accurate and reliable results in simulation studies and real data applications.
Problem

Research questions and friction points this paper is trying to address.

Modeling entire integer-valued data distributions with heavy tails
Addressing zero-inflated data in discrete exceedance scenarios
Improving low-threshold exceedance predictions without asymptotic constraints
Innovation

Methods, ideas, or system contributions that make the work stand out.

Extended DGPD models entire data distribution
New versions handle zero-inflated data effectively
Improved tail estimation for low thresholds
💼 Related Jobs
No related jobs found.
University of Rennes | Allama Iqbal Open University
T
Touqeer Ahmad
CREST, ENSAI, University of Rennes, France
I
I. Arshad
Department of Statistics, Faculty of Sciences, Allama Iqbal Open University, H-8/4, Islamabad, 44000, Pakistan