Generalised Exponential Kernels for Nonparametric Density Estimation

2026-02-17

AI Summary

This study addresses the computational and analytical challenges posed by existing nonparametric kernel density estimators for positive continuous data—such as Gamma kernels—which rely on special functions. To overcome these limitations, we propose a novel kernel density estimator based on the generalized exponential (GE) distribution. This new estimator features a simple closed-form expression that avoids special functions while offering both modeling flexibility and theoretical tractability. We construct a second-kind GE kernel density estimator and establish, for the first time, that it achieves the optimal rate of convergence in mean integrated squared error. A detailed asymptotic bias–variance analysis explicitly characterizes its error orders. Numerical experiments demonstrate that the proposed method performs comparably to or better than existing approaches on both simulated and real-world data, providing an efficient and analytically amenable alternative for density estimation on the positive real line.

Technology Category

• Machine Learning: Kernel Methods
• Reasoning under Uncertainty: Graphical Models
• Search and Optimization: Non-convex Optimization

Application Category

• Graph Algorithms and Modeling for the Web: Algorithms and analysis for incomplete, noisy, or partially observed Web-related graphs
• Security and Privacy: Large-scale security measurements
• Economics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI

Abstract

This paper introduces a novel kernel density estimator (KDE) based on the generalised exponential (GE) distribution, designed specifically for positive continuous data. The proposed GE KDE offers a mathematically tractable form that avoids the use of special functions, for instance, distinguishing it from the widely used gamma KDE, which relies on the gamma function. Despite its simpler form, the GE KDE maintains similar flexibility and shape characteristics, aligning with distributions such as the gamma, which are known for their effectiveness in modelling positive data. We derive the asymptotic bias and variance of the proposed kernel density estimator, and formally demonstrate the order of magnitude of the remaining terms in these expressions. We also propose a second GE KDE, for which we are able to show that it achieves the optimal mean integrated squared error, something that is difficult to establish for the former. Through numerical experiments involving simulated and real data sets, we show that GE KDEs can be an important alternative and competitive to existing KDEs.

Problem

• kernel density estimation
• positive data
• nonparametric density estimation
• generalised exponential distribution
• special functions

Innovation

• generalised exponential kernel
• nonparametric density estimation
• positive data
• optimal MISE
• tractable kernel form