Towards Semiparametric Bandwidth Selectors for Kernel Density Estimators

2026-02-13

AI Summary

Bandwidth selection in kernel density estimation is often hindered by either insufficient flexibility of nonparametric methods or overly restrictive normality assumptions. This work proposes a semiparametric bandwidth selection framework that builds upon the normal reference rule and incorporates a small number of data-driven correction coefficients via Hermite series expansion, enabling flexible adjustment of the bandwidth. The approach preserves the structural benefits of the normal prior while significantly improving adaptability to the actual data distribution. Theoretical analysis demonstrates that the proposed correction form enjoys favorable asymptotic properties, thereby providing a solid foundation for subsequent algorithmic implementation and numerical validation.

Technology Category

• Machine Learning: Kernel Methods
• Search and Optimization: Non-convex Optimization
• Reasoning under Uncertainty: Graphical Models

Application Category

• Semantics and Knowledge: Methods, algorithms and applications for the development of semantic models, knowledge graphs and other forms of structured data models with machine-interpretable semantics
• Graph Algorithms and Modeling for the Web: Algorithms and analysis for incomplete, noisy, or partially observed Web-related graphs
• Security and Privacy: Large-scale security measurements

Abstract

There is an intense and partly recent literature focussing on the problem of selecting the bandwidth parameter for kernel density estimators. Available methods are largely `very nonparametric', in the sense of not requiring any knowledge about the underlying density, or `very parametric', like the normality-based reference rule. This report aims at widening the scope towards the inclusion of many semiparametric bandwidth selectors, via Hermite type expansions aroundthe normal distribution. The resulting bandwidths may be seen as carrying out suitable corrections on the normal reference rule, requiring a low number of extra coefficients to be estimated from data. The present report introduces and discusses some basic ideas and develops the necessary initial theory, but modestly chooses to stop short of giving precise recommendations for specific procedures among the many possible constructions. This will require some further analysis, numerical work, and some simulation-based exploration.

Problem

• bandwidth selection
• kernel density estimation
• semiparametric methods
• Hermite expansions
• normal reference rule

Innovation

• semiparametric bandwidth selection
• kernel density estimation
• Hermite expansion
• normal reference rule
• bandwidth correction