🤖 AI Summary
To address insufficient uncertainty quantification in data bias correction, this paper proposes Selective Bandwidth Kernel Density Estimation (SB-KDE), a multivariate KDE method. SB-KDE introduces a novel learnable selective KDE factor that jointly controls the scale and shape of multidimensional kernel functions. An adaptive bandwidth selection mechanism is incorporated, jointly optimizing bandwidth via two complementary criteria: Mean Conditional Squared Error (MCSE), which prioritizes correction accuracy by minimizing RMSE, and Least-Squares Cross-Validation (LSCV), which ensures overall probability density function (PDF) fidelity. Uncertainty in bias correction is explicitly modeled through the conditional PDF’s expectation and its associated confidence intervals. Extensive experiments on both synthetic and real-world datasets demonstrate that SB-KDE significantly outperforms conventional non-selective KDE methods, achieving simultaneous improvements in correction accuracy and uncertainty characterization.
📝 Abstract
This paper presents an intuitive application of multivariate kernel density estimation (KDE) for data correction. The method utilizes the expected value of the conditional probability density function (PDF) and a credible interval to quantify correction uncertainty. A selective KDE factor is proposed to adjust both kernel size and shape, determined through least-squares cross-validation (LSCV) or mean conditional squared error (MCSE) criteria. The selective bandwidth method can be used in combination with the adaptive method to potentially improve accuracy. Two examples, involving a hypothetical dataset and a realistic dataset, demonstrate the efficacy of the method. The selective bandwidth methods consistently outperform non-selective methods, while the adaptive bandwidth methods improve results for the hypothetical dataset but not for the realistic dataset. The MCSE criterion minimizes root mean square error but may yield under-smoothed distributions, whereas the LSCV criterion strikes a balance between PDF fitness and low RMSE.