Score
Designs and implements methods, models, and tools to estimate, represent, propagate, and visualize predictive uncertainty—including posterior, epistemic, and aleatoric components—using probabilistic (Bayesian, ensembles, conformal) and non‑probabilistic techniques, as well as online and post‑hoc estimators and uncertainty sampling. Builds evaluation and calibration procedures, metrics and benchmarks to quantify coverage and reliability (e.g., nonconformity scores, calibration and weighting schemes), to flag or abstain on high‑uncertainty cases, and to combine or aggregate multiple uncertainty sources.
This work addresses the challenge of entangled uncertainty sources and the difficulty of disentangling pointwise statistical risk in predictive modeling. We propose a unified generative framework based on approximate Bayesian inference that, for the first time, establishes an explicit, interpretable decomposition linking pointwise statistical risk to two fundamental uncertainty types: aleatoric uncertainty (arising from inherent data noise) and epistemic uncertainty (stemming from model ignorance). The framework jointly generates multiple uncertainty measures while ensuring semantic consistency across them. Experiments on image benchmarks demonstrate significant improvements in out-of-distribution detection and misclassification identification, achieving higher AUROC scores compared to existing methods. Our approach thus provides robust, quantifiable uncertainty estimates essential for downstream uncertainty-aware tasks such as active learning, safe decision-making, and model debugging.
This study addresses the computational bottleneck in evaluating the calibration of nested uncertainty sets within expensive simulation models. To overcome this limitation, the work proposes an efficient calibration assessment method grounded in a Bayesian framework and the Dirichlet-Multinomial model. By exploiting the nested structure, the approach directly processes interval outputs without requiring access to the full predictive distribution. Furthermore, it incorporates Bayes factor testing for statistical inference, substantially reducing the number of independent simulations needed. The proposed method successfully detects model miscalibration in data assimilation tasks under limited simulation budgets. Overall, this work significantly lowers computational costs while demonstrating both the effectiveness and practical utility of the proposed approach for calibrating complex simulation systems.
This study addresses the quantification of sources of predictive uncertainty and their contributions to prediction interval width. Building upon the law of total variance, the work proposes several conservative decompositions of posterior predictive variance, systematically characterizing the components of uncertainty and their interdependencies through conditional expectation and conditional variance terms. Experimental evaluations across multiple canonical models demonstrate that the proposed approach effectively identifies the dominant sources of uncertainty and reveals coherent patterns of co-variation among decomposition terms. These insights offer a novel perspective for model assessment and refinement, enhancing interpretability and guiding targeted improvements in predictive reliability.
本文综述了时间序列和时空数据的概率预测方法,通过统一视角组织不同引入不确定性的预测手段,对比分析了多种模型的有效性和效率。
本文提出一种基于三向假设检验的框架,用于量化模拟基础推理中的认知校准不确定性,并评估必要的模拟预算。
This study addresses the persistent challenges of inadequate statistical coverage and inaccurate uncertainty quantification in existing AI-based weather forecasting models, particularly during extreme events. It introduces, for the first time, an online conformal prediction framework that makes no distributional assumptions to post-process outputs from three leading global probabilistic AI models—GenCast, NeuralGCM, and AIFS-ENS. The proposed method significantly improves the statistical coverage accuracy of temperature and precipitation forecasts, including extreme events, without compromising other probabilistic performance metrics. By providing mathematically rigorous uncertainty guarantees, this approach enables reliably calibrated AI-driven weather predictions.
This study addresses the common conflation of epistemic uncertainty (EU) and aleatoric uncertainty (AU) in existing wind power forecasting methods, which undermines decision reliability. Building upon the law of total variance, the authors propose a unified framework combining heteroscedastic neural networks with Bayesian posterior approximation to explicitly disentangle total predictive uncertainty into its AU and EU components. A β-negative log-likelihood (β-NLL) loss is introduced to balance mean and variance learning. The work presents the first evaluation framework for uncertainty disentanglement in wind power prediction that operates without ground-truth uncertainty labels. Through synthetic experiments, data attribute analysis, and scaling studies, the approach demonstrates theoretically consistent responses of AU and EU to noise structure, distribution shifts, and training set size on both synthetic and real-world SCADA data, validating its theoretical soundness and practical utility.
本文针对条件均值的校准点预测问题,利用共形预测开发了校准置信区间方法,提供不确定性量化,并通过模拟和保险数据集验证了方法的有效性。
This study addresses the challenges of inaccurate uncertainty quantification and insufficient coverage of confidence sets in predictive resampling by proposing a bagged martingale posterior method. This approach integrates Bayesian inference, bootstrap techniques, and high-dimensional quantile modeling to achieve conservative calibration by initiating predictive paths from random bootstrap samples and aggregating the results. Its core innovation lies in substantially improving calibration accuracy without additional simulation costs, thereby overcoming the reliance of conventional methods on algorithmic tuning. Experimental results demonstrate that the proposed method delivers computationally efficient and conservatively calibrated uncertainty quantification in complex scenarios, such as sparse high-dimensional regression.
本文提出一种通过概率积分变换和最大均值差异消除重采样噪声的方法,解决了混合不确定性下的模型更新问题,并采用TMCMC进行后验推断。