🤖 AI Summary
This study addresses the limited interpretability of the Brier score in diagnosing deficiencies in probabilistic forecasts by proposing an algebraic rearrangement based on Yates’ covariance decomposition. The method cleanly decomposes the Brier score into three non-negative components: variance mismatch, insufficient correlation, and overall calibration bias. This decomposition is not only mathematically concise but also highly interpretable, explicitly revealing that perfect prediction requires simultaneous satisfaction of three conditions: matched variances, perfect positive correlation, and agreement in means. By elucidating the distinct sources of forecast error, the approach substantially enhances the diagnostic capability for evaluating probabilistic predictions and provides both a theoretical foundation and a practical tool for improving predictive models.
📝 Abstract
Proper scoring rules are essential for evaluating probabilistic forecasts. We propose a simple algebraic rearrangement of the Yates covariance decomposition of the Brier score into three independently non-negative terms: a variance mismatch term, a correlation deficit term, and a calibration-in-the-large term. This rearrangement makes the optimality conditions for perfect forecasting transparent: the optimal forecast must simultaneously match the variance of outcomes, achieve perfect positive correlation with outcomes, and match the mean of outcomes. Any deviation from these conditions results in a positive contribution to the Brier score.