Machine Learning for Stress Testing: Uncertainty Decomposition in Causal Panel Prediction

πŸ“… 2026-03-08
πŸ“ˆ Citations: 0
✨ Influential: 0
πŸ“„ PDF
πŸ€– AI Summary
This study addresses the causal inference challenges in credit loss forecasting for regulatory stress testing by proposing a causal panel prediction framework that explicitly separates components learnable from data from those reliant on untestable confounding assumptions. The approach integrates iterative regression, path-conditioned mean identification, causal set identification under bounded confounding, and recursive error analysis with importance-weighted conformal calibration to decompose predictive uncertainty into three interpretable layers. It innovatively disentangles estimation uncertainty from confounding uncertainty, yielding actionable outputs including robustness metrics, extrapolation cost diagnostics, an automatic abstention mechanism, and time-domain reliability bounds. The framework’s effectiveness and practical utility are validated through simulations and semi-synthetic experiments based on real unemployment data, including retrospective analyses of extreme scenarios such as the COVID-19 pandemic.

Technology Category

Machine Learning: Calibration & Uncertainty QuantificationReasoning under Uncertainty: CausalityPlanning, Routing, and Scheduling: Planning under Uncertainty

Application Category

Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for rankingResponsible Web: Machine-in-the-loop, human agency and autonomyEconomics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI
πŸ“ Abstract
Regulatory stress testing requires projecting credit losses under hypothetical macroeconomic scenarios -- a fundamentally causal question typically treated as a prediction problem. We propose a framework for policy-path counterfactual inference in panels that transparently separates what can be learned from data from what requires assumptions about confounding. Our approach has four components: (i) observational identification of path-conditional means via iterated regression, enabling continuous macro-path contrasts without requiring a control group; (ii) causal set identification under bounded confounding, yielding sharp identified sets with interpretable breakdown values that communicate robustness in a single number; (iii) an oracle inequality showing that recursive rollout error is governed by a horizon-dependent amplification factor, providing a concrete answer to how far ahead one can reliably predict under stress; and (iv) importance-weighted conformal calibration bands with diagnostics that quantify extrapolation cost and trigger abstention when coverage guarantees degrade. The final output is a three-layer uncertainty decomposition that cleanly separates estimation uncertainty from confounding uncertainty. We validate all results through simulation and semi-synthetic experiments with real unemployment data, including a Covid retrospective demonstrating the framework's diagnostic value under extreme scenarios.
Problem

Research questions and friction points this paper is trying to address.

stress testing
causal inference
uncertainty decomposition
panel data
counterfactual prediction
Innovation

Methods, ideas, or system contributions that make the work stand out.

causal panel prediction
uncertainty decomposition
counterfactual inference
conformal calibration
bounded confounding
πŸ”Ž Similar Papers
No similar papers found.
Y
Yu Wang
Independent Researcher
X
Xiangchen Liu
Department of Family and Consumer Sciences, California State University, Long Beach
S
Siguang Li
Society Hub, Hong Kong University of Science and Technology (Guangzhou)