Surrogate-Based Bayesian Inference: Uncertainty Quantification and Active Learning

📅 2026-03-13
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This work addresses the challenge of performing Bayesian inference in high-computational-cost settings, where standard approaches are often infeasible and existing surrogate modeling methods frequently neglect uncertainty propagation and workflow integration. The paper introduces the first unified framework that systematically integrates surrogate modeling, Bayesian inference, uncertainty quantification, and active learning. By co-designing surrogate uncertainty modeling with sequential optimization mechanisms, the framework enables an efficient and robust inference pipeline. It synthesizes previously fragmented research across multiple domains into a coherent methodology, offering practitioners and method developers a clear, actionable surrogate-based Bayesian workflow that substantially enhances both the reliability and efficiency of inference in expensive simulation scenarios.

Technology Category

Reasoning under Uncertainty: Probabilistic InferenceSearch and Optimization: Sampling/Simulation-based SearchMachine Learning: Calibration & Uncertainty Quantification

Application Category

User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systemsGraph Algorithms and Modeling for the Web: Algorithms and analysis for incomplete, noisy, or partially observed Web-related graphsSystems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications
📝 Abstract
Surrogate models - also called emulators - are widely used to facilitate Bayesian inference in settings where computational costs preclude the use of standard posterior inference algorithms. Their deployment is now standard practice across many scientific domains. However, integrating surrogates in statistical analyses introduces unique challenges that complicate established Bayesian workflow principles. While significant progress has been made in addressing these issues, the relevant developments are scattered across several distinct research communities, with different emphases and perspective. We present a unifying review that synthesizes the literature into a coherent framework, aiming to benefit both practitioners and methods developers. We place particular emphasis on propagating surrogate uncertainty and sequentially refining emulators via active learning, two key components of a robust surrogate-based Bayesian workflow.
Problem

Research questions and friction points this paper is trying to address.

Surrogate models
Bayesian inference
Uncertainty quantification
Active learning
Emulators
Innovation

Methods, ideas, or system contributions that make the work stand out.

Surrogate models
Bayesian inference
Uncertainty quantification
Active learning
Emulator refinement
🔎 Similar Papers
2024-05-02International Conference on Machine LearningCitations: 5
A
Andrew Gerard Roberts
Faculty of Computing and Data Sciences, Boston University
M
Michael C. Dietze
Department of Earth and Environment, Boston University
J
Jonathan H. Huggins
Department of Mathematics and Statistics, Boston University