Estimating Intractable Posterior Distributions through Gaussian Process regression and Metropolis-adjusted Langevin procedure

📅 2025-06-16
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
To address Bayesian calibration of complex systems under computationally expensive, data-sparse, or noisy conditions, this paper proposes a sequential surrogate modeling framework. It employs Gaussian process regression to progressively approximate the log-likelihood and its gradients, integrated with gradient-driven Metropolis-adjusted Langevin algorithm (MALA) sampling. We introduce an uncertainty-aware adaptive likelihood evaluation strategy that invokes the expensive true likelihood only in regions where the surrogate exhibits high predictive uncertainty and posterior sensitivity. This enables tight coupling between surrogate modeling and gradient-informed MCMC. Evaluated on synthetic benchmarks and a high-speed train parameter calibration case, the method scales to >20-dimensional parameter spaces, achieves significantly accelerated convergence, reduces computational cost by over 60%, and accurately recovers physically meaningful posterior distributions—even under missing-sensor conditions.

Technology Category

Machine Learning: Calibration & Uncertainty QuantificationReasoning under Uncertainty: Stochastic OptimizationSearch and Optimization: Sampling/Simulation-based Search

Application Category

User Modeling, Personalization and Recommendation: Explainable and interpretable methods for personalizationSearch and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for rankingGraph Algorithms and Modeling for the Web: Algorithms and analysis for incomplete, noisy, or partially observed Web-related graphs
📝 Abstract
Numerical simulations are crucial for modeling complex systems, but calibrating them becomes challenging when data are noisy or incomplete and likelihood evaluations are computationally expensive. Bayesian calibration offers an interesting way to handle uncertainty, yet computing the posterior distribution remains a major challenge under such conditions. To address this, we propose a sequential surrogate-based approach that incrementally improves the approximation of the log-likelihood using Gaussian Process Regression. Starting from limited evaluations, the surrogate and its gradient are refined step by step. At each iteration, new evaluations of the expensive likelihood are added only at informative locations, that is to say where the surrogate is most uncertain and where the potential impact on the posterior is greatest. The surrogate is then coupled with the Metropolis-Adjusted Langevin Algorithm, which uses gradient information to efficiently explore the posterior. This approach accelerates convergence, handles relatively high-dimensional settings, and keeps computational costs low. We demonstrate its effectiveness on both a synthetic benchmark and an industrial application involving the calibration of high-speed train parameters from incomplete sensor data.
Problem

Research questions and friction points this paper is trying to address.

Estimating intractable posterior distributions with noisy data
Reducing computational cost of expensive likelihood evaluations
Calibrating complex systems using incomplete sensor data
Innovation

Methods, ideas, or system contributions that make the work stand out.

Uses Gaussian Process Regression for likelihood approximation
Employs Metropolis-Adjusted Langevin Algorithm for posterior exploration
Selects informative locations to reduce computational costs
💼 Related Jobs
No related jobs found.
G
Guillaume Perrin
Universit´e Gustave Eiffel, COSYS, 14-20 Boulevard Newton, 77447 Marne-la-Vall´ee, France
R
Romain Jorge Do Marco
SNCF, DTIPG, 1-3 Av Fran¸cois Mitterrand, 93574 Saint-Denis, France
C
Christian Soize
Universit´e Gustave Eiffel, MSME UMR 8208 CNRS, 5 bd Descartes, Marne-la-Vall´ee, 77454, France
C
Christine Funfschilling
SNCF, DTIPG, 1-3 Av Fran¸cois Mitterrand, 93574 Saint-Denis, France