🤖 AI Summary
This study addresses the degradation of posterior quality and predictive performance in practical Bayesian inference caused by data noise, high-dimensional strongly correlated parameters, and anomalous model outputs. To overcome these challenges, the authors embed Bayes’ theorem within a statistical mechanics framework and introduce a tempered posterior distribution governed by a temperature parameter τ. They propose, for the first time, the use of Wang–Landau sampling to estimate the posterior density of states. A single simulation run automatically identifies phase-transition-like signals to determine the optimal temperature, thereby eliminating the need for manual tuning or repeated computations. The method demonstrates remarkable efficacy in equation-of-state modeling in materials science, successfully handling high-dimensional correlated parameters and noisy, chaotic data while substantially improving inference accuracy and predictive capability.
📝 Abstract
We present a simple method to obtain optimal posterior distributions and improve the quality of Bayesian inference with reduced human and computational effort. Bayes' Theorem is reformulated in the language of statistical mechanics, wherein an improved posterior -- referred to as a tempered posterior -- is defined analogously to a canonical probability distribution at temperature $τ$. Wang-Landau sampling is used to obtain the density of states of the posterior probability, and signals analogous to those of phase transitions are extracted from a single simulation. In addition, the transition temperature is easily identified, providing the tempered posterior with optimal predictive performance. We demonstrate the efficacy of the method on a real-world problem in materials science (equation of state modeling) with messy data, a high-dimensional and correlated input parameter space, and "frustration" among model outputs.