perform mcmc diagnostics

Designs and applies diagnostic procedures and quantitative tests to analyze Markov Chain Monte Carlo sampler behavior, including assessing chain convergence and mixing, computing effective sample sizes, and calculating convergence test statistics. Uses these analyses to estimate posterior bias and variance, diagnose non‑convergent behavior, and calibrate algorithm stopping and monitoring criteria.

performmcmcdiagnostics

Recent Skill Trend

Momentum and market value over time
Trending
Score
No comparison yet
0.05
Oct 01, 2026Oct 01, 2026
Career
Value
No comparison yet
$200K/year
Oct 01, 2026Oct 01, 2026

Must-Read Papers

Most classic and influential ideas
View more

The Traceplot Thickens: MCMC Diagnostics for Non-Euclidean Spaces

Aug 27, 2024
LD
Luke Duttweiler
🏛️ Harvard T.H. Chan School of Public Health | University of Rochester

Existing MCMC convergence diagnostics—such as trace plots, the Gelman–Rubin statistic, and effective sample size (ESS)—frequently fail or are ill-defined in discrete or non-Euclidean parameter spaces (e.g., Bayesian networks, Dirichlet process mixture models). To address this limitation, we propose a novel, generalized diagnostic paradigm: first, apply distance-preserving embedding to map the original space into the real line; then, reconstruct trace plots and adapt the Gelman–Rubin statistic and ESS estimation in the embedded space. This constitutes the first systematic framework for MCMC convergence assessment specifically designed for discrete and non-Euclidean parameter spaces, thereby overcoming the traditional reliance on continuous Euclidean geometry. Extensive simulation studies demonstrate that our method robustly detects convergence failures missed by standard diagnostics, significantly enhancing the reliability and diagnosability of MCMC inference in non-Euclidean models.

Creates method to handle discrete parameters in MCMC samplingDevelops convergence diagnostics for MCMC with varying dimensionsMaps sample space to real-line for effective convergence assessment

Digesting Gibbs Sampling Using R

Oct 17, 2024
MT
Mahdi Teimouri
🏛️ Gonbad Kavus University

Introductory teaching resources for Markov chain Monte Carlo (MCMC) methods—particularly Gibbs sampling—lack beginner-friendly, hands-on tools. Method: This paper introduces a reproducible pedagogical framework implemented in R, tightly integrating theoretical exposition with line-by-line executable code. Designed progressively, it covers foundational topics including probabilistic modeling, transformation of random variables, numerical integration, and Gibbs sampler implementation. Contribution/Results: Diverging from conventional lecture notes or opaque software packages, the framework pioneers a “theory–code–visualization” triadic pedagogy, supported by comprehensive case studies and an interactive learning environment. Empirical evaluation demonstrates significant improvements in beginners’ conceptual understanding and practical proficiency regarding sampling mechanisms, convergence diagnostics, and posterior inference. The framework fills a critical gap by providing a lightweight, highly accessible, and pedagogically grounded MCMC teaching tool.

Focusing on Gibbs sampling in statistical investigationsProviding a framework for implementing MCMC approachesRequiring basic calculus and statistics knowledge for users

This study addresses the limitation of standard MCMC diagnostics, which frequently misinterpret multimodal posteriors as sampling failures. To overcome this, it proposes a graph-theoretic convergence diagnostic framework that constructs a graph structure by computing between-chain R-hat values, thereby identifying groups of Markov chains exploring the same posterior mode. The method is implemented using Stan and the R package mcmcConvergenceGraph. As the first approach to leverage graph structures for distinguishing genuine multimodality from poor mixing, it prevents the penalizing misdiagnosis of multimodal posteriors. By providing both graphical and numerical summaries, the framework offers comprehensive diagnostic insights. Its effectiveness in accurately diagnosing multimodal behavior is validated through applications in regression and pharmacokinetic models.

Markov chain Monte CarloMCMC convergence diagnosticsmultimodal posteriors

Sequential Design with Posterior and Posterior Predictive Probabilities

Apr 01, 2025
LH
Luke Hagar
🏛️ McGill University | McGill University Health Centre

In Bayesian sequential trials, error rate evaluation relies on computationally expensive Monte Carlo simulations, hindering efficient optimization of sample size and decision thresholds. Method: This paper establishes, for the first time, analytical functional relationships between posterior and posterior predictive probabilities and sample size. Leveraging Bayesian decision theory and asymptotic analysis—combined with numerical fitting and error-rate inversion—the method enables precise error-rate assessment for any sample size using only two simulations, and rapidly identifies optimal design parameters. Contribution/Results: The approach drastically reduces computational cost while achieving error-rate control accuracy comparable to conventional simulation-based methods. In two real-world case studies, it attains exact error-rate calibration and accelerates design optimization by several orders of magnitude. This provides a scalable, verifiable, and highly efficient design paradigm for Bayesian adaptive trials.

Efficient error rate assessment for Bayesian sequential designsModeling probabilities as functions of sample sizeOptimal sample size determination using posterior probabilities

Estimating MCMC convergence rates using common random number simulation

Sep 27, 2023
SS
Sabrina Sixta
🏛️ University of Toronto

This work addresses the challenge of assessing convergence rates of Markov chain Monte Carlo (MCMC) algorithms. We propose a novel, computable upper bound on the Wasserstein distance between the current and stationary distributions, leveraging Common Random Numbers (CRN) in simulation. Our method is the first to systematically integrate CRN into MCMC convergence diagnostics: by coupling two chains driven by identical random inputs, it yields a tight, analytically tractable upper bound on the convergence rate. Theoretical analysis and empirical evaluation—across canonical Bayesian settings including variance-components models and James–Stein correlation models—demonstrate that the CRN-based bound substantially outperforms classical drift/minorization bounds in both tightness and practicality. Crucially, our bound is both theoretically grounded and computationally feasible, providing the first quantitative convergence criterion for MCMC practitioners. This advances MCMC diagnostics from qualitative heuristics toward rigorous, quantitative assessment.

Comparing CRN bounds with drift-minorization methodsEstimating MCMC convergence rates via CRN simulationUpper bounding Wasserstein distance using CRN averages

Latest Papers

What's happening recently
View more

This study addresses the limitation of traditional statistical process control, which emphasizes detecting historical shifts while neglecting the acceptability of the current process state. To overcome this, the authors propose a Bayesian sequential monitoring framework tailored for recoverable processes subject to parameter drift. By recursively computing the posterior probability that the process is in-control at the current time, the method shifts the monitoring focus toward real-time state assessment. The framework integrates time-to-failure modeling, Gaussian and binomial tracking, and multivariate data analysis within a unified Bayesian formulation. Demonstrated through simulation studies and an application to white wine quality data, the approach effectively identifies the current operational status of dynamic recoverable processes, significantly enhancing both monitoring accuracy and practical applicability.

Bayesian MonitoringDrifting ProcessesPhase II SPC

This work addresses the inefficiency and lack of a unified theoretical understanding of gradient-based MCMC methods when sampling from anisotropic and hierarchical posteriors. Starting from continuous-time dynamics, the authors systematically derive algorithms such as HMC, MALA, NUTS, and MAKLA through numerical discretization and Metropolis correction, establishing a cohesive theoretical framework. They introduce two key innovations: a globally whitened mass matrix and a stochastic step-size strategy, which together mitigate sampling difficulties arising from state-dependent curvature. The proposed approach substantially improves sampling efficiency and demonstrates superior convergence and stability in large-scale Bayesian inference and hierarchical models.

anisotropic targetsgradient-based MCMChierarchical posteriors

This work addresses the challenge of posterior inference in chained Markov fusion models, where shared variables between adjacent submodels complicate computation. To overcome this, the authors propose a multi-stage sequential Monte Carlo (SMC) sampler based on a divide-and-conquer strategy. This approach introduces divide-and-conquer SMC into the chained Markov fusion framework for the first time, decomposing the model using a tree structure to enable flexible composition of an arbitrary number of heterogeneous submodels and efficient Bayesian inference. Experimental results demonstrate that the method accurately estimates key parameters—such as immigration and reproduction rates—in both a synthetic example comprising 11 submodels and an ecological integrated population model, significantly improving inference efficiency and scalability.

Bayesian modelchained Markov meldingposterior inference

Traditional hybrid experimental designs struggle to robustly control the frequentist operating characteristics of Bayesian decisions under model misspecification and lack efficient sample size determination methods applicable to generalized posteriors. This work proposes a computationally efficient experimental design framework that requires simulations at only two sample sizes and leverages extrapolation modeling of posterior summary functions to infer performance across the entire sample size space. This approach enables identification of the minimal sample size and decision rule satisfying desired operating characteristics. It represents the first general and scalable method for sample size planning under generalized posteriors, substantially reducing computational burden while enhancing robustness to model misspecification. The method’s validity and broad applicability within Bayesian M-estimation–type experiments are demonstrated through the redesign of an adaptive clinical trial with time-to-event outcomes.

Bayesian decision proceduresexperimental designgeneralized posteriors

Hot Scholars

SS

Shonosuke Sugasawa

Faculty of Economics, Keio University
Bayesian statisticsHierarchical modelingSpatio-temporal statistics
DR

Daniel Rudolf

University of Passau
Monte Carlo methodsBayesian statisticsInformation-Based Complexity
ES

Emanuel Sommer

PhD Candidate @ muniq.ai lab | Department of Statistics, LMU Munich
(Bayesian) Deep LearningUncertainty QuantificationStatistics
PK

Prabhat Kumar

Professor, Computer Science and Engineering Department, National Institute of Technology Patna
Wireless Sensor NetworksInternet of ThingsSoftware EngineeringSocial Networks