direct parameter sampling

Design and implement procedures that produce direct draws of model parameters by sampling from their conditional or marginal posterior distributions rather than iterating Markov chains, using analytic factorization, conjugate conditional forms (e.g., Normal–Inverse–Gamma), inversion or the method of composition, and handling any parameter constraints during sampling.

directparametersampling

Recent Skill Trend

Momentum and market value over time
Trending
Score
No comparison yet
-0.31
Oct 01, 2026Oct 01, 2026
Career
Value
No comparison yet
$200K/year
Oct 01, 2026Oct 01, 2026

Must-Read Papers

Most classic and influential ideas
View more

This work addresses the computational inefficiency in Bayesian semiparametric regression arising from complex design matrix structures. To mitigate this challenge, the authors propose an orthogonalization preprocessing step applied to the design日晚间 matrix prior to iterative inference, combined with a hybrid algorithm integrating Gibbs sampling and coordinate ascent variational inference. This approach reduces computational complexity to quadratic in the number of covariates, substantially accelerating both model fitting and posterior inference. Empirical evaluations across diverse experimental settings demonstrate speedups ranging from 5× to 60× compared to conventional methods, effectively alleviating the computational bottleneck induced by high-dimensional covariates.

Bayesian semiparametric regressioncomputational speed-upGibbs sampling

Conditional sampling within generative diffusion models

Sep 15, 2024
ZZ
Zheng Zhao
🏛️ Uppsala University

This work addresses the challenge of conditional sampling in generative diffusion models for Bayesian inverse problems. It systematically surveys and unifies two dominant paradigms: end-to-end methods based on the joint distribution, and decoupled approaches combining a pre-trained marginal distribution with an explicit likelihood model. We propose, for the first time, a theoretically consistent unified framework that integrates Monte Carlo sampling, diffusion process reweighting, conditional probability construction, and fine-tuning techniques—rigorously characterizing the underlying assumptions and intrinsic relationships among these methods. The framework bridges theoretical gaps across disparate conditional generation strategies and delivers a scalable, interpretable, and theoretically grounded toolkit for conditional sampling in scientific computing inverse problems, including image reconstruction and physics-based simulation.

addressing Bayesian inverse problemsconditional sampling in generative modelsleveraging joint and marginal distributions

Exact Sampling of Gibbs Measures with Estimated Losses

Apr 24, 2024
DF
David Frazier
🏛️ Monash University | University College London | Queensland University of Technology

This work addresses the slow MCMC convergence in Gibbs posterior sampling under stochastic loss functions, which stems from spurious dependence on the number of pseudo-observations. We propose the first pseudo-sample-size–independent corrected piecewise deterministic Markov process (PDMP) sampler. By designing a novel jump-rate function and direction mechanism, our method rigorously ensures that the invariant measure remains invariant to the pseudo-observation count—thereby overcoming the inherent trade-off between asymptotic bias and slow convergence in conventional stochastic-loss inference. We prove that the sampler converges exactly to the target Gibbs posterior measure with a uniform convergence rate independent of pseudo-sample size. Empirical validation across three canonical settings—likelihood-intractable models, misspecified models, and stochastic losses—demonstrates elimination of pseudo-sample-size bias in posterior sampling, alongside substantial improvements in robustness and estimation accuracy.

Addressing slow convergence in Gibbs measures with estimated lossesImproving inference for intractable likelihoods and model misspecificationReducing pseudo-observation dependence in MCMC posterior sampling

Conditional Stochastic Interpolation for Generative Learning

Dec 09, 2023
DH
Ding Huang
🏛️ The Hong Kong Polytechnic University

This work addresses weak interpolation controllability and training instability in conditional generation. We propose Conditional Stochastic Interpolation (CSI), a framework that enables differentiable and controllable transport from a reference distribution to a target conditional distribution by modeling conditional probability flows or stochastic differential equations (SDEs). Key contributions include: (i) the first explicit formulation of the conditional drift and score function as conditional expectations; (ii) an adaptive diffusion term that enhances training stability; (iii) a non-asymptotic error bound guaranteeing convergence and generalization; and (iv) support for parameter-free regression estimation, deterministic ODE sampling, and adaptive-diffusion sampling. Extensive experiments on standard image datasets demonstrate high-quality, high-fidelity conditional generation. The method combines theoretical rigor—grounded in conditional probability flow theory—with practical effectiveness, offering improved controllability, stability, and flexibility over existing approaches.

Addressing diffusion process instability with adaptive termEstimating probability flow equations for conditional samplingLearning conditional distributions via stochastic interpolation method

Latest Papers

What's happening recently
View more

Traditional inverse design methods are limited to point-wise target outputs and struggle to accommodate design requirements expressed as target distributions. This work formalizes, for the first time, the distribution-level inverse design problem and introduces a new paradigm termed Conditional Distribution Matching (CDM), defining two task variants: CDMS and CDMO. The authors propose MLGD-F, a plug-and-play inference algorithm that efficiently solves these tasks without additional training. MLGD-F leverages a pre-trained score-based diffusion model combined with a single-step conditional sampler, using a matching loss to guide gradient updates. The method successfully recovers inputs whose outputs align with complex target distributions—including discrete mixtures and continuous low-rank supports—demonstrating effectiveness across synthetic data, structured image transformation, and generative editing tasks.

Conditional Distribution MatchingDistributional TargetGenerative Modeling

Traditional hybrid experimental designs struggle to robustly control the frequentist operating characteristics of Bayesian decisions under model misspecification and lack efficient sample size determination methods applicable to generalized posteriors. This work proposes a computationally efficient experimental design framework that requires simulations at only two sample sizes and leverages extrapolation modeling of posterior summary functions to infer performance across the entire sample size space. This approach enables identification of the minimal sample size and decision rule satisfying desired operating characteristics. It represents the first general and scalable method for sample size planning under generalized posteriors, substantially reducing computational burden while enhancing robustness to model misspecification. The method’s validity and broad applicability within Bayesian M-estimation–type experiments are demonstrated through the redesign of an adaptive clinical trial with time-to-event outcomes.

Bayesian decision proceduresexperimental designgeneralized posteriors

This study addresses the scalability and statistical validity bottlenecks in likelihood approximation and inference for complex simulation models by proposing a novel framework based on aggregated normalizing flow chains. Methodologically, it integrates information-theoretic formalization with sequential decision-making paradigms to construct flexible probability distributions through the sequential optimization of bijective transformation parameters. Furthermore, an empirical likelihood estimator under moment constraints is employed to iteratively update and aggregate the global flow parameters. This research establishes a surrogate model that simultaneously ensures computational feasibility and statistical power, enabling efficient parameter exploration, hypothesis testing, and uncertainty quantification. Ultimately, the proposed approach provides a reliable Bayesian inference solution for complex systems.

complex simulation modelslikelihood approximationnormalizing flows

Hot Scholars

RD

Reuben Dorent

Inria
Machine LearningDeep LearningMedical Image Analysis
JN

Jack Nugent

PhD Student, Princeton University
Computer Vision
RS

Raimondo Schettini

University of Milano Bicocca
color imagingartificial visionartificial intelligenceimage understanding
AZ

Andreas Zell

Professor für Informatik, Universität Tübingen
RobotikBioinformatikMaschinelles LernenKünstliche Intelligenz