Reducing Calls to the Simulator in Simulation Based Inference (SBI)

πŸ“… 2025-04-16
πŸ“ˆ Citations: 0
✨ Influential: 0
πŸ“„ PDF
πŸ€– AI Summary
Likelihood-free inference (LFI) suffers from sample inefficiency when black-box simulators are computationally expensive. To address this, we propose an enhanced Sequential Neural Posterior Estimation (SNPE) framework. Our method introduces two key innovations: (i) integrating a Neural Density Estimator (NDE) as a differentiable likelihood surrogate within the SNPE pipeline, and (ii) adopting Support Points sampling to strategically select informative parameter configurations. This design substantially reduces simulator evaluations while preserving posterior estimation accuracy. Empirical evaluation across multiple benchmark tasks demonstrates that the NDE surrogate exhibits strong stability and generalization. Moreover, Support Points sampling achieves 30–50% fewer simulator calls in several tasksβ€”without degrading, and sometimes even improving, posterior quality. Our approach establishes a new paradigm for efficient Bayesian inference in high-cost simulation settings.

Technology Category

Search and Optimization: Sampling/Simulation-based SearchMachine Learning: Calibration & Uncertainty QuantificationReasoning under Uncertainty: Stochastic Optimization

Application Category

Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for rankingUser Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systemsSemantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
πŸ“ Abstract
Simulation-Based Inference (SBI) deals with statistical inference in problems where the data are generated from a system that is described by a complex stochastic simulator. The challenge for inference in these problems is that the likelihood is intractable; SBI proceeds by using the simulator to sample from the likelihood. In many real world applications, simulator calls are expensive, limiting the associated sample size. Our goal in this work is to extend SBI to exploit two proposals for reducing simulator calls: to draw likelihood samples from a Neural Density Estimator (NDE) surrogate rather than from the stochastic simulator; and use of Support Points rather than simple random sampling to generate evaluation sites. We embed these methods in the Sequential Neural Posterior Estimator (SNPE) algorithm. Across a suite of test cases, we find that the NDE surrogate improves the quality of the inference; support points worked well in some examples, but not in others.
Problem

Research questions and friction points this paper is trying to address.

Reducing expensive simulator calls in Simulation-Based Inference
Using Neural Density Estimator surrogate for likelihood sampling
Evaluating Support Points versus random sampling in SNPE algorithm
Innovation

Methods, ideas, or system contributions that make the work stand out.

Neural Density Estimator surrogate reduces simulator calls
Support Points optimize evaluation site sampling
Embedded in Sequential Neural Posterior Estimator algorithm
πŸ”Ž Similar Papers
D
David Refaeli
Department of Statistics and Operations Research, Tel-Aviv University
M
Mira Marcus-Kalish
Department of Statistics and Operations Research, Tel-Aviv University
D
David M. Steinberg
Department of Statistics and Operations Research, Tel-Aviv University