Detecting Conflicts in Evidence Synthesis Models Using Score Discrepancies

📅 2025-11-04
📈 Citations: 0
Influential: 0
📄 PDF

career value

190K/year
🤖 AI Summary
This study addresses structural conflicts—arising both among heterogeneous data sources and between data and model assumptions—in evidence synthesis models. We propose a general conflict detection framework based on score-based discrepancy measures. Methodologically, we extend prior–data conflict diagnostics to the latent space of hierarchical models, enabling inconsistency detection under multilevel and non-exchangeable structures; integrating Bayesian evidence synthesis, score-function-based metrics, and posterior simulation, our approach provides quantitative assessment of model assumption–data compatibility. Key contributions include: (1) moving beyond conventional bias diagnostics confined to the prior–likelihood level; (2) demonstrating high sensitivity to conflicts in both exchangeable and non-exchangeable models; and (3) exhibiting complementary diagnostic capability to existing methods in a real-world influenza severity model, thereby significantly enhancing the reliability of complex Bayesian inference.

Technology Category

Application Category

📝 Abstract
Evidence synthesis models combine multiple data sources to estimate latent quantities of interest, enabling reliable inference on parameters that are difficult to measure directly. However, shared parameters across data sources can induce conflicts both among the data and with the assumed model structure. Detecting and quantifying such conflicts remains a challenge in model criticism. Here we propose a general framework for conflict detection in evidence synthesis models based on score discrepancies, extending prior-data conflict diagnostics to more general conflict checks in the latent space of hierarchical models. Simulation studies in an exchangeable model demonstrate that the proposed approach effectively detects between-data inconsistencies. Application to an influenza severity model illustrates its use, complementary to traditional deviance-based diagnostics, in complex real-world hierarchical settings. The proposed framework thus provides a flexible and broadly applicable tool for consistency assessment in Bayesian evidence synthesis.
Problem

Research questions and friction points this paper is trying to address.

Detecting conflicts in evidence synthesis models
Quantifying inconsistencies between data sources
Extending conflict diagnostics to hierarchical models
Innovation

Methods, ideas, or system contributions that make the work stand out.

Score discrepancies detect conflicts in evidence synthesis
Extends prior-data conflict diagnostics to hierarchical models
Provides flexible tool for Bayesian consistency assessment
🔎 Similar Papers
No similar papers found.
F
Fuming Yang
MRC Biostatistics Unit, University of Cambridge, East Forvie Site, Robinson Way, Cambridge CB2 0SR, United Kingdom
D
David J. Nott
Department of Statistics and Data Science, Institute of Operations Research and Analytics, National University of Singapore, 117546, Singapore
A
A. Presanis
MRC Biostatistics Unit, University of Cambridge, East Forvie Site, Robinson Way, Cambridge CB2 0SR, United Kingdom