Generating Chest X-Ray Counterfactuals by Specialising Foundation Image Models

2026-09-21

AI Summary

本文提出一种数据和参数高效的方法，通过专业化预训练的非因果生成模型来解决胸部X光片反事实生成问题，提高反事实推理的准确性。

Abstract

Counterfactual image generation answers questions about how a subject would have looked under retrospective, hypothetical scenarios. Recent methods have improved perceptual quality, identity preservation and faithfulness to an underlying causal model, but their adoption in healthcare is limited by scarce annotated data, distribution shift between datasets, and mismatches between pretrained generative models and those required for counterfactual inference. We propose specialisation, a data and parameter-efficient framework for adapting pretrained, non-causal generative models into causal mechanisms under distribution shift. Based on this framework, we train a radiology counterfactual image generation model, called RadCF, using latent flow matching. We validate our approach on three chest X-ray datasets spanning different dataset shifts, data volumes, and counterfactual questions, associated with challenging, highly-localised interventions. Our results show that RadCF and specialisation improve counterfactual soundness over existing methods while being data and parameter efficient, and that the resulting counterfactuals can detect and mitigate shortcut learning in a downstream medical classifier. Code is available at https://github.com/GSK-AI/RadCF/.

Problem

• counterfactual image generation
• chest X-ray
• distribution shift
• annotated data

Innovation

• specialisation
• counterfactual image generation
• latent flow matching
• distribution shift