Counterfactual Generation via Flow Matching: Coupling-Sensitive End-to-End Rates

📅 2026-10-01
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the problem of generating counterfactual outcomes under hypothetical interventions from observational data. To this end, it proposes a flow matching framework that integrates doubly robust training with coupling learning to enable end-to-end counterfactual generation, while introducing Gaussian smoothed interpolation and stochastic samplers to enhance inference efficiency. Theoretically, the work establishes a coupling-sensitive KL error bound, demonstrating its dependence on displacement moments rather than global regularity, and provides finite-step convergence guarantees. Empirically, experiments on synthetic and image benchmarks validate these theoretical findings, revealing that stochastic samplers significantly outperform deterministic ODE samplers under limited computational budgets.
📝 Abstract
Counterfactual generation seeks to sample outcomes under a hypothetical intervention or decision using observational data collected under the factual assignment mechanism. We develop a flow-matching approach that combines a sample-split, doubly robust training objective with a learned coupling between observed source outcomes and target outcomes drawn from a fitted conditional outcome model. To enable finite-step generation, we leverage a score-corrected stochastic sampler based on a Gaussian-smoothed interpolation. Our main theoretical contribution is a coupling-sensitive KL bound for constant-step Euler discretization: the error is controlled by moments of the source--target displacement under the chosen coupling, rather than by global uniform regularity of the velocity field, and has near-linear dependence on the ambient dimension. We also establish finite-sample non-parametric guarantees for the learned velocity and score fields when both the conditional outcome model and the source-target coupling are estimated from data. These bounds separate approximation, coupling-replacement, nuisance-estimation, generalization, and Monte Carlo errors and, combined with the sampler analysis, yield an end-to-end guarantee for counterfactual generation. Experiments on synthetic and semi-synthetic image benchmarks support the coupling-dependent theory and show that, at finite discretization budgets, the stochastic sampler can outperform the corresponding deterministic ODE sampler.
Problem

Research questions and friction points this paper is trying to address.

Counterfactual Generation
Flow Matching
Causal Inference
Coupling-Sensitive Error Bound
Innovation

Methods, ideas, or system contributions that make the work stand out.

Counterfactual Generation
Flow Matching
Coupling-Sensitive KL Bound
Score-Corrected Stochastic Sampler
Doubly Robust Training
🔎 Similar Papers
2024-03-29arXiv.orgCitations: 4
2024-08-21BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLPCitations: 1
💼 Related Jobs
No related jobs found.
Y
Yunrui Guan
Department of Applied Mathematics and Statistics, Johns Hopkins University
Krishnakumar Balasubramanian
Krishnakumar Balasubramanian
University of California, Davis
StatisticsOptimizationMachine learning
S
Shiva Prasad Kasiviswanathan
Amazon