Learning Causal Normalizing Flows from Incomplete Data via Observed-Data Likelihood

πŸ“… 2026-09-29
πŸ“ˆ Citations: 0
✨ Influential: 0
πŸ“„ PDF
πŸ€– AI Summary
This study addresses the limitation that training causal normalizing flows typically requires complete data, rendering them difficult to apply directly to datasets with missing values. To overcome this, we propose MissCNF, a model trained by maximizing the marginal likelihood of observed data without imputation or sample discarding. Leveraging an autoregressive structure, it integrates out missing variables exclusively within their ancestral closure. Furthermore, we introduce a "causal family positivity" condition to ensure distributional identifiability under extreme missingness, accommodating MCAR, MAR, and MNAR mechanisms. Empirically, MissCNF significantly outperforms conventional methods in KL divergence and counterfactual error under nonlinear settings while maintaining state-of-the-art performance in linear scenarios, demonstrating robustness even with up to 90% missing data.
πŸ“ Abstract
Causal Normalizing Flows (CNFs) enable causal inference from observational data given the causal structure, but they assume fully observed training data. We introduce MissCNF, which trains CNFs directly on incomplete data by maximizing the marginal likelihood of each partially observed sample, without discarding rows or constructing a completed dataset. Thanks to the causal structure encoded in the autoregressive factorization of CNFs, only missing variables in the ancestral closure of the observed set are integrated out, while the others are dropped without computation. We further establish the conditions under which MissCNF recovers the true joint distribution, and introduce \emph{causal-family positivity}, where identification is possible even when no record in the dataset is ever complete. We compare MissCNF with two common strategies for handling missing data: listwise deletion and impute-then-fit pipelines. Across eight synthetic causal benchmarks, three missingness mechanisms, and missing rates up to $90\%$, MissCNF achieves the lowest KL divergence in 23 of 24 nonlinear MCAR and MAR settings and in all nonlinear MNAR settings, as well as the lowest counterfactual error in 20 of 24 settings. On linear SCMs, where linear imputation performs best, MissCNF ranks in the top two in 22 of 24 settings.
Problem

Research questions and friction points this paper is trying to address.

Causal Normalizing Flows
Incomplete Data
Causal Inference
Missing Data
Observed-Data Likelihood
Innovation

Methods, ideas, or system contributions that make the work stand out.

Causal Normalizing Flows
Incomplete Data
Observed-Data Likelihood
Marginal Likelihood
Causal-Family Positivity
πŸ”Ž Similar Papers
2024-02-09International Conference on Machine LearningCitations: 4
πŸ’Ό Related Jobs
No related jobs found.
T
Trung-Dung Hoang
Department of Digital Medicine, University of Bern, Switzerland; Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism (UDEM), Inselspital, Bern University Hospital, University of Bern, Switzerland; Graduate School for Cellular and Biomedical Sciences (GCB), University of Bern, Switzerland; Diabetes Center Berne, Switzerland
Alceu Bissoto
Alceu Bissoto
University of Bern
domain generalizationmedical imagingbiases
T
Tim FlΓΌhmann
Department of Digital Medicine, University of Bern, Switzerland; Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism (UDEM), Inselspital, Bern University Hospital, University of Bern, Switzerland; Graduate School for Cellular and Biomedical Sciences (GCB), University of Bern, Switzerland; Diabetes Center Berne, Switzerland
D
David Herzig
Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism (UDEM), Inselspital, Bern University Hospital, University of Bern, Switzerland
C
Christos Nakas
Department of Clinical Chemistry, Inselspital, Bern University Hospital, University of Bern, Switzerland; Laboratory of Biometry, School of Agriculture, University of Thessaly, 384 46 Volos, Greece
L
Lia Bally
Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism (UDEM), Inselspital, Bern University Hospital, University of Bern, Switzerland
L
Lisa M. Koch
Department of Digital Medicine, University of Bern, Switzerland; Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism (UDEM), Inselspital, Bern University Hospital, University of Bern, Switzerland; Diabetes Center Berne, Switzerland