GLR-MM: Graph-Based Global-Local Reconstruction for Robust Multimodal Chest X-ray and EHR Representation Learning under Missing Modalities

📅 2026-09-20
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究提出GLR-MM框架,通过图基全局-局部重建解决多模态数据缺失下的重症监护病房早期死亡预测问题。
📝 Abstract
Clinical multimodal models must often predict before all chest X-ray (CXR) and electronic health record (EHR) inputs are available. Existing approaches align observed representations, model missingness, or reconstruct across modalities, but do not jointly exploit within-patient and clinically similar inter-patient evidence. We propose GLR-MM, a Graph-Based Global-Local Reconstruction framework for early ICU mortality prediction. It maps five CXR-EHR modalities to a shared space, reconstructs missing embeddings through complementary local cross-modal and global graph-attention branches, adaptively fuses their estimates, and optimizes class-balanced prediction, reconstruction, and contrastive objectives. On 9,620 MIMIC-derived ICU stays, we evaluate 10%, 30%, and 50% random modality missingness with shared deterministic masks. MUSE performs better under mild and moderate missingness, whereas GLR-MM achieves higher AUROC and AUPRC at 50% by 0.0088 and 0.0249, respectively. These results indicate that graph-guided reconstruction is most useful when inputs are severely incomplete.
Problem

Research questions and friction points this paper is trying to address.

multimodal models
missing modalities
chest X-ray
electronic health record
early ICU mortality prediction
Innovation

Methods, ideas, or system contributions that make the work stand out.

Graph-Based Global-Local Reconstruction
missing modality
cross-modal and global graph-attention
adaptive fusion
class-balanced objectives
🔎 Similar Papers
No similar papers found.
S
Surbhi Sharma
Houston Methodist, Houston, TX, USA
D
Devesh Maheshwari
University of Wisconsin–Madison, Madison, WI, USA
N
Nikhil Manali
Walmart, USA