🤖 AI Summary
Early, interpretable longitudinal prediction of individualized cognitive decline in Alzheimer’s disease (AD) remains challenged by the difficulty of jointly achieving effective multimodal data fusion and model transparency. To address this, we propose the Neural Koopman Machine (NKM), a physics-informed, group-aware hierarchical attention framework that integrates genetic, neuroimaging, proteomic, and demographic data. NKM maps nonlinear cognitive trajectories onto interpretable linear Koopman representations, enabling simultaneous prediction of multidimensional cognitive scores and quantification of biomarker-specific contributions. Model architecture is constrained by two priors: α-prior (analytical prior) guiding feature organization and β-prior (biological prior) governing dynamic modeling. Evaluated on the ADNI dataset, NKM significantly outperforms state-of-the-art machine learning and deep learning baselines. It further identifies neuroanatomically and biologically salient predictive regions and biomarkers, offering a clinically actionable, mechanistically insightful tool for AD research and decision support.
📝 Abstract
Early forecasting of individual cognitive decline in Alzheimer's disease (AD) is central to disease evaluation and management. Despite advances, it is as of yet challenging for existing methodological frameworks to integrate multimodal data for longitudinal personalized forecasting while maintaining interpretability. To address this gap, we present the Neural Koopman Machine (NKM), a new machine learning architecture inspired by dynamical systems and attention mechanisms, designed to forecast multiple cognitive scores simultaneously using multimodal genetic, neuroimaging, proteomic, and demographic data. NKM integrates analytical ($α$) and biological ($β$) knowledge to guide feature grouping and control the hierarchical attention mechanisms to extract relevant patterns. By implementing Fusion Group-Aware Hierarchical Attention within the Koopman operator framework, NKM transforms complex nonlinear trajectories into interpretable linear representations. To demonstrate NKM's efficacy, we applied it to study the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Our results suggest that NKM consistently outperforms both traditional machine learning methods and deep learning models in forecasting trajectories of cognitive decline. Specifically, NKM (1) forecasts changes of multiple cognitive scores simultaneously, (2) quantifies differential biomarker contributions to predicting distinctive cognitive scores, and (3) identifies brain regions most predictive of cognitive deterioration. Together, NKM advances personalized, interpretable forecasting of future cognitive decline in AD using past multimodal data through an explainable, explicit system and reveals potential multimodal biological underpinnings of AD progression.