🤖 AI Summary
This study addresses the limited clinical adoption of machine learning models for Alzheimer’s disease (AD), which stems from the lack of robustness and consistency in existing interpretability methods across tasks, disease stages, and model architectures. To overcome this, we propose the first multidimensional SHAP evaluation framework that integrates coherence, stability, and cross-task consistency, systematically validating its transferability in both AD diagnosis and prognosis tasks. Leveraging AutoML-optimized classifiers combined with SHAP analysis, we quantitatively assess feature importance through feature correlation, top-k overlap ratio, sign consistency, and domain contribution ratios. Results demonstrate that cognitive and functional biomarkers predominantly drive explanations in both tasks, with SHAP attributions showing high consistency between diagnostic and prognostic models—achieving 100% sign stability and stable domain contributions, except for a modest increase in the contribution of genetic features in prognosis.
📝 Abstract
Alzheimer disease (AD) diagnosis and prognosis increasingly rely on machine learning (ML) models. Although these models provide good results, clinical adoption is limited by the need for technical expertise and the lack of trustworthy and consistent model explanations. SHAP (SHapley Additive exPlanations) is com-monly used to interpret AD models, but existing studies tend to focus on explanations for isolated tasks, providing little evidence about their robustness across disease stages, model architectures, or prediction objectives. This paper proposes a multi-level explainability framework that measures the coherence, stabil-ity and consistency of explanations by integrating: (1) within-model coherence metrics between feature importance and SHAP, (2) SHAP stability across AD boundaries, and (3) SHAP cross-task consistency be-tween diagnosis and prognosis. Using AutoML to optimize classifiers on the NACC dataset, we trained four diagnostic and four prognostic models covering the standard AD progression stages. Stability was then evaluated using correlation metrics, top-k feature overlap, SHAP sign consistency, and domain-level contribution ratios. Results show that cognitive and functional markers dominate SHAP explanations in both diagnosis and prognosis. SHAP-SHAP consistency between diagnostic and prognostic models was high across all classifiers, with 100% sign stability and minimal shifts in explanatory magnitude. Domain-level contributions also remained stable, with only minimal increases in genetic features for prognosis. These results demonstrate that SHAP explanations can be quantitatively vali-dated for robustness and transferability, providing clinicians with more reliable interpretations of ML pre-dictions.