Detecting Neurocognitive Disorders through Analyses of Topic Evolution and Cross-modal Consistency in Visual-Stimulated Narratives

📅 2025-01-07
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
Early screening for neurocognitive disorders (NCDs) in older adults remains challenging, as conventional approaches rely predominantly on static, micro-linguistic features (e.g., lexical or syntactic markers), lacking sensitivity to higher-order cognitive decline. Method: This work proposes a novel paradigm centered on *dynamic macro-narrative structure*, integrating Dynamic Topic Modeling (DTM) with a Text–Image Temporal Alignment Network (TITAN) to jointly model thematic evolution in spoken narratives and temporal alignment between linguistic output and multimodal (textual + visual) stimuli. Contribution/Results: The framework extracts two interpretable biolinguistic biomarkers: *thematic drift abnormality* and *stimulus-response desynchronization*. Evaluated on the CU-MARVEL Rabbit Story corpus, TITAN achieves F1 = 0.72 and AUC = 0.81—significantly outperforming both micro- and macro-level baselines. DTM independently validates dynamic topic consistency as an effective macro-level indicator (F1 = 0.61, AUC = 0.78).

Technology Category

Application Category

📝 Abstract
Early detection of neurocognitive disorders (NCDs) is crucial for timely intervention and disease management. Speech analysis offers a non-intrusive and scalable screening method, particularly through narrative tasks in neuropsychological assessment tools. Traditional narrative analysis often focuses on local indicators in microstructure, such as word usage and syntax. While these features provide insights into language production abilities, they often fail to capture global narrative patterns, or microstructures. Macrostructures include coherence, thematic organization, and logical progressions, reflecting essential cognitive skills potentially critical for recognizing NCDs. Addressing this gap, we propose to investigate specific cognitive and linguistic challenges by analyzing topical shifts, temporal dynamics, and the coherence of narratives over time, aiming to reveal cognitive deficits by identifying narrative impairments, and exploring their impact on communication and cognition. The investigation is based on the CU-MARVEL Rabbit Story corpus, which comprises recordings of a story-telling task from 758 older adults. We developed two approaches: the Dynamic Topic Models (DTM)-based temporal analysis to examine the evolution of topics over time, and the Text-Image Temporal Alignment Network (TITAN) to evaluate the coherence between spoken narratives and visual stimuli. DTM-based approach validated the effectiveness of dynamic topic consistency as a macrostructural metric (F1=0.61, AUC=0.78). The TITAN approach achieved the highest performance (F1=0.72, AUC=0.81), surpassing established microstructural and macrostructural feature sets. Cross-comparison and regression tasks further demonstrated the effectiveness of proposed dynamic macrostructural modeling approaches for NCD detection.
Problem

Research questions and friction points this paper is trying to address.

Neurocognitive Disorders
Elderly Population
Detection and Identification
Innovation

Methods, ideas, or system contributions that make the work stand out.

Neurocognitive Disorders Detection
Narrative Analysis
Consistency of Sensory Modalities
🔎 Similar Papers
No similar papers found.
J
Jinchao Li
The Chinese University of Hong Kong, Hong Kong, China
Y
Yuejiao Wang
The Chinese University of Hong Kong, Hong Kong, China
J
Junan Li
The Chinese University of Hong Kong, Hong Kong, China
J
Jiawen Kang
The Chinese University of Hong Kong, Hong Kong, China
B
Bo Zheng
The Chinese University of Hong Kong, Hong Kong, China
S
Simon Wong
The Chinese University of Hong Kong, Hong Kong, China
B
Brian Mak
The Hong Kong University of Science and Technology, Hong Kong, China
Helene Fung
Helene Fung
Chinese University of Hong Kong
agingemotionculture
J
Jean Woo
The Chinese University of Hong Kong, Hong Kong, China
M
Man-Wai Mak
The Hong Kong Polytechnic University, Hong Kong, China
Timothy Kwok
Timothy Kwok
The Chinese University of Hong Kong, Hong Kong, China
V
Vincent Mok
The Chinese University of Hong Kong, Hong Kong, China
Xianmin Gong
Xianmin Gong
The Chinese University of Hong Kong
agingadulthood developmentgoal and motivationemotion and wellbeing
Xixin Wu
Xixin Wu
The Chinese University of Hong Kong
Xunying Liu
Xunying Liu
Chinese University of Hong Kong
Speech and Language ProcessingMachine Learning
Patrick Wong
Patrick Wong
Open University
Artificial Intelligenceimage processingcomputer visionpower system
H
Helen Meng
The Chinese University of Hong Kong, Hong Kong, China