🤖 AI Summary
Existing electrocardiogram (ECG) foundation models lack a unified evaluation for atrial fibrillation detection, primarily due to inconsistencies in datasets, preprocessing pipelines, classifiers, and validation protocols. This work proposes the first standardized and reproducible benchmark framework to fairly assess nine publicly available ECG foundation models as frozen feature extractors under a deployment-oriented setting that prevents data leakage. The evaluation employs uniform preprocessing, native resampling, a fixed XGBoost classifier, and record-level grouped cross-validation. Experimental results demonstrate that ECGFounder—a lightweight, clinically pretrained encoder—achieves the best overall performance across four heterogeneous datasets, striking an optimal balance among accuracy, model size, inference speed, and memory footprint.
📝 Abstract
Atrial fibrillation (AF) is the most common sustained cardiac arrhythmia and is associated with increased risks of stroke, heart failure, and mortality. Recent ECG foundation models offer transferable representations for automated AF detection. However, their relative effectiveness remains unclear because existing studies use different datasets, preprocessing procedures, classifiers, and validation protocols. This study presents FOUND-AF, a unified, leakage-controlled, and deployment-oriented benchmarking framework that evaluates the quality of pretrained ECG representations under identical experimental conditions. Nine publicly available foundation models from five families, including HuBERT-ECG, CLEF, ST-MEM, ECG-JEPA, and ECGFounder, were evaluated across four heterogeneous ECG datasets, namely AFDB, CinC2017, CPSC2021, and LTAFDB. All models were used as frozen feature extractors with standardized preprocessing, model-native resampling, a fixed XGBoost classifier, and recording-level grouped cross-validation. The evaluation included classification metrics, receiver operating characteristic analysis, paired recording-level bootstrap comparisons with Holm correction, embedding-space visualization, and computational efficiency profiling. The ECGFounder model consistently achieved the strongest overall performance across datasets while offering a favorable trade-off between accuracy, model size, inference time, and memory usage. FOUND-AF therefore provides a reproducible framework for selecting ECG foundation models and demonstrates that compact, clinically pretrained encoders can support robust and computationally efficient AF detection across heterogeneous acquisition settings.