AnyECG: Foundational Models for Electrocardiogram Analysis

📅 2024-11-17
🏛️ arXiv.org
📈 Citations: 1
✨ Influential: 0
📄 PDF
🤖 AI Summary
Real-world ECG analysis faces significant challenges, including strong data heterogeneity, high noise levels, substantial inter-population variability, and complex rhythm-event associations. To address these, we propose AnyECG—the first foundation model tailored for multi-source heterogeneous ECG data. Our method introduces three key innovations: (1) an ECG Tokenizer that encodes continuous, noisy signals into discrete, compact, and clinically interpretable local rhythm tokens; (2) a proxy-task-driven discretized representation learning framework coupled with rhythm-pattern-aware autoregressive pretraining; and (3) joint self-supervised learning across diverse devices and clinical scenarios. Evaluated on four tasks—abnormality detection, arrhythmia classification, lead imputation, and ultra-long ECG analysis—AnyECG consistently surpasses state-of-the-art methods, demonstrating marked improvements in generalization and robustness under realistic, noisy, and heterogeneous conditions.

Technology Category

Machine Learning: Other Foundations of Machine LearningHumans and AI: Other Foundations of Human Computation & AIComputer Vision: Other Foundations of Computer Vision

Application Category

Economics, Online Markets and Human Computation: Data quality aspects of human-annotated datasetsGraph Algorithms and Modeling for the Web: Foundation models and LLMs for Web-related graphsUser Modeling, Personalization and Recommendation: On-Device user modeling, personalization, and recommendation
📝 Abstract
Electrocardiogram (ECG), a non-invasive and affordable tool for cardiac monitoring, is highly sensitive in detecting acute heart attacks. However, due to the lengthy nature of ECG recordings, numerous machine learning methods have been developed for automated heart disease detection to reduce human workload. Despite these efforts, performance remains suboptimal. A key obstacle is the inherent complexity of ECG data, which includes heterogeneity (e.g., varying sampling rates), high levels of noise, demographic-related pattern shifts, and intricate rhythm-event associations. To overcome these challenges, this paper introduces AnyECG, a foundational model designed to extract robust representations from any real-world ECG data. Specifically, a tailored ECG Tokenizer encodes each fixed-duration ECG fragment into a token and, guided by proxy tasks, converts noisy, continuous ECG features into discrete, compact, and clinically meaningful local rhythm codes. These codes encapsulate basic morphological, frequency, and demographic information (e.g., sex), effectively mitigating signal noise. We further pre-train the AnyECG to learn rhythmic pattern associations across ECG tokens, enabling the capture of cardiac event semantics. By being jointly pre-trained on diverse ECG data sources, AnyECG is capable of generalizing across a wide range of downstream tasks where ECG signals are recorded from various devices and scenarios. Experimental results in anomaly detection, arrhythmia detection, corrupted lead generation, and ultra-long ECG signal analysis demonstrate that AnyECG learns common ECG knowledge from data and significantly outperforms cutting-edge methods in each respective task.
Problem

Research questions and friction points this paper is trying to address.

Overcoming complexity in ECG data for accurate heart disease detection.
Developing a model to handle noisy, heterogeneous ECG recordings effectively.
Enhancing performance in multiple ECG analysis tasks across diverse settings.
Innovation

Methods, ideas, or system contributions that make the work stand out.

Tailored ECG Tokenizer encodes ECG fragments
Pre-trained AnyECG captures cardiac event semantics
Generalizes across diverse ECG data sources
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
Zhejiang University | University of Illinois at Urbana-Champaign | Hong Kong University of Science and Technology
Y
Yue Wang
The College of Computer Science and Technology, Zhejiang University, Hangzhou 310012, China; State Key Laboratory of Transvascular Implantation Devices of the Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou 310009, China; Zhejiang Key Laboratory of Medical Imaging Artificial Intelligence, Hangzhou 310058, China
X
Xu Cao
Department of Computer Science, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
Y
Yaojun Hu
The College of Computer Science and Technology, Zhejiang University, Hangzhou 310012, China
H
Haochao Ying
the School of Public Health and Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou 310058, China
J
J. Rehg
School of Computer Science, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
Jimeng Sun
Jimeng Sun
Professor at University of Illinois Urbana-Champaign
AI for healthcareMachine learning for healthcaredeep learning for healthcare
J
Jian Wu
The College of Computer Science and Technology, Zhejiang University, Hangzhou 310012, China; the School of Public Health and Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou 310058, China
Jintai Chen
Jintai Chen
Assistant Professor@HKUST(GZ)
AI for HealthcareMultimodal LearningDeep Tabular Learning