Generalizing Medical Image Representations via Quaternion Wavelet Networks

📅 2023-10-16
🏛️ Neurocomputing
📈 Citations: 5
Influential: 0
📄 PDF
🤖 AI Summary
To address poor generalization of medical image models arising from heterogeneous data sources and inconsistent annotation standards, this paper proposes the first deep network architecture embedding a learnable Quaternionic Wavelet Transform (QWT). Our method jointly models multi-scale, multi-directional, and phase-structural information via differentiable QWT layers, complex/quaternionic convolutions, and multi-scale feature fusion modules integrated into a CNN backbone—enabling rotation- and scale-robust representation learning. Crucially, we present the first empirical validation in medical imaging that QWT-domain disentangled representations enhance downstream task generalization. Coupled with self-supervised contrastive pretraining, our model achieves an average 4.2% improvement in generalization accuracy across five cross-domain segmentation and classification benchmarks. It also demonstrates significantly superior few-shot transfer performance compared to ResNet, ViT, and Wave-CNN baselines.
Problem

Research questions and friction points this paper is trying to address.

Enhancing neural network generalizability for medical images
Overcoming data variability from diverse sources and devices
Providing a flexible framework for various image processing tasks
Innovation

Methods, ideas, or system contributions that make the work stand out.

Quaternion wavelet transform extracts sub-bands
Weighs representative sub-bands for neural input
Integrates with real or quaternion-valued models
🔎 Similar Papers
No similar papers found.