Beyond the Embedding Bottleneck: Adaptive Retrieval-Augmented 3D CT Report Generation

📅 2026-03-16
📈 Citations: 0
✨ Influential: 0
📄 PDF

Technology Category

Computer Vision: 3D Computer VisionMultiagent Systems: Adversarial AgentsData Mining & Knowledge Management: Conversational Systems for Recommendation & Retrieval

Application Category

Search and Retrieval-Augmented AI: Retrieval-Augmented Generation (RAG) and multi-modal RAGUser Modeling, Personalization and Recommendation: Fairness-aware retrieval and rankingGraph Algorithms and Modeling for the Web: Querying, indexing, and retrieval in Web-related graphs
📝 Abstract
Automated radiology report generation from 3D CT volumes often suffers from incomplete pathology coverage. We provide empirical evidence that this limitation stems from a representational bottleneck: contrastive 3D CT embeddings encode discriminative pathology signals, yet exhibit severe dimensional concentration, with as few as 2 effective dimensions out of 512. Corroborating this, scaling the language model yields no measurable improvement, suggesting that the bottleneck lies in the visual representation rather than the generator. This bottleneck limits both generation and retrieval; naive static retrieval fails to improve clinical efficacy and can even degrade performance. We propose \textbf{AdaRAG-CT}, an adaptive augmentation framework that compensates for this visual bottleneck by introducing supplementary textual information through controlled retrieval and selectively integrating it during generation. On the CT-RATE benchmark, AdaRAG-CT achieves state-of-the-art clinical efficacy, improving Clinical F1 from 0.420 (CT-Agent) to 0.480 (+6 points); ablation studies confirm that both the retrieval and generation components contribute to the improvement. Code is available at https://github.com/renjie-liang/Adaptive-RAG-for-3DCT-Report-Generation.
💼 Related Jobs
No related jobs found.
R
Renjie Liang
University of Florida
Y
Yiling Ma
Yale University
Y
Yang Xing
University of Florida
Z
Zhengkang Fan
University of Florida
J
Jinqian Pan
University of Florida
C
Chengkun Sun
University of Florida
Li Li
Li Li
Pennsylvania State University; Southern University of Science and Technology
Materials ScienceDielectricsFerroelectricsPolymers and composites
Kuang Gong
Kuang Gong
Assistant Professor of Biomedical Engineering, University of Florida
PETMRICTInverse ProblemMachine Learning
J
Jie Xu
University of Florida