Cross-Modal Contrastive Learning from Histopathology and CT for Automated Renal Cell Carcinoma Grading

📅 2026-09-22
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
本文通过开发RCC-Align框架,利用配对的组织病理学和CT数据进行跨模态对比学习,以提高非侵入性的ccRCC分级预测准确性。
📝 Abstract
Background: Clear cell renal cell carcinoma (ccRCC) exhibits substantial clinical heterogeneity, and accurate grade assessment is essential for risk stratification and treatment planning. However, conventional grading requires invasive tissue sampling. We developed RCC-Align, a cross-modal contrastive learning framework that leverages paired histopathology and computed tomography (CT) data during training to improve noninvasive CT-based ccRCC grade prediction. Methods: RCC-Align aligns paired whole-slide histopathology images (WSIs) and CT scans through contrastive cross-modal objectives, transferring grade-discriminative information from microscopic tissue morphology to macroscopic radiologic representations. The framework was trained and evaluated on paired TCGA and CPTAC cohorts using patient-level five-fold cross-validation. Performance for low- versus high-grade ccRCC classification was compared against CT-only baselines (DINOv2-Base and DINOv2-Finetuned) and a WSI-based reference model (GigaPath-Finetuned). Cross-modal alignment was assessed using cosine similarity analysis. Results: RCC-Align achieved an AUC of 0.601 (95% CI, 0.524-0.673) and AUPRC of 0.599 (95% CI, 0.541-0.676), outperforming DINOv2-Finetuned (AUC 0.545; AUPRC 0.543) with significantly improved low-grade prediction (p = 0.004). RCC-Align also demonstrated stronger paired WSI-CT embedding alignment compared with baselines. The WSI-based GigaPath reference achieved an AUC of 0.719. Conclusion: Pathology-guided contrastive learning improves CT-based ccRCC grading while requiring only CT at inference. This approach may complement tissue diagnosis when biopsy is unsafe, infeasible, or limited by intratumoral heterogeneity. Validation in larger, multi-institutional cohorts with external testing is needed before clinical translation.
Problem

Research questions and friction points this paper is trying to address.

Cross-Modal Contrastive Learning
Histopathology
Computed Tomography (CT)
Renal Cell Carcinoma (RCC)
Noninvasive Grading
Innovation

Methods, ideas, or system contributions that make the work stand out.

Cross-Modal Contrastive Learning
Histopathology and CT Integration
Noninvasive ccRCC Grading
RCC-Align Framework
💼 Related Jobs
No related jobs found.
A
Amit Das
Department of Computer Science, Dartmouth College, Hanover, NH 03755, USA
T
Tanmay Shukla
Department of Biomedical Data Science, Geisel School of Medicine at Dartmouth, Hanover, NH 03755, USA
Naofumi Tomita
Naofumi Tomita
Research Scientist, Dartmouth College
Deep LearningComputer VisionMedical Image Analysis
F
Faraz Farhadi
Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA
J
Jessica Sin
Department of Radiology, Dartmouth-Hitchcock Medical Center, Lebanon, NH 03756, USA
A
Ari Hakimi
Department of Urology, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
C
Chad Vanderbilt
Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
J
Jie-Fu Chen
Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
Ritesh Kotecha
Ritesh Kotecha
Genitourinary Oncology Service, Division of Solid Tumor Oncology, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
Weijie Ma
Weijie Ma
Fudan University
Computer Vision & GraphicsExtended RealityAI for Science
Bing Ren
Bing Ren
Dept. of Pathology and Laboratory Medicine, Dartmouth Hitchcock Medical Center
Saeed Hassanpour
Saeed Hassanpour
Professor at Dartmouth
Biomedical InformaticsMachine LearningAI for HealthcareMedical Imaging