From Fibers to Cells: Fourier-Based Registration Enables Virtual Cresyl Violet Staining From 3D Polarized Light Imaging

2025-05-16

AI Summary

Addressing the challenges of cross-modal registration between 3D polarized light imaging (3D-PLI) and histologically stained sections—namely, poor registration accuracy and low sample throughput—this paper proposes a deep learning–driven virtual staining method. We introduce the first end-to-end framework that synthesizes spatially aligned, single-cell-resolution virtual Cresyl Violet–stained images directly from label-free 3D-PLI data. Our approach innovatively integrates a U-Net architecture with a Fourier-domain local block registration mechanism and tissue-section-level spatial consistency constraints, enabling dynamic correction of multi-scale nonlinear deformations during training. Evaluated on real human brain sections, the generated virtual stains exhibit strong agreement with ground-truth histology: neuronal soma localization error is <2.1 μm. This work overcomes longstanding dependencies on physical staining and manual registration, establishing a novel paradigm for multimodal integration of brain microstructure.

Technology Category

• Computer Vision: Medical and Biological Imaging
• Machine Learning: Multimodal Learning
• Intelligent Robots: Multimodal Perception & Sensor Fusion

Application Category

• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• Graph Algorithms and Modeling for the Web: Graph neural networks and deep learning approaches for Web-related graphs
• Web Mining and Content Analysis: Large pretrained models with web data

Abstract

Comprehensive assessment of the various aspects of the brain's microstructure requires the use of complementary imaging techniques. This includes measuring the spatial distribution of cell bodies (cytoarchitecture) and nerve fibers (myeloarchitecture). The gold standard for cytoarchitectonic analysis is light microscopic imaging of cell-body stained tissue sections. To reveal the 3D orientations of nerve fibers, 3D Polarized Light Imaging (3D-PLI) has been introduced as a reliable technique providing a resolution in the micrometer range while allowing processing of series of complete brain sections. 3D-PLI acquisition is label-free and allows subsequent staining of sections after measurement. By post-staining for cell bodies, a direct link between fiber- and cytoarchitecture can potentially be established within the same section. However, inevitable distortions introduced during the staining process make a nonlinear and cross-modal registration necessary in order to study the detailed relationships between cells and fibers in the images. In addition, the complexity of processing histological sections for post-staining only allows for a limited number of samples. In this work, we take advantage of deep learning methods for image-to-image translation to generate a virtual staining of 3D-PLI that is spatially aligned at the cellular level. In a supervised setting, we build on a unique dataset of brain sections, to which Cresyl violet staining has been applied after 3D-PLI measurement. To ensure high correspondence between both modalities, we address the misalignment of training data using Fourier-based registration methods. In this way, registration can be efficiently calculated during training for local image patches of target and predicted staining. We demonstrate that the proposed method enables prediction of a Cresyl violet staining from 3D-PLI, matching individual cell instances.

Problem

• Aligns 3D-PLI and cell staining images nonlinearly
• Enables virtual Cresyl violet staining from 3D-PLI
• Improves cell-fiber microstructure analysis via registration

Innovation

• Fourier-based registration for cross-modal alignment
• Deep learning for virtual Cresyl violet staining
• 3D-PLI to cell-level aligned image translation