Ascribe New Dimensions to Scientific Data Visualization with VR

2025-04-18

AI Summary

Traditional 2D visualization techniques inadequately represent and analyze inherently 3D, multiscale scientific images, hindering microstructural understanding and quantitative analysis. To address this, we propose ASCRI BE-VR—a novel platform integrating AI-driven semantic segmentation with immersive VR interaction in a closed-loop paradigm. It employs a lightweight iterative feedback learning model for high-accuracy, fully automated segmentation of multi-source 3D volumetric data (e.g., CT, MRI), and leverages real-time VR rendering (Meta Quest) with natural gesture-based interaction to establish a human-in-the-loop digital twin visualization system. The platform achieves millisecond-scale responsiveness for hundred-GB-scale volumetric datasets. In materials science microstructure identification tasks, it improves analytical efficiency by over 3.2× and segmentation accuracy by +18.7%. ASCRI BE-VR establishes a new methodological framework for interpretable exploration of complex scientific imagery.

Technology Category

• Computer Vision: 3D Computer Vision
• Intelligent Robots: Multimodal Perception & Sensor Fusion
• Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning

Application Category

• Search and Retrieval-Augmented AI: Vertical and domain-specific search
• Systems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications
• Web Mining and Content Analysis: Web data visualization

Abstract

For over half a century, the computer mouse has been the primary tool for interacting with digital data, yet it remains a limiting factor in exploring complex, multi-scale scientific images. Traditional 2D visualization methods hinder intuitive analysis of inherently 3D structures. Virtual Reality (VR) offers a transformative alternative, providing immersive, interactive environments that enhance data comprehension. This article introduces ASCRIBE-VR, a VR platform of Autonomous Solutions for Computational Research with Immersive Browsing &Exploration, which integrates AI-driven algorithms with scientific images. ASCRIBE-VR enables multimodal analysis, structural assessments, and immersive visualization, supporting scientific visualization of advanced datasets such as X-ray CT, Magnetic Resonance, and synthetic 3D imaging. Our VR tools, compatible with Meta Quest, can consume the output of our AI-based segmentation and iterative feedback processes to enable seamless exploration of large-scale 3D images. By merging AI-generated results with VR visualization, ASCRIBE-VR enhances scientific discovery, bridging the gap between computational analysis and human intuition in materials research, connecting human-in-the-loop with digital twins.

Problem

• Overcoming limitations of 2D tools for 3D data exploration
• Enhancing intuitive analysis of complex scientific images
• Bridging AI-driven computation and immersive VR visualization

Innovation

• VR platform integrates AI-driven algorithms
• Supports multimodal and immersive 3D visualization
• Combines AI segmentation with VR exploration