Honey, I shrunk the scientist -- Evaluating 2D, 3D, and VR interfaces for navigating samples under the microscope

2026-03-25

AI Summary

This study addresses the challenging and tedious task of navigating micrometer-scale three-dimensional specimens under a microscope to locate regions of interest for imaging. It presents the first systematic comparison of three interaction paradigms—2D desktop, 3D desktop, and virtual reality (VR)—within a real-world micro-manipulation context, evaluating their performance through a user study in terms of task efficiency, usability, and completion rates. The results demonstrate that VR significantly outperforms both traditional 2D and 3D desktop interfaces, offering superior speed, enhanced user experience, and higher acceptance among participants. In contrast, the 3D desktop interface provides no substantial advantage over its 2D counterpart. These findings establish VR as a promising new interaction paradigm for three-dimensional navigation at microscopic scales and underscore its potential for scientific visualization and microscale manipulation tasks.

Technology Category

• Computer Vision: 3D Computer Vision
• Intelligent Robots: Manipulation
• Humans and AI: Interaction Techniques and Devices

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Systems and Infrastructure for Web, Mobile and WoT: Virtualization and resource management in Web systems and infrastructures

Abstract

In contemporary biology and medicine, 3D microscopy is one of the most widely-used techniques for imaging and manipulation of various kinds of samples. Navigating such a micrometer-sized, 3-dimensional sample under the microscope -- e.g. to find relevant imaging regions -- can pose a tedious challenge for the experimenter. In this paper, we examine whether 2D desktop, 3D desktop, or Virtual Reality (VR) interfaces provide the best user experience and performance for the exploration of 3D samples. We invited 12 skilled microscope operators to perform two different exploration tasks in 2D, 3D and VR and compared all conditions in terms speed, usability, and completion. Our results show a clear benefit when using VR -- in terms of task efficiency, usability, and user acceptance. Intriguingly, while VR outperformed desktop 2D and 3D in all scenarios, 3D desktop did not outperform 2D desktop.

Problem

• 3D microscopy
• sample navigation
• user interface
• virtual reality
• microscope operation

Innovation

• Virtual Reality
• 3D microscopy
• user interface
• human-computer interaction
• microscopy navigation