Comparing Pass-Through Quality of Mixed Reality Devices: A User Experience Study During Real-World Tasks

2025-02-10

AI Summary

This study addresses the lack of cross-platform, task-driven objective evaluation of pass-through video quality in mixed reality (MR) devices. We conduct the first systematic comparison of pass-through performance and its impact on user experience across Apple Vision Pro, Meta Quest 3, and Varjo XR3—under realistic, task-oriented scenarios: text reading and jigsaw puzzle solving. Using a controlled user study, we quantify clarity, perceived latency, visual comfort, and cognitive load via NASA-TLX, Simulator Sickness Questionnaire (SSQ), and dual-task behavioral metrics. Results demonstrate that the Vision Pro significantly outperforms both Quest 3 and XR3 across all subjective and behavioral measures, delivering the highest overall user experience. This work establishes the first multidimensional, natural-interaction–oriented evaluation framework for MR pass-through quality, providing an empirical benchmark for hardware optimization and human-centered design.

Technology Category

• Computer Vision: Multi-modal Vision
• Humans and AI: Interaction Techniques and Devices
• Machine Learning: Hardware-aware ML

Application Category

• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Responsible Web: Machine-in-the-loop, human agency and autonomy
• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience

Abstract

In extended reality, pass-through enables users to view their real-world surroundings via cameras on the headset, displaying live video inside the device. This study compared the pass-through quality of three devices: Apple Vision Pro, Meta Quest 3, and Varjo XR3. Thirtyone participants performed two tasks, reading a text and solving a puzzle, while using each headset with the pass-through feature activated. Participants then rated their experiences, focusing on workload and cybersickness. Results showed that the Apple Vision Pro outperformed the Meta Quest 3 and Varjo XR3, receiving the highest ratings for pass-through quality.

Problem

• Compare pass-through quality of XR devices
• Assess user experience in real-world tasks
• Evaluate workload and cybersickness impact

Innovation

• Comparative study of mixed reality devices
• Assessment of pass-through quality
• User experience evaluation via real-world tasks