Comparing Hand and Controller Avatars with Hand Tracking and Controller-Based Interaction

2026-09-18

AI Summary

研究探讨了手部追踪与控制器在不同视觉表示下的性能差异，发现手部追踪即使在不匹配时也能提高准确性，而控制器则对不匹配更敏感。

Abstract

Previous research suggests that the congruency between common VR input devices - such as controllers or hand tracking - and their visual representations (e.g., hand or controller avatars) influences user experience and performance. However, the specific effects of input-avatar combinations remain underexplored. We study the effects of common input devices (hand tracking and controllers) and visual representations (hand and controller avatars) on performance and perceived success in target acquisition tasks. We included both grasping and pinching gestures across 16 combinations of input, avatar, and target size. Results indicate that hand tracking benefits from any form of visual representation - even when mismatched - achieving up to 5.8% greater accuracy compared to having no avatar, likely due to its reliance on visual feedback in the absence of a physical prop. Controllers were generally preferred and offered faster task completion. However, mismatched avatars had a stronger negative effect with controllers, particularly when the virtual gesture did not align with the physical action, leading to a 5.6% drop in accuracy compared to the matched condition - suggesting that inaccurate feedback can be more disruptive than having no avatar feedback at all.

Problem

• VR input devices
• visual representations
• user performance
• target acquisition

Innovation

• Hand Tracking
• Controller Avatars
• Visual Feedback
• Input-Avatar Congruency
• Target Acquisition