Touvigation: Embodied Adaptive Object Acquisition for Blind and Low-Vision Users in Unfamiliar Indoor Environments

📅 2026-09-18
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究解决了视障用户在陌生室内环境中寻找和获取物体的问题,通过结合视觉-语言理解和持续局部空间建模的方法提供低延迟的身体相对指导。
📝 Abstract
Blind and low-vision users often face challenges when locating and physically acquiring objects in unfamiliar indoor environments. Existing vision-language-model-based assistants can provide semantic descriptions but may introduce latency, hallucinations, and guidance that is poorly aligned with embodied action. We present Touvigation, a hands-free object acquisition system that combines vision-language understanding with persistent local spatial modeling to provide low-latency, body-relative guidance. Drawing on formative interviews with eight blind and low-vision participants, we design a multi-stage guidance framework that adapts spatial references as users transition from orienting, to walking, to reaching and tactile verification. We evaluated Touvigation with 12 blind and low-vision participants against a multimodal large-language-model assistant and unassisted search. Touvigation achieved 100% task success, compared with 58% for the multimodal assistant and 85% for unassisted search, while reducing completion time and cognitive workload. Our findings demonstrate how persistent spatial grounding and adaptive embodied guidance can improve object acquisition for blind and low-vision users.
Problem

Research questions and friction points this paper is trying to address.

Blind and Low-Vision Users
Indoor Environments
Object Acquisition
Vision-Language Models
Spatial Guidance
Innovation

Methods, ideas, or system contributions that make the work stand out.

Embodied Adaptive Guidance
Persistent Spatial Modeling
Vision-Language Understanding
🔎 Similar Papers
No similar papers found.
G
George Xi Wang
Stony Brook University, United States and New York University, United States
X
Xiangyu Li
Brown University, United States
S
Shaoyue Wen
Imperial College London, United Kingdom
J
Jiaqian Hu
Middlebury Institute of International Studies at Monterey, United States
J
Junan Xie
The Hong Kong University of Science and Technology (Guangzhou), China
Y
Yupeng Wang
Tongji University, China
Z
Ziyue Shi
Shanghai Qibao Dwight High School, China
Q
Qijun Chen
Tongji University, China
M
Maaike Bouwmeester
New York University, United States
Y
Yuhua Jin
The Chinese University of Hong Kong, Shenzhen, China
J
Jing Qian
Tongji University, China