🤖 AI Summary
Existing mapping systems lack haptic-voice synergy, limiting their ability to support pre-navigation spatial cognition for visually impaired individuals. This work proposes a multimodal interaction system that anchors an AI conversational agent to a constrained tactile surface rendered on a laptop trackpad. By integrating audio-haptic mapping with natural language processing, the system enables users to autonomously explore spatial layouts. Its core innovation lies in achieving multimodally synergistic spatial cognitive enhancement through a controllable haptic interface. User studies demonstrate that the system effectively facilitates location identification and description, significantly improving pre-navigation spatial awareness among visually impaired users.
📝 Abstract
Accessible map systems either make a layout explorable by hand or convey information through speech; few combine both to support pre-travel spatial understanding for blind and low-vision (BLV) people. We present TouchingSpace: a system that retrieves map data for an outdoor place and renders its surroundings as bounded regions at fixed trackpad positions. During exploration, users receive audio and haptic feedback and can ask a conversational agent open-ended questions. We conducted a user study with fourteen BLV participants who explored a place using TouchingSpace and reflected on the experience. We found participants used sound and vibration to locate places and speech to identify and describe them; the bounded surface supported discovery, revision, and spatial checks by hand; they expected this awareness to support future travel. TouchingSpace demonstrates how a laptop trackpad can support self-directed spatial exploration. These findings suggest accessible AI maps should ground conversation on bounded, user-controlled spatial surfaces.