Technology Category
Computer Vision: Diffusion Models for VisionHumans and AI: Game Design — Virtual Humans, NPCs and Autonomous CharactersIntelligent Robots: Multimodal Perception & Sensor Fusion
HapticMatch: An Exploration for Generative Material Haptic Simulation and Interaction
🤖 AI Summary
High-fidelity tactile feedback is crucial for enhancing immersion in virtual reality, yet existing methods struggle to efficiently generate realistic haptic textures. To address this challenge, this work proposes HapticMatch, a novel framework that leverages diffusion and flow-matching models to synthesize renderable microscale surface geometries directly from a single RGB image, enabling rapid “scan-to-touch” prototyping. The study introduces the first aligned multimodal material dataset, integrating microscale optical images, height maps, and friction-induced vibration signals. By combining conditional generative models with VR/AR interaction techniques, HapticMatch significantly lowers the barrier to haptic content creation and substantially improves visuo-tactile consistency in virtual environments.
Technology Category
Application Category
📝 Abstract
High-fidelity haptic feedback is essential for immersive virtual environments, yet authoring realistic tactile textures remains a significant bottleneck for designers. We introduce HapticMatch, a visual-to-tactile generation framework designed to democratize haptic content creation. We present a novel dataset containing precisely aligned pairs of micro-scale optical images, surface height maps, and friction-induced vibrations for 100 diverse materials. Leveraging this data, we explore and demonstrate that conditional generative models like diffusion and flow-matching can synthesize high-fidelity, renderable surface geometries directly from standard RGB photos. By enabling a"Scan-to-Touch"workflow, HapticMatch allows interaction designers to rapidly prototype multimodal surface sensations without specialized recording equipment, bridging the gap between visual and tactile immersion in VR/AR interfaces.
Problem
Research questions and friction points this paper is trying to address.
haptic feedback
tactile texture
virtual reality
haptic content creation
multimodal interaction
Innovation
Methods, ideas, or system contributions that make the work stand out.
visual-to-tactile generation
conditional generative models
haptic simulation
multimodal dataset
Scan-to-Touch
🔎 Similar Papers
No similar papers found.
