On the Performance and Implementation of Parallax free Video See-Through Displays

2026-07-17

AI Summary

This work addresses parallax errors and distortions in video see-through displays caused by image acquisition geometry. To mitigate these issues, the authors propose an efficient parallax correction method that employs a dual-camera system to separately capture the user and the background. By leveraging feature detection to estimate the relative poses among the user, display, and scene, the approach performs geometric correction based on a planar scene model and a fixed working distance assumption. The method achieves significantly enhanced perceptual realism while maintaining low computational overhead. Both theoretical analysis and experimental results demonstrate that the system effectively eliminates parallax in typical applications such as driver assistance, enabling high-fidelity, low-latency end-to-end video see-through display.

Abstract

In see-through systems an observer watches a (background) scene partially occluded by a display. In this display, usually positioned close to the observer, a region of the background scene is shown, yielding the sensation that the display is transparent. To achieve the transparency effect, it is very important to compensate the parallax error and other distortions caused by the image acquisition system. In this paper a detailed study of a video see-through methodology with parallax correction is performed. In a system composed by two cameras -- one directed to the user and another to the background scene -- and a display, the relative position between the user, the display and the scene is estimated using a feature detection algorithm and the parallax error is compensated assuming a planar scene model. The application of the proposed methodology on Driver Assistance Systems (DAS) is proposed. A theoretical assessment of the algorithm shows that although approximations are proposed to simplify the methodology and reduce the computational cost, such as the planar scene model and fixed working distance, on some practical situations their effects can be neglected without noticeable impact on the perceptual quality of the solution.

Problem

• parallax error
• video see-through display
• see-through systems
• distortion compensation
• transparent display

Innovation

• parallax correction
• video see-through display
• planar scene model
• feature detection
• driver assistance systems