SFVO: Decoupled Confidence-Guided Stereo-Flow Visual Odometry with Bidirectional PnP

📅 2026-09-18
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
SFVO通过结合预训练的立体匹配和光流模型,利用解耦置信度图指导的方法解决视觉里程计中的尺度模糊问题,实现鲁棒准确的姿态估计。
📝 Abstract
Deep learning-based visual odometry (VO) has achieved significant progress, yet most existing methods focus on a monocular approach, which suffers from scale ambiguity. Stereo VO provides real metric by its nature, but remains less studied in deep learning VO due to its high computational cost and modeling complexity. Recent advances in stereo matching and optical flow estimation have made dense visual correspondence increasingly accurate and reliable, but their complementary geometric information has not been fully exploited for VO. In this paper, we present SFVO, a correspondence-driven stereo VO framework that directly builds upon pretrained stereo matching and optical flow models. SFVO exploits pretrained stereo matching and optical flow models to estimate stereo and temporal correspondences. Instead of learning pose directly from images, SFVO maps learned correspondences into geometric constraints and predicts which points are trustworthy. To improve the reliability of visual correspondence-based geometric constraints, we introduce decoupled confidence maps for rotation and translation. This design better aligns the characteristics of visual correspondence and 6-DoF transformations. Extensive experiments on outdoor and indoor datasets demonstrate that SFVO achieves robust and accurate pose estimation with strong generalization capability. The code will be released.
Problem

Research questions and friction points this paper is trying to address.

visual odometry
stereo matching
optical flow
geometric constraints
confidence-guided
Innovation

Methods, ideas, or system contributions that make the work stand out.

Decoupled Confidence Maps
Stereo-Flow Visual Odometry
Pretrained Models
🔎 Similar Papers
2024-01-03Computer Vision and Pattern RecognitionCitations: 35
💼 Related Jobs
No related jobs found.
K
Kai Zhang
Robotics and Autonomous Systems Thrust, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, China
G
Guoyang Zhao
Robotics and Autonomous Systems Thrust, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, China
J
Jun Ma
Robotics and Autonomous Systems Thrust, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, China; and Cheng Kar-Shun Robotics Institute, The Hong Kong University of Science and Technology, Hong Kong SAR, China