AquaOrbit: Sim-to-Real Reinforcement Learning for Underwater Target Orbiting under Intermittent Visual Feedback

📅 2026-09-20
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出AquaOrbit,一种基于强化学习的控制器,通过恢复模块解决水下目标环绕时视觉反馈间歇性丢失的问题,提高目标重新捕获能力。
📝 Abstract
Intermittent visual loss disrupts target-relative feedback during underwater orbiting, making it difficult to maintain coordinated motion and reacquire a moving target. We present AquaOrbit, a reinforcement-learning controller with a recovery module for underwater target orbiting under interrupted visual feedback. During detection loss, the recovery module uses latched line-of-sight, roll, and depth references to support stabilization and target reacquisition. We train the controller in Isaac Sim with dynamics, observation, and vision-loss randomization. Evaluated without retraining in Gazebo/ROS2 under a different physics engine and perception perturbations, AquaOrbit completes 20/20 orbiting trials in each of the static- and moving-target conditions on an unseen variable-depth 3-D trajectory. In the moving-target condition, it reduces mean line-of-sight error by approximately 46% relative to a PID-based visual servoing controller with recovery while maintaining comparable path-tracking accuracy; removing the recovery module reduces completion to 9/20. Zero-shot physical deployment with fully onboard perception and control demonstrates elliptical, figure-eight, and variable-depth circular trajectories, including the latter two trajectory types absent from training. The robot maintains attitude stability during manual occlusions lasting up to 8s and reacquires the target within 2.5s in the reported attitude-induced field-of-view loss events.
Problem

Research questions and friction points this paper is trying to address.

Intermittent visual loss
target orbiting
underwater
Innovation

Methods, ideas, or system contributions that make the work stand out.

reinforcement learning
intermittent visual feedback
recovery module
target reacquisition
zero-shot deployment
💼 Related Jobs
No related jobs found.
K
Kanzhong Yao
Institute of Artificial Intelligence (TeleAI), China Telecom, China
J
Jinyi Leng
Institute of Artificial Intelligence (TeleAI), China Telecom, China; Harbin Engineering University, China
H
Hao Zhang
Institute of Artificial Intelligence (TeleAI), China Telecom, China; Tongji University, China
Z
Zhe Sun
Institute of Artificial Intelligence (TeleAI), China Telecom, China
X
Xuelong Li
Institute of Artificial Intelligence (TeleAI), China Telecom, China