🤖 AI Summary
This work addresses the limitations of generic object tracking under severe deformation, complex interference, drastic environmental changes, or unseen object categories, where insufficient generalization and online adaptation often lead to failure. To bridge this gap, the study presents a unified framework that systematically integrates key components of human visual perception—namely prior knowledge, spatial geometric constraints, and semantic context—by synergistically combining online adaptive learning, geometric modeling, and discriminative optimization. The proposed approach substantially enhances the tracker’s discriminative power, robustness, and geometric reasoning capabilities in open and dynamic environments. Extensive experiments demonstrate significant improvements in tracking accuracy across diverse challenging scenarios, effectively narrowing the performance gap between machine-based tracking and human visual perception.
📝 Abstract
At the heart of human visual perception lies the ability to maintain a continuous and coherent understanding of the external world. By integrating observations with accumulated experience, the human visual system can continuously adapt to variations in both the target and its surrounding environment, while preserving robust visual continuity as scene dynamics evolve. Human vision can therefore integrate prior knowledge, spatial geometry, and semantic context to understand complex scenes and their changes. As a core problem in computer vision, visual object tracking aims to bring machine perception closer to human visual perception. These capabilities are central to the task of Generic Object Tracking (GOT). In this task, a visual tracker is initialized only with the bounding box of an arbitrarily specified target in the first frame, and must continuously localize the target in subsequent dynamic visual streams. However, future events, observations, and real-world variations are inherently unpredictable; therefore, the model's generalization and online adaptation capabilities remain bottlenecks. Tracking reliability can deteriorate when the target undergoes severe deformation, is affected by complex distractors, encounters significant environmental changes, or belongs to a category unseen during training. This dissertation aims to narrow the gap between machine visual tracking systems and human visual perception by proposing a series of methods that systematically enhance the target discrimination, robust adaptation, and geometric reasoning capabilities of tracking models.