FeatureSORT: Essential Features for Effective Tracking

๐Ÿ“… 2024-07-05
๐Ÿ›๏ธ arXiv.org
๐Ÿ“ˆ Citations: 7
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
To address frequent identity switches and trajectory discontinuities caused by occlusion in multi-object tracking, this paper proposes a lightweight online tracker. Methodologically: (1) it introduces the first multi-granularity appearance feature disentanglement framework, jointly modeling IoU, motion direction, clothing color/style, and ReID embeddings via an adaptive weighted composite distance metric; (2) it integrates a high-accuracy detector with a customized post-processing module to enhance detection robustness and trajectory smoothness. Experiments on mainstream benchmarks demonstrate significant improvements in MOTA (+2.1%) and IDF1 (+3.4%), a 32% reduction in ID switches, and markedly enhanced trajectory continuity under occlusionโ€”while maintaining real-time inference speed (โ‰ฅ30 FPS), thus satisfying practical online deployment requirements.

Technology Category

Application Category

๐Ÿ“ Abstract
In this work, we introduce a novel tracker designed for online multiple object tracking with a focus on being simple, while being effective. we provide multiple feature modules each of which stands for a particular appearance information. By integrating distinct appearance features, including clothing color, style, and target direction, alongside a ReID network for robust embedding extraction, our tracker significantly enhances online tracking accuracy. Additionally, we propose the incorporation of a stronger detector and also provide an advanced post processing methods that further elevate the tracker's performance. During real time operation, we establish measurement to track associated distance function which includes the IoU, direction, color, style, and ReID features similarity information, where each metric is calculated separately. With the design of our feature related distance function, it is possible to track objects through longer period of occlusions, while keeping the number of identity switches comparatively low. Extensive experimental evaluation demonstrates notable improvement in tracking accuracy and reliability, as evidenced by reduced identity switches and enhanced occlusion handling. These advancements not only contribute to the state of the art in object tracking but also open new avenues for future research and practical applications demanding high precision and reliability.
Problem

Research questions and friction points this paper is trying to address.

Enhancing multi-object tracking with enriched appearance features
Reducing identity switches during occlusions in object tracking
Improving association accuracy through complementary feature embeddings
Innovation

Methods, ideas, or system contributions that make the work stand out.

Extended YOLOX outputs multiple appearance attributes
Joint distance function combines IoU and feature cues
Global linking and Gaussian smoothing handle missing associations
๐Ÿ”Ž Similar Papers
No similar papers found.
H
Hamidreza Hashempoor
Pintel Co. Ltd., Seoul, South Korea
R
Rosemary Koikara
Pintel Co. Ltd., Seoul, South Korea
Y
Yu Dong Hwang
Pintel Co. Ltd., Seoul, South Korea