Score
Design, implement, and evaluate algorithms and gating mechanisms that associate measurements or detections across time and multiple sensors into consistent tracks or identities. This work includes building measurement gates and similarity tests (kinematic, bearing/distance, appearance, or joint constraints), resolving identity switches under occlusion and missed detections, reducing false associations, and optimizing for runtime latency and robustness.
本文针对多目标跟踪中的评估不一致问题,通过系统回顾基于检测的跟踪方法,并从最小基线跟踪器出发公平评估各方法贡献。
This paper identifies a previously unrecognized statistical bias in Kalman filter tracking arising jointly from validation gating and nearest-neighbor (NN) data association. Specifically, conventional chi-square gating renders the innovation process conditional rather than unconditional, inducing a systematic mean shift and a deterministic, dimension-dependent contraction of the innovation covariance. NN association further introduces an irreducible energy attenuation. The authors derive, for the first time, closed-form expressions for the first- and second-order moments of the gated-and-associated innovation under general elliptical gating, establishing an exact statistical model. Theoretical analysis and two-dimensional numerical experiments demonstrate that this dual selection mechanism induces innovation covariance biases of 10%–30%, substantially compromising filter performance evaluation and tuning of design parameters such as gate size and process noise.
High-precision online estimation algorithms for robotics are highly sensitive to sensor timestamp accuracy; however, existing synchronization solutions struggle to simultaneously achieve real-time operation, low cost, and high temporal precision. To address this, we propose a real-time, trigger-based time synchronization system built on commodity hardware. Our approach employs a hardware-triggered mechanism to jointly schedule heterogeneous sensors operating at different frequencies, and integrates an enhanced clock synchronization protocol with nanosecond-resolution timestamping to ensure precise coordination between sensors and the onboard computer. Crucially, the system eliminates reliance on expensive dedicated timing hardware, thereby substantially mitigating the impact of timing errors on online estimation. Experimental evaluation on a physical robot platform demonstrates sub-microsecond synchronization accuracy, along with significant improvements in both estimation robustness and real-time performance.
Existing evaluation metrics for visual object tracking lack a comparable, continuous-time measure for the trajectory function of time (FoT), relying instead on discrete-frame assessments that fail to characterize arbitrary-time states or disentangle distinct error types (e.g., localization, false positives, missed detections). Method: We propose Star-ID—the first spatiotemporally aligned trajectory integral distance—defining a rigorous, comparable FoT metric over continuous spacetime. Star-ID strictly distinguishes temporally aligned versus misaligned trajectory segments and analytically decouples detection and localization errors. It introduces time-averaged metrics and a theoretical error decomposition model, supported by a multi-object numerical validation framework. Contribution/Results: We provide formal theoretical analysis and demonstrate—via both single- and multi-object simulations—that Star-ID significantly enhances physical interpretability and fine-grained discriminative power in tracking evaluation, enabling precise, continuous-time performance assessment.
To address accuracy degradation and computational overhead caused by measurement-to-state association uncertainty in multi-object tracking (MOT), this paper proposes the Probabilistic Data Association Kalman Filter (PKF). Methodologically, PKF treats data association as a latent variable and employs variational inference with an EM algorithm for efficient Bayesian state estimation. It introduces the first explicit use of the permanent of the likelihood matrix to compute association probabilities and incorporates an ambiguity-aware detection mechanism that applies probabilistic association only to ambiguous subsets—balancing accuracy and efficiency. Additionally, PKF adopts an extended measurement vector and a lightweight bounding-box association strategy. Experiments demonstrate that PKF achieves state-of-the-art HOTA scores among Kalman-based MOT methods on MOT17, MOT20, and DanceTrack, with CPU-only inference exceeding 250 fps. Remarkably, using detections alone—without appearance or velocity features—PKF ranks within the top-10 on both MOT17 and MOT20 leaderboards.
Existing visual SLAM methods exhibit severe generalization deficits across diverse applications (e.g., XR, IoT, autonomous driving, UAVs, human pose tracking) and heterogeneous environments (indoor/outdoor, static/dynamic scenes, varying motion patterns), stemming from deep coupling among algorithm design, environmental characteristics, and platform motion dynamics. Method: We propose the first three-dimensional challenge taxonomy—“algorithm–environment–motion”—and systematically evaluate state-of-the-art methods (ORB-SLAM2/3, VINS-Fusion) on multi-source benchmarks (TUM, EuRoC, ARKitScenes, UAV-Human), quantifying performance via absolute trajectory error (ATE), relative pose error (RPE), and tracking loss. Contribution/Results: No method achieves robust cross-domain or intra-domain heterogeneous generalization. To address this, we introduce a principled co-optimization pathway comprising input representation disentanglement, intermediate information reuse, and output dynamic validation—establishing a reproducible benchmark and foundational design principles for universal visual localization.
This study addresses fundamental engineering challenges in developing multi-sensor platforms for autonomous driving, encompassing mechanical structure design, joint calibration, power management, and time synchronization. To mitigate these pervasive issues, the project employs a high-precision GNSS/NTP-based time synchronization scheme, devises customized sensor calibration procedures, and optimizes both the platform's mechanical architecture and power supply topology. The primary contribution lies in distilling a reusable set of best practices for multi-sensor platform construction, thereby establishing a standardized reference for related system designs. Consequently, the proposed approach significantly enhances system robustness, experimental reproducibility, and data acquisition integrity during deployment in complex, unstructured outdoor environments.
研究通过结合学习的对象检测和图像-文本比较等方法,解决带宽限制下空中传感器视频传输问题,显著降低数据量。
该研究通过系统实验评估了多目标跟踪算法中检测和关联组件的贡献,揭示了检测质量对整体性能的影响远大于关联策略,并提供了设计优化MOT系统的实用指导。
This work addresses the lack of effective auditing mechanisms in current AI-based motion capture systems, which hinders verification of whether inferred skeletal poses conform to authentic human behavior. To tackle this challenge, the authors propose a novel auditing framework that integrates contextual reasoning with biomechanical symmetry principles. By embedding practical application contexts into the evaluation process and combining motion capture outputs with empirically verifiable real-world measurements—even in the absence of ground truth or amid contested annotations—the method enables rigorous empirical auditing of system behavior. The approach successfully uncovers implicit assumptions and biases in how ground truth is defined within existing systems, thereby offering both theoretical foundations and practical pathways for trustworthy assessment of motion capture technologies.
This work addresses the challenge of time synchronization among heterogeneous sensors in roadside and vehicle-mounted multi-LiDAR–multi-camera systems by proposing an open-source, modular, and scalable hardware synchronization solution. Using the LiDAR synchronization pulse as a reference, the system employs programmable delay circuits to generate independent trigger signals for each camera, enabling flexible and precise spatiotemporal alignment. The architecture supports arbitrary combinations of sensor counts and has been validated on both a three-camera roadside platform and a seven-camera vehicular setup. Experimental results demonstrate significantly improved spatial consistency between point clouds and images, while the design ensures robustness, reproducibility, and ease of deployment.