Semantic-weighted ICP for LiDAR Odometry: Class-Aware Residual Reweighting for Robust Scan Registration

2026-06-02

AI Summary

This work addresses the performance degradation of conventional LiDAR odometry in dynamic or unstructured environments, where unreliable point correspondences—caused by moving objects, vegetation, or sparse geometry—adversely affect pose estimation. To mitigate this issue, the authors propose a semantic category-weighted ICP (Iterative Closest Point) approach that leverages semantic segmentation to identify point cloud categories and dynamically adjusts the weights of registration residuals based on the geometric stability of each semantic class. Rather than discarding dynamic points outright, this strategy suppresses disruptive influences while preserving structurally informative points. Evaluated on the SemanticKITTI and RELLIS-3D datasets, the method demonstrates significant improvements in pose accuracy and robustness, particularly in off-road scenarios characterized by a scarcity of rigid geometric features.

Abstract

LiDAR odometry is a fundamental component of autonomous robotic systems, relying on geometric registration between consecutive point clouds to estimate ego-motion. However, traditional geometric approaches often degrade in dynamic or unstructured environments due to unreliable correspondences caused by moving objects, sparse geometric features, vegetation, and semantically ambiguous structures. Existing works have shown that, some of these limitations can be addressed by introducing semantic information from the environment in the registration process. In this work, we build on this, and show that not all elements in the environment are equally relevant for registration. Hence, we propose a semantic class-weighted ICP for LiDAR odometry. Instead of strictly filtering out points belonging to specific semantic classes, the proposed approach weights the residuals of points belonging to semantic categories based on their expected geometric stability. This strategy enables informative but potentially unstable structures, to contribute to the registration process while mitigating the influence of dynamic objects. The experimental evaluation was conducted on the SemanticKITTI and RELLIS-3D datasets, which include urban, highway, rural, and off-road environments. The empirical results show that the proposed Semantic-weighted ICP improves pose estimation, especially in challenging off-road scenarios where conventional rigid features are scarce. Furthermore, the analysis reveals that the effectiveness of this weighting strategy is highly environment-dependent, influenced by the structural and semantic composition of the scene.

Problem

• LiDAR odometry
• scan registration
• semantic ambiguity
• dynamic environments
• geometric instability

Innovation

• Semantic-weighted ICP
• LiDAR odometry
• class-aware reweighting
• scan registration
• geometric stability