Problem
Research questions and friction points this paper is trying to address.
3D scene graphs
uncertainty
hierarchical representation
robot perception
Probabilistic Scene Graphs: Hierarchical Representation and Real-time System
🤖 AI Summary
该研究解决了3D场景图中不确定性表示和传播问题，通过引入概率场景图（PSG）及高斯层次图（HGG），实现了实时感知与精确定位。
📝 Abstract
3D scene graphs provide semantically rich and hierarchical representations for robot perception. However, existing systems do not maintain uncertainty as an explicit belief or propagate it through the operations that construct and refine the graph. We introduce Probabilistic Scene Graph (PSG), a generalization of the conventional scene graph that represents a posterior over possible graphs, factorized into a discrete graph structure of entities, relations, and semantic attributes, and continuous states that ground them spatially, with uncertainty maintained over both components. Geometry is carried directly by the nodes rather than selected from a separately constructed metric map, so a metric map, where needed, follows from the graph rather than preceding it. We instantiate PSG's probabilistic spatial grounding with hierarchical graphs of Gaussians (HGG): each object primitive is represented by a full-covariance Gaussian under a Normal-Inverse-Wishart belief, and the same parametrization applied recursively within a node yields a geometry graph that resolves its surface at finer resolution. We then build a mapping pipeline that preserves these beliefs throughout graph construction and refinement: a purely graph-based coarse-to-fine alignment registers observations by comparing node beliefs, while a nested Expectation-Maximization and factor-graph optimization jointly refines poses, object parameters, and internal geometry. Across six datasets spanning indoor RGB-D, outdoor LiDAR, and cross-modality deployment, HGG operates at sensor rate with near-constant memory and achieves state-of-the-art object accuracy and zero-shot graph alignment.
Innovation
Methods, ideas, or system contributions that make the work stand out.
Probabilistic Scene Graph
Uncertainty Propagation
Hierarchical Graphs of Gaussians
Graph-based Alignment
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
