🤖 AI Summary
In cross-morphological character motion retargeting, contact semantics—especially contact points—are often lost, leading to motion distortion. To address this, we propose the first contact-aware real-time motion retargeting framework. Our method automatically identifies binding key vertices to construct a low-dimensional shape-pose joint embedding; it introduces trajectory-based motion descriptors and a dynamic feature weighting optimization scheme that adaptively preserves source-contact constraints within a constrained optimization formulation. The framework supports multi-character coordinated retargeting and adaptation to non-planar terrain. Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art methods in contact accuracy and motion smoothness, while maintaining robustness and real-time performance across diverse morphologies, complex interactions, and highly uneven terrains.
📝 Abstract
Preserving semantics, in particular in terms of contacts, is a key challenge when retargeting motion between characters of different morphologies. Our solution relies on a low-dimensional embedding of the character's mesh, based on rigged key vertices that are automatically transferred from the source to the target. Motion descriptors are extracted from the trajectories of these key vertices, providing an embedding that contains combined semantic information about both shape and pose. A novel, adaptive algorithm is then used to automatically select and weight the most relevant features over time, enabling us to efficiently optimize the target motion until it conforms to these constraints, so as to preserve the semantics of the source motion. Our solution allows extensions to several novel use-cases where morphology and mesh contacts were previously overlooked, such as multi-character retargeting and motion transfer on uneven terrains. As our results show, our method is able to achieve real-time retargeting onto a wide variety of characters. Extensive experiments and comparison with state-of-the-art methods using several relevant metrics demonstrate improved results, both in terms of motion smoothness and contact accuracy.