EgoLAP: Learning from Egocentric Human Data through Language-Action Reasoning
This study addresses the challenge that first-person human data cannot be directly applied to robot control due to embodiment discrepancies, proposing the EgoLAP framework. Its core innovation lies in replacing low-level actions with cross-embodiment motion intentions and jointly learning human and robot trajectories through a shared language-action chain-of-thought. Furthermore, it introduces a motion-level reasoning mechanism integrating scene geometry, physics, and object affordances. Built upon vision-language-action (VLA) pretraining, this approach constructs a multimodal motion reasoning model. Real-world experiments demonstrate that EgoLAP achieves an average task progress of 80.1%, outperforming alternative action representations by a factor of 2.3 and surpassing composite reasoning formats.