MotionDisco: Motion Discovery for Extreme Humanoid Loco-Manipulation

πŸ“… 2026-06-04
πŸ“ˆ Citations: 0
✨ Influential: 0
πŸ“„ PDF

career value

201K/year
πŸ€– AI Summary
This work proposes a fully automated, human-demonstration-free approach to discover long-horizon locomotion-manipulation skills for humanoid robots in complex environments from scratch. By integrating large language model–guided evolutionary search with sequential dynamic trajectory optimization and motion pruning strategies, the method efficiently explores feasible whole-body motion sequences. High-precision tracking control is achieved through reinforcement learning. For the first time, this framework autonomously generates and deploys highly challenging, long-horizon task skills without relying on teleoperation or motion retargeting. The approach successfully discovers diverse and effective trajectories in simulation and seamlessly transfers them to real-world humanoid robots, demonstrating robust zero-shot sim-to-real transfer and eliminating dependence on human-provided demonstrations.
πŸ“ Abstract
We present MotionDisco, a framework that discovers contact-rich, long-horizon humanoid loco-manipulation motions from scratch, without relying on teleoperation or motion retargeting from human demonstrations. This is challenging because the space of possible contact interactions grows combinatorially with the task horizon and the number of objects in the scene. MotionDisco enables rapid discovery of novel motions by coupling a large language model (LLM) guided evolutionary search over sequences of interactions with an efficient sequential kinodynamic trajectory optimizer and pruning strategy, enabling the rapid discovery of novel skills. Through extensive ablation studies, we show that our LLM-guided search discovers successful whole-body trajectories across several challenging long-horizon tasks. Finally, by training reinforcement learning tracking policies on the discovered trajectories, we transfer the motions to a real humanoid robot. This is the first work to discover and deploy long-horizon humanoid loco-manipulation skills entirely through automated evolutionary search. Supplementary videos of the experiments are available at: https://youtu.be/DHiVz34QYlw.
Problem

Research questions and friction points this paper is trying to address.

humanoid locomotion
manipulation
contact-rich motion
long-horizon tasks
motion discovery
Innovation

Methods, ideas, or system contributions that make the work stand out.

Motion Discovery
Humanoid Loco-Manipulation
LLM-Guided Search
Evolutionary Optimization
Kinodynamic Trajectory Planning
πŸ”Ž Similar Papers
2024-07-16Neural Information Processing SystemsCitations: 16
πŸ’Ό Related Jobs
I
Ilyass Taouil
Technical University of Munich, Germany
M
Michal Ciebelski
Technical University of Munich, Germany
S
Shafeef Omar
Technical University of Munich, Germany
H
Haizhou Zhao
Technical University of Munich, Germany
Angela Dai
Angela Dai
Technical University of Munich
Computer GraphicsComputer Vision
Aaron M. Johnson
Aaron M. Johnson
Carnegie Mellon University
Legged LocomotionBioinspired RoboticsDynamical SystemsContactRobot Ethics
Majid Khadiv
Majid Khadiv
Assistant Professor, TUM
Robotics