Unlock Reliable Skill Inference for Quadruped Adaptive Behavior by Skill Graph

📅 2023-11-10
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
Quadrupedal robots face significant challenges in rapidly adapting to unknown off-road environments due to weak skill reusability and poor few-shot adaptability in existing approaches. Method: This paper introduces the Robot Skill Graph (RSG), a novel, knowledge-graph-inspired framework for dynamically organizing robotic skills. RSG models large-scale dynamic locomotion skills and their implicit inter-skill relationships via behavior representation learning, and enables efficient skill composition and generalization for novel tasks through context-aware retrieval and graph neural network–driven skill reasoning. Contribution/Results: Experiments demonstrate that RSG substantially improves skill reasoning accuracy and boosts sample efficiency in transfer learning by over threefold. It provides a scalable, structured solution for few-shot rapid adaptation of embodied agents—marking the first application of knowledge-graph principles to dynamic robotic skill organization and reasoning.
📝 Abstract
Developing robotic intelligent systems that can adapt quickly to unseen wild situations is one of the critical challenges in pursuing autonomous robotics. Although some impressive progress has been made in walking stability and skill learning in the field of legged robots, their ability for fast adaptation is still inferior to that of animals in nature. Animals are born with a massive set of skills needed to survive, and can quickly acquire new ones, by composing fundamental skills with limited experience. Inspired by this, we propose a novel framework, named Robot Skill Graph (RSG) for organizing a massive set of fundamental skills of robots and dexterously reusing them for fast adaptation. Bearing a structure similar to the Knowledge Graph (KG), RSG is composed of massive dynamic behavioral skills instead of static knowledge in KG and enables discovering implicit relations that exist in between the learning context and acquired skills of robots, serving as a starting point for understanding subtle patterns existing in robots' skill learning. Extensive experimental results demonstrate that RSG can provide reliable skill inference upon new tasks and environments, and enable quadruped robots to adapt to new scenarios and quickly learn new skills.
Problem

Research questions and friction points this paper is trying to address.

Quadruped robot adaptation
Skill graph organization
Fast skill acquisition
Innovation

Methods, ideas, or system contributions that make the work stand out.

Skill Graph organizes robot skills
RSG enables fast skill adaptation
Dynamic behavioral skills in RSG
🔎 Similar Papers
No similar papers found.
H
Hongyin Zhang
Machine Intelligence Lab (MiLAB), School of Engineering, Westlake University, Hangzhou, China
Diyuan Shi
Diyuan Shi
Westlake University
Machine LearningReinforcement Learning
Zifeng Zhuang
Zifeng Zhuang
Westlake University
Reinforcement Learning
H
Han Zhao
Machine Intelligence Lab (MiLAB), School of Engineering, Westlake University, Hangzhou, China
Zhenyu Wei
Zhenyu Wei
Westlake university
RobotSignal ProcessingReinforcement LearningCircuit DesignCompressed Sensing
F
Feng Zhao
Machine Intelligence Lab (MiLAB), School of Engineering, Westlake University, Hangzhou, China
S
Sibo Gai
Machine Intelligence Lab (MiLAB), School of Engineering, Westlake University, Hangzhou, China
Shangke Lyu
Shangke Lyu
Westlake University
Robot controlLearning controlHuman-robot Interaction
D
Donglin Wang
Machine Intelligence Lab (MiLAB), School of Engineering, Westlake University, Hangzhou, China