motion primitive design

Designing reusable low-level action chunks or motion primitives and mapping high-level descriptions into those primitives so they can be integrated into sampling controllers (e.g., MPPI), policy proposals, and robot execution pipelines (ROS) for structured exploration and reliable control.

motionprimitivedesign

12-Month Skill Trend

Momentum and market value over time
Trending
Score
+20 in 12 mo
96
12 mo agoNow
Career
Value
+$12K in 12 mo
$42K/year
12 mo agoNow

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

Signal Temporal Logic Compliant Co-design of Planning and Control

Jul 17, 2025
MS
Manas Sashank Juvvi
🏛️ IISc | Technical University Delft

Autonomous robots face challenges in decoupling trajectory planning from control and ensuring formal verification when executing Signal Temporal Logic (STL) tasks in complex environments. Method: This paper proposes a model-free planning–control co-design framework. It offline constructs a spatiotemporal motion primitive library via reinforcement learning and establishes a verifiable mapping from primitives to STL spatiotemporal semantics. Online, it integrates sampling-based STL-satisfying planning to synthesize safe motion sequences adhering to diverse temporal constraints. Contribution/Results: The framework requires no system dynamics model and enables end-to-end behavioral verification. Experiments on differential-drive and quadrupedal robot platforms demonstrate its effectiveness and generalization capability in dynamic obstacle avoidance and multi-objective temporal tasks.

Generate STL-compliant motion plans for autonomous robotsIntegrate trajectory planning and control for STL tasksLearn spatio-temporal motion primitives for robot constraints

Behavioral modeling in robotics lacks systematic empirical understanding of the practical differences and commonalities between Behavior Trees (BTs) and State Machines (SMs). Method: We conduct the first large-scale empirical comparison across 1,200+ open-source ROS projects, leveraging domain-specific language (DSL) parsing, code mining, and conceptual mapping to analyze BT and SM usage across language design, structural abstraction, reuse patterns, and engineering practice. Contribution/Results: We find a significant upward trend in BT DSL adoption; uncover deep isomorphisms between BTs and SMs in control-flow abstraction granularity and modular reuse mechanisms; and release RoboBT-SM-Bench—the first cross-DSL, fully annotated benchmark dataset of robotic behavioral models. This work establishes an empirical foundation and infrastructure support for unifying theoretical frameworks and designing reusable architectures for behavioral modeling languages.

Analyzing real-world usage of behavior modeling languages in roboticsComparing behavior trees and state machines for robot behavior coordinationStudying language design concepts in behavior tree DSL implementations

This work addresses the “execution gap” between high-level semantic tasks and executable robot motions by introducing Motion Statecharts—a symbolic, executable motion representation that supports concurrency and hierarchical nesting. Coupled with a unified differentiable kinematic world model, this framework enables end-to-end mapping from semantic task specifications to low-level motion control. Smooth and dynamically feasible trajectories are generated through a linear model predictive control (lMPC)-driven task-function approach incorporating snap (jerk derivative) constraints. The proposed system has been successfully deployed across eight heterogeneous robotic platforms, demonstrating strong cross-platform generalization and real-world efficacy. The accompanying software framework, Giskard, has been publicly released.

Kinematic ControlMotion Execution GapRobot Motion Planning

Traditional hierarchical robotic planning simplifies task-level actions into open-loop kinematic skills, hindering seamless integration of pre-trained closed-loop motor controllers. Method: We propose Composable Interaction Primitives (CIPs), a framework enabling plug-and-play composition of heterogeneous, non-composable pre-trained skills within task-and-motion planning. Building upon CIPs, we introduce Task-and-Skill Planning (TASP), a unified architecture that jointly models symbolic task planning, geometric motion planning, and learned closed-loop control. Contribution/Results: TASP transcends reliance on motion-centric skills by elevating task semantics to the perception–action closed-loop level. Evaluated on a real mobile manipulator, it achieves end-to-end autonomous execution of multi-step complex tasks—including dynamic collaborative transport and tool manipulation—demonstrating significantly improved skill reusability and environmental adaptability.

Combining motion planning with general-purpose skills for complex tasksEnabling use of diverse pre-learned skills in hierarchical planningIntegrating kinematic skills and closed-loop motor controllers in planning

This work addresses the limitations of traditional signal temporal logic (STL)-based sampling-based planning, which relies on min-max robustness metrics that consider only critical time points and subformulas, resulting in non-smooth optimization landscapes and inefficient search. To overcome this, the authors propose the RRT$^\eta$ framework, which introduces arithmetic-geometric mean (AGM) robustness semantics to evaluate satisfaction across all time points and subformulas, enabling continuous and globally aware trajectory reasoning. The approach integrates efficient incremental monitoring with a fulfillment-priority-logic-derived gradient-like vector that guides the search toward higher satisfaction. Experiments on a double integrator, unicycle, and a 7-DOF manipulator demonstrate that the method significantly improves planning performance and robustness under multi-constraint and weakly guided scenarios, while preserving probabilistic completeness and asymptotic optimality.

non-smooth optimizationrobustness measuresampling-based motion planning

Latest Papers

What's happening recently
View more

This work addresses the challenge of reusing skills across tasks in offline hierarchical reinforcement learning by proposing a reusable skill abstraction mechanism grounded in local dynamics similarity. Building upon the HIQL framework, the method employs contrastive action representation learning (CARL) to automatically cluster semantically meaningful low-level skills and aligns action sequences across tasks to identify their applicable contexts. By capturing fine-grained dynamic similarities, the approach substantially enhances the high-level policy’s ability to effectively schedule low-level skills. Empirical evaluations demonstrate significant performance gains on downstream tasks in complex humanoid environments and the OGBench benchmark, highlighting the method’s capacity to improve cross-task skill transfer in offline settings.

Hierarchical Reinforcement LearningLocal DynamicsOffline RL

This work addresses the limited exploration capability and difficulty in converging to global optima inherent in sampling-based controllers for path planning. To overcome these challenges, the authors propose integrating motion primitives into the Model Predictive Path Integral (MPPI) framework. By fusing motion primitive-guided structured sampling with perturbed control sequences within the real-time optimization loop, the method substantially enhances exploration efficiency and global optimality in the control space while preserving MPPI’s intrinsic fast response characteristics. Evaluations on quadrotor obstacle navigation tasks demonstrate that the proposed algorithm significantly improves both exploratory behavior and real-time performance, thereby validating its superiority over conventional approaches.

control space explorationmodel predictive controlmotion primitives

This work addresses the fragility and lack of reactivity inherent in action chunking strategies when executed open-loop under stochastic dynamics, actuation errors, and partial observability. To mitigate these limitations, the authors propose a test-time augmentation method that integrates a lightweight latent world model into the action chunking framework. Without requiring policy fine-tuning, the approach performs predictive rollouts over multiple candidate action chunks and selects the sequence whose predicted states best align with actual observations. This enables dynamic adaptation to perturbations without additional training, substantially enhancing robustness and responsiveness in long-horizon tasks. Experiments on the Kinetix benchmark and four real-world robotic manipulation tasks demonstrate significant improvements in success rates over baseline methods, particularly when demonstration data includes corrective behaviors.

action chunkingopen-loop executionpartial observability

This work addresses the limited generalizability and transferability of current foundation models in robotics, which often require custom integration of perception, actuation, and safety mechanisms. To overcome this, the authors propose ROSClaw—a model-agnostic execution layer that enables plug-and-play deployment of arbitrary foundation models on any ROS 2 robot by integrating the OpenClaw agent runtime with ROS 2. Key innovations include standardized capability discovery, multimodal observation normalization, action validation within configurable safety bounds, and structured audit logging. Experiments across three robotic platforms and four foundation models demonstrate up to a 4.8× difference in non-policy action proposal rates and show that the proposed execution layer significantly improves task success rates and safety across diverse frameworks.

agentic AIembodied AIfoundation models

This work addresses the challenge of achieving hierarchical action representations in humanoid motor control that jointly support structured abstraction and fine-grained manipulation. The authors propose MotionPyramid, which introduces the concept of hierarchical perceptual representations into motor control by recursively stacking latent decoders to learn multiscale action hierarchies directly from motion data: high-level latent variables generate temporally extended action segments, while low-level variables produce immediate whole-body commands. After pretraining, this hierarchy is frozen and employed as a multi-resolution action interface for reinforcement learning policies, augmented with a residual mechanism that fuses coarse-grained action programs with fine-grained corrective commands. Experiments demonstrate that this approach accelerates early-stage learning, enhances movement regularity, and preserves feedback control precision, thereby unifying structured abstraction with high-fidelity motor execution.

action interfaceshierarchical motion representationhumanoid control

Hot Scholars

PW

Pengfei Wan

Head of Kling Video Generation Models, Kuaishou Technology
Generative ModelsComputer VisionMultimodal AIComputer Graphics
CK

C. Karen Liu

Professor of Computer Science, Stanford University
Computer GraphicsRobotics.
XL

Xiu Li

Bytedance Seed
Computer VisionComputer Graphics3D Vision
JC

Jiahang Cao

The University of Hong Kong
Robot LearningGenerative ModelsCognitive-inspired Models
MJ

Michael J. Black

Max Planck Institute for Intelligent Systems
Computer VisionComputer GraphicsMachine LearningVirtual Humans