Technology Category
Intelligent Robots: Embodied AISearch and Optimization: Sampling/Simulation-based SearchCognitive Modeling & Cognitive Systems: Simulating Human Behavior
A Survey of Robotic Navigation and Manipulation with Physics Simulators in the Era of Embodied AI
🤖 AI Summary
To address performance degradation in sim-to-real transfer for embodied intelligence—caused by modeling discrepancies in physics simulators—this paper presents the first systematic, three-dimensional evaluation of mainstream engines (e.g., PyBullet, MuJoCo, Isaac Gym) along physical fidelity, task adaptability, and hardware constraints. We integrate cutting-edge techniques—including world models and geometrically equivariant networks—to establish a comprehensive benchmark featuring multi-task datasets, unified evaluation metrics, and an open-source platform. Furthermore, we propose a task-aware simulator selection framework that quantifies trade-offs among accuracy, real-time capability, differentiability, and deployment compatibility for navigation and manipulation tasks. Our contributions include an open-source evaluation repository and practical guidelines, providing both theoretical foundations and engineering evidence to reduce real-world training costs and enhance transfer robustness.
Technology Category
Application Category
📝 Abstract
Navigation and manipulation are core capabilities in Embodied AI, yet training agents with these capabilities in the real world faces high costs and time complexity. Therefore, sim-to-real transfer has emerged as a key approach, yet the sim-to-real gap persists. This survey examines how physics simulators address this gap by analyzing their properties overlooked in previous surveys. We also analyze their features for navigation and manipulation tasks, along with hardware requirements. Additionally, we offer a resource with benchmark datasets, metrics, simulation platforms, and cutting-edge methods-such as world models and geometric equivariance-to help researchers select suitable tools while accounting for hardware constraints.
Problem
Research questions and friction points this paper is trying to address.
Addressing sim-to-real gap in robotic navigation and manipulation
Analyzing physics simulators' properties for Embodied AI tasks
Providing benchmark resources for tool selection under hardware constraints
Innovation
Methods, ideas, or system contributions that make the work stand out.
Physics simulators reduce sim-to-real gap
Benchmark datasets aid tool selection
World models enhance navigation and manipulation
🔎 Similar Papers
2024-07-09IEEE/ASME transactions on mechatronicsCitations: 94
💼 Related Jobs
