Generation of Geodesics with Actor-Critic Reinforcement Learning to Predict Midpoints

๐Ÿ“… 2024-07-02
๐Ÿ›๏ธ arXiv.org
๐Ÿ“ˆ Citations: 0
โœจ Influential: 0
๐Ÿ“„ PDF
๐Ÿค– AI Summary
This work addresses the challenge of computing geodesicsโ€”i.e., globally shortest paths under an infinitesimal metricโ€”on Riemannian manifolds. We propose a generative framework based on recursive midpoint prediction. Our core innovation is the first integration of Actor-Critic reinforcement learning into geodesic midpoint prediction, with theoretical guarantees of geometric consistency and convergence. The method jointly models manifold geometry and motion planning optimization, bypassing explicit differential equation solving or manifold discretization. It generalizes directly to high-dimensional, nonlinearly constrained spaces. Experiments demonstrate state-of-the-art performance in complex dynamical agent navigation and collision-free motion planning for 7-DOF robotic arms, significantly outperforming existing sampling-based, optimization-based, and learning-based approaches. The method achieves superior accuracy, computational efficiency, and scalability.

Technology Category

Machine Learning: Learning with ManifoldsHumans and AI: Human-Aware Planning and Behavior PredictionPlanning, Routing, and Scheduling: Replanning and Plan Repair

Application Category

Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphsResponsible Web: Machine-in-the-loop, human agency and autonomyEconomics, Online Markets and Human Computation: Economic ramifications for generative AI infrastructure and applications
๐Ÿ“ Abstract
To find the shortest paths for all pairs on manifolds with infinitesimally defined metrics, we introduce a framework to generate them by predicting midpoints recursively. To learn midpoint prediction, we propose an actor-critic approach. We prove the soundness of our approach and show experimentally that the proposed method outperforms existing methods on several planning tasks, including path planning for agents with complex kinematics and motion planning for multi-degree-of-freedom robot arms.
Problem

Research questions and friction points this paper is trying to address.

Generate geodesics via midpoint prediction on manifolds
Learn midpoint prediction using actor-critic reinforcement learning
Outperform existing methods in complex path and motion planning
Innovation

Methods, ideas, or system contributions that make the work stand out.

Actor-critic reinforcement learning for geodesics
Recursive midpoint prediction framework
Outperforms existing planning methods
๐Ÿ”Ž Similar Papers
๐Ÿ’ผ Related Jobs
No related jobs found.
OMRON SINIC X Corporation
K
Kazumi Kasaura
OMRON SINIC X Corporation