Learning While Repositioning in On-Demand Vehicle Sharing Networks

2025-01-31

AI Summary

To address spatiotemporal supply–demand imbalance in one-way shared mobility networks under uncertain demand and vehicle return patterns with a fixed fleet size, this paper proposes a dynamic rescheduling method minimizing total operational cost. Methodologically, we design an *n*-dimensional optimal base-stock policy and prove its asymptotic optimality. Algorithmically, we introduce the first online gradient-based rescheduling algorithm relying solely on truncated demand observations—overcoming the “curse of dimensionality” and achieving an *O*(*n*^{2.5}√*T*) regret bound, which matches the theoretical lower bound and exhibits polynomial dependence on dimension *n*. Our approach integrates Lipschitz multi-armed bandits, online gradient estimation from truncated data, dual-solution-driven policy gradients, and surrogate cost modeling. Numerical experiments demonstrate substantial improvements over state-of-the-art benchmarks.

Technology Category

• Planning, Routing, and Scheduling: Scheduling under Uncertainty
• Machine Learning: Online Learning & Bandits
• Search and Optimization: Learning to Search

Application Category

• Economics, Online Markets and Human Computation: The sharing economy
• Graph Algorithms and Modeling for the Web: Efficient manipulation of static and dynamic Web-related graphs
• Responsible Web: Human-perceived consequences of algorithmic deployment on the web

Abstract

We consider a network inventory problem motivated by one-way, on-demand vehicle sharing services. Due to uncertainties in both demand and returns, as well as a fixed number of rental units across an $n$-location network, the service provider must periodically reposition vehicles to match supply with demand spatially while minimizing costs. The optimal repositioning policy under a general $n$-location network is intractable without knowing the optimal value function. We introduce the best base-stock repositioning policy as a generalization of the classical inventory control policy to $n$ dimensions, and establish its asymptotic optimality in two distinct limiting regimes under general network structures. We present reformulations to efficiently compute this best base-stock policy in an offline setting with pre-collected data. In the online setting, we show that a natural Lipschitz-bandit approach achieves a regret guarantee of $widetilde{O}(T^{frac{n}{n+1}})$, which suffers from the exponential dependence on $n$. We illustrate the challenges of learning with censored data in networked systems through a regret lower bound analysis and by demonstrating the suboptimality of alternative algorithmic approaches. Motivated by these challenges, we propose an Online Gradient Repositioning algorithm that relies solely on censored demand. Under a mild cost-structure assumption, we prove that it attains an optimal regret of $O(n^{2.5} sqrt{T})$, which matches the regret lower bound in $T$ and achieves only polynomial dependence on $n$. The key algorithmic innovation involves proposing surrogate costs to disentangle intertemporal dependencies and leveraging dual solutions to find the gradient of policy change. Numerical experiments demonstrate the effectiveness of our proposed methods.

Problem

• Vehicle Redistribution
• Network Optimization
• Demand-Supply Matching

Innovation

• Improved Inventory Adjustment Policy
• Online Gradient Adjustment Algorithm
• Substitute Cost Processing