Learning Traffic Signal Control via Genetic Programming

📅 2024-03-26
🏛️ Annual Conference on Genetic and Evolutionary Computation
📈 Citations: 2
✨ Influential: 0
📄 PDF
🤖 AI Summary
To address the challenges in deep reinforcement learning (DRL)-based signal control at complex intersections—including heavy reliance on handcrafted reward functions, opaque decision-making, and extensive domain expertise—this paper proposes an interpretable phase-based traffic signal control method grounded in *phase urgency*. We introduce a novel tree-structured urgency model that dynamically computes phase priorities from real-time traffic flow features. Instead of gradient-based optimization, we employ genetic programming to evolve human-readable, fully traceable control logic while preserving high performance. Evaluated across diverse SUMO simulation scenarios and multiple public benchmarks, our approach achieves an average 12.7% reduction in vehicle delay and a 9.4% improvement in throughput, significantly outperforming state-of-the-art traffic controllers and mainstream DRL algorithms. This work bridges the gap between high control performance and full algorithmic transparency.

Technology Category

Planning, Routing, and Scheduling: Model-Based ReasoningSearch and Optimization: Sampling/Simulation-based SearchReasoning under Uncertainty: Stochastic Optimization

Application Category

Responsible Web: Machine-in-the-loop, human agency and autonomySearch and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for rankingUser Modeling, Personalization and Recommendation: Explainable and interpretable methods for personalization
📝 Abstract
The control of traffic signals is crucial for improving transportation efficiency. Recently, learning-based methods, especially Deep Reinforcement Learning (DRL), garnered substantial success in the quest for more efficient traffic signal control strategies. However, the design of rewards in DRL highly demands domain knowledge to converge to an effective policy, and the final policy also presents difficulties in terms of explainability. In this work, a new learning-based method for signal control in complex intersections is proposed. In our approach, we design a concept of phase urgency for each signal phase. During signal transitions, the traffic light control strategy selects the next phase to be activated based on the phase urgency. We then proposed to represent the urgency function as an explainable tree structure. The urgency function can calculate the phase urgency for a specific phase based on the current road conditions. Genetic programming is adopted to perform gradient-free optimization of the urgency function. We test our algorithm on multiple public traffic signal control datasets. The experimental results indicate that the tree-shaped urgency function evolved by genetic programming outperforms the baselines, including a state-of-the-art method in the transportation field and a well-known DRL-based method.
Problem

Research questions and friction points this paper is trying to address.

Traffic Signal Control
Reinforcement Learning
Interpretable AI
Innovation

Methods, ideas, or system contributions that make the work stand out.

Urgency Concept
Genetic Programming
Intersections Traffic Control
💼 Related Jobs
No related jobs found.
Victoria University of Wellington
X
Xiao-Cheng Liao
Victoria University of Wellington, Centre for Data Science and Artificial Intelligence & School of Engineering and Computer Science, Wellington, New Zealand
Y
Yi Mei
Victoria University of Wellington, Centre for Data Science and Artificial Intelligence & School of Engineering and Computer Science, Wellington, New Zealand
M
Mengjie Zhang
Victoria University of Wellington, Centre for Data Science and Artificial Intelligence & School of Engineering and Computer Science, Wellington, New Zealand