New MDP Model and Learning Algorithm for Bus Scheduling Problem with Conditional Signal Priority - Archive ouverte HAL Access content directly
Conference Papers Year : 2022

New MDP Model and Learning Algorithm for Bus Scheduling Problem with Conditional Signal Priority

(1) , (1) , (2) , (3) , (4, 5)
1
2
3
4
5

Abstract

Buses are expected to be punctual, but deviation from the schedule is a common occurrence. Transit signal priority (TSP) and conditional signal priority (CSP) are methods to help the bus perform the schedule better by giving traffic signal priority to the bus. Markov decision process (MDP) is suitable for modeling such sequential decision process. In this article, we point out the Markov property of the system based on the analysis of the bus driving process. We model the process of bus driving with CSP as a Markov decision process. Then, the Deep Q Network (DQN) algorithm is applied to solve this MDP model. To the best of our knowledge, this is the first time that the bus scheduling problem with CSP has been modeled as an MDP model and solved by a learning algorithm. Numerical experiments verify the applicability of the DQN algorithm to solve this MDP model.

Dates and versions

hal-03723270 , version 1 (14-07-2022)

Identifiers

Cite

Ming Liu, Yecheng Zhao, Feng Chu, Feifeng Zheng, Chengbin Chu. New MDP Model and Learning Algorithm for Bus Scheduling Problem with Conditional Signal Priority. 10th IFAC Conference on Manufacturing Modelling, Management and Control (MIM 2022), Jun 2022, Nantes, France. pp.3160--3165, ⟨10.1016/j.ifacol.2022.10.215⟩. ⟨hal-03723270⟩
28 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More