Skip to Main content Skip to Navigation
Conference papers

New MDP Model and Learning Algorithm for Bus Scheduling Problem with Conditional Signal Priority

Abstract : Buses are expected to be punctual, but deviation from the schedule is a common occurrence. Transit signal priority (TSP) and conditional signal priority (CSP) are methods to help the bus perform the schedule better by giving traffic signal priority to the bus. Markov decision process (MDP) is suitable for modeling such sequential decision process. In this article, we point out the Markov property of the system based on the analysis of the bus driving process. We model the process of bus driving with CSP as a Markov decision process. Then, the Deep Q Network (DQN) algorithm is applied to solve this MDP model. To the best of our knowledge, this is the first time that the bus scheduling problem with CSP has been modeled as an MDP model and solved by a learning algorithm. Numerical experiments verify the applicability of the DQN algorithm to solve this MDP model.
Document type :
Conference papers
Complete list of metadata

https://hal-univ-evry.archives-ouvertes.fr/hal-03723270
Contributor : Frédéric Davesne Connect in order to contact the contributor
Submitted on : Thursday, July 14, 2022 - 11:14:04 AM
Last modification on : Tuesday, August 2, 2022 - 4:33:46 AM

Identifiers

  • HAL Id : hal-03723270, version 1

Citation

Ming Liu, Yecheng Zhao, Feng Chu, Feifeng Zheng, Chengbin Chu. New MDP Model and Learning Algorithm for Bus Scheduling Problem with Conditional Signal Priority. 10th IFAC Conference on Manufacturing Modelling, Management and Control (MIM 2022), Jun 2022, Nantes, France. ⟨hal-03723270⟩

Share

Metrics

Record views

0