A Reinforcement learning method for traffic signal control at an isolated intersection with pedestrian flows

Biao Yin, Monica Menendez

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In the paper, we propose a model-based reinforcement learning algorithm, i.e., approximate dynamic programming for signal control at isolated intersections with mixed traffic: vehicles and pedestrians. The integrated optimization problem is formulated by the discrete-time dynamic process. The system state is represented by the combination of weighted vehicle queue lengths and the number of waiting pedestrians. The system action is generated in each decision step by the proposed algorithm. To solve the computation issue in conventional dynamic programming, the proposed algorithm adopts a linear approximation function that helps to quickly obtain a near-optimal solution. In simulation, we extract traffic information from the traffic simulator SUMO. The on-line traffic information is provided for the algorithm to make a signal decision. After testing various scenarios, results show that the proposed algorithm has potential control performance. We also reveal the delay changes with different weights assigned to the vehicle and pedestrian components.

Original languageEnglish (US)
Title of host publicationCICTP 2019
Subtitle of host publicationTransportation in China - Connecting the World - Proceedings of the 19th COTA International Conference of Transportation Professionals
EditorsLei Zhang, Jianming Ma, Pan Liu, Guangjun Zhang
PublisherAmerican Society of Civil Engineers (ASCE)
Pages3123-3135
Number of pages13
ISBN (Electronic)9780784482292
DOIs
StatePublished - 2019
Event19th COTA International Conference of Transportation Professionals: Transportation in China - Connecting the World, CICTP 2019 - Nanjing, China
Duration: Jul 6 2019Jul 8 2019

Publication series

NameCICTP 2019: Transportation in China - Connecting the World - Proceedings of the 19th COTA International Conference of Transportation Professionals

Conference

Conference19th COTA International Conference of Transportation Professionals: Transportation in China - Connecting the World, CICTP 2019
CountryChina
CityNanjing
Period7/6/197/8/19

Keywords

  • Approximate dynamic programming
  • Intersection
  • Pedestrians
  • Signal control

ASJC Scopus subject areas

  • Transportation

Fingerprint Dive into the research topics of 'A Reinforcement learning method for traffic signal control at an isolated intersection with pedestrian flows'. Together they form a unique fingerprint.

Cite this