Deep reinforcement learning is a data-driven method, which is very promising for alleviating traffic congestion through intelligent control of traffic lights. In this paper, the traffic signal of an intersection is divided into four independent phases and then controlled by deep Q-network (DQN) models respectively. Models can receive observations from their own angle of view, i.e., north-south straight, north-south left turn, east-west straight, east-west left turn, instead of extracting features from the whole scene. We suppose that it is beneficial for learning better policy if agents could sense the environment more precisely. DQN models are jointly trained under the revised QMIX framework to promote coordination capability. For decentralized execution, traffic lights of the phase with the highest Q-value will turn green. The experiments are done under SUMO, the results demonstrate that our method obtains higher reward and lower delay compared to controlling the holistic cycle by using a single DQN model.
Single Intersection Traffic Light Control by Multi-agent Reinforcement Learning
Tongchun Du,Bo Wang,Liangchen Hu
Published 2023 in Journal of Physics: Conference Series
ABSTRACT
PUBLICATION RECORD
- Publication year
2023
- Venue
Journal of Physics: Conference Series
- Publication date
2023-03-01
- Fields of study
Physics, Computer Science, Engineering
- Identifiers
- External record
- Source metadata
Semantic Scholar
CITATION MAP
EXTRACTION MAP
CLAIMS
- No claims are published for this paper.
CONCEPTS
- No concepts are published for this paper.
REFERENCES
Showing 1-36 of 36 references · Page 1 of 1
CITED BY
Showing 1-8 of 8 citing papers · Page 1 of 1