Adaptive Traffic Signal Control : Exploring Reward Definition For Reinforcement Learning - Université Pierre et Marie Curie Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

Adaptive Traffic Signal Control : Exploring Reward Definition For Reinforcement Learning

Mohamed Ait Babram
  • Fonction : Auteur
Tri Nguyen-Huu
  • Fonction : Auteur
Nicolas Marilleaub
  • Fonction : Auteur
Moulay L. Hbid
  • Fonction : Auteur
Christophe Cambier
  • Fonction : Auteur
Serge Stinckwich
  • Fonction : Auteur

Résumé

As mobility grow in urban cities, traffic congestion become more frequent and troublesome. traffic signal is one way to decrease traffic congestion in urban areas but needs to be adjusted in order to take into account the stochasticity of traffic. Reinforcement learning (RL) has been the object of investigation of many recent papers as a promising approach to control such a stochastic environment. The goal of this paper is to analyze the feasibility of RL, particularly the use of Q-learning algorithm for adaptive traffic signal control in different traffic dynamics. A RL control was developed for an isolated multi-phase intersection using a microscopic traffic simulator known as Paramics. The novelty of this work consists of its methodology which uses a new generalized state space with different known reward definitions. The results of this study demonstrate the advantage of using RL over fixed signal plan, and yet exhibit different outcomes depending on the reward definitions and different traffic dynamics being considered.

Dates et versions

hal-01540391 , version 1 (16-06-2017)

Identifiants

Citer

Saad Touhbi, Mohamed Ait Babram, Tri Nguyen-Huu, Nicolas Marilleaub, Moulay L. Hbid, et al.. Adaptive Traffic Signal Control : Exploring Reward Definition For Reinforcement Learning. 8th International Conference on Ambient Systems, Networks and Technologies, ANT-2017 and the 7th International Conference on Sustainable Energy Information Technology, SEIT 2017, 16-19 May 2017, Madeira, Portugal, May 2017, Madeira, Portugal. pp.513-520, ⟨10.1016/j.procs.2017.05.327⟩. ⟨hal-01540391⟩
123 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More