Adaptive Traffic Signal Control Using Deep Reinforcement Learning with Noise Injection

Read full text
Authors: Raul Alejandro Velasquez Ortiz, M Gómez Ramírez, Luis Agustín Alvarez-Icaza, Héctor Alonso Guzmán Gutiérrez
Cited by: 1
References: 57

Abstract

Adaptive traffic signal control (ATSC) remains a critical challenge for urban mobility. In this direction, deep reinforcement learning (DRL) has been widely investigated for ATSC, showing promising improvements in simulated environments. However, a noticeable gap remains between simulation-based results and practical implementations, due to reward formulations that do not address phase instability. Stochastic variations may trigger premature phase changes (“flickers”), affecting signal behavior and potentially limiting deployment in real scenarios. Although several works have examined delay, queues, and decentralized coordination, stability-focused variables remain comparatively less explored, particularly in single yet complex intersections. This study proposes a decentralized DRL model for ATSC with noise injection (ATSC-DRLNI) applied to a single intersection, introducing a stability-oriented reward function that integrates flickers, queue length, and advantage actor-critic (A2C) learning feedback. The model is evaluated in the Simulation of Urban MObility (SUMO) platform and compared against seven baseline methods, using real traffic data from a Mexican city for calibration and validation. Results suggest that penalizing flickers may contribute to more stable phase transitions, while reductions of up to 40% in queue length were observed in heavy-traffic scenarios. These findings indicate that incorporating stability-related variables into reward functions may help in implementing DRL-based ATSC studies.

Fields of Study & Subjects

Traffic control and management Traffic Prediction and Management Techniques Traffic and Road Safety

Publication details

Journal / source
Applied Sciences
Publisher
MDPI AG
Volume
16
Issue
8
Pages
3833–3833
Publication date
15 April 2026
Language
EN