Recent advances in combining deep learning and Reinforcement Learning have shown a promising path for designing new control agents that can learn optimal policies for challenging control tasks. These new methods address the main limitations of conventional Reinforcement Learning methods such as customized feature engineering and small action state space dimension requirements. In this paper, we leverage one of the state-of-the-art Reinforcement Learning methods, known as Trust Region Policy Optimization, to tackle intersection management for autonomous vehicles. We show that using this method, we can perform fine-grained acceleration control of autonomous vehicles in a grid street plan to achieve a global design objective.
Recently several artificial intelligence labs have suggested the use of fully equipped vehicles with the capability of sensing the surrounding environment to enhance roadway safety. As a result, it is anticipated in the future that many vehicles will be autonomous and thus there is a need to optimize the movement of these vehicles. This paper presents a new tool for optimizing the movements of autonomous vehicles through intersections: iCACC. The main concept of the proposed tool is to control vehicle trajectories using Cooperative Adaptive Cruise Control (CACC) systems to avoid collisions and minimize intersection delay. Simulations were executed to compare conventional signal control with iCACC considering two measures of effectiveness - delay and fuel consumption. Savings in delay and fuel consumption in the range of 91 and 82 percent relative to conventional signal control were demonstrated, respectively.