Increased stress, fuel consumption, air pollution, accidents and delays are some of the consequences of traffic congestion usually incurring in tremendous economic impacts, which society aims to remedy in order to leverage a sustainable development. Recently, unconventional means for modeling and controlling such complex traffic systems relying on multi-agent systems have arisen. This paper contributes to the understanding of such complex and highly dynamic systems by proposing an open-source tool-chain to implement multi-agent-based solutions in traffic and transportation. The proposed approach relies on two very popular tools in both domains, with focus on traffic light control. This tool-chain consists in combining JADE (Java Agent DEvelopment Framework), for the implementation of multi-agent systems, with SUMO (Simulation of Urban MObility), for the microscopic simulation of traffic interactions. TraSMAPI (Traffic Simulation Manager Application Programming Interface) is used to combine JADE and SUMO allowing communication between them. A demonstration of the concept is presented to illustrate the main features of this tool-chain, using Q-Learning as the reinforcement learning method for each traffic light agent in a simulated network. Results demonstrate the feasibility of the proposed framework as a practical means to experiment with different agent-based designs of intelligent transportation solutions.
Regarding this simulation tools some examples of multi-agent system approaches for traffic lights control can be seen in @cite_16 , @cite_14 , @cite_15 and @cite_9 . Simulators used in these works were Aimsun, ITSUMO, VisSim and ITSUMO, respectively.
@cite_14 @cite_15 @cite_16 @cite_9
2078895652 89499552 2061348089 2740264533
In many urban areas where traffic congestion does not have the peak pattern, conventional traffic signal timing methods does not result in an efficient control. One alternative is to let traffic signal controllers learn how to adjust the lights based on the traffic situation. However this creates a classical non-stationary environment since each controller is adapting to the changes caused by other controllers. In multi-agent learning this is likely to be inefficient and computationally challenging, i.e., the efficiency decreases with the increase in the number of agents (controllers). In this paper, we model a relatively large traffic network as a multi-agent system and use techniques from multi-agent reinforcement learning. In particular, Q-learning is employed, where the average queue length in approaching links is used to estimate states. A parametric representation of the action space has made the method extendable to different types of intersection. The simulation results demonstrate that the proposed Q-learning outperformed the fixed time method under different traffic demands. Recently, several artificial intelligence labs have suggested the use of fully driverless vehicles with the capability of sensing the surrounding environment to enhance the roadway safety. The idea of having fully automated vehicles running in streets was inapplicable for many years until recently when researchers succeeded in releasing fully automated vehicles (without human drivers). Consequently, the paper develops a heuristic optimization algorithm for driverless vehicles at unsignalized intersections using a multi-agent system. The proposed system models the driverless vehicles as autonomous agents controlled by the intersection controller (manager agent). The input information of the system consists of vehicles’ current location, speed and acceleration in addition to the surrounding environment (weather, intersection characteristics, etc.). The intersection controller processes the input information using a built-in simulator: “OSDI” (Optimization Simulator for Driverless vehicles at Intersections). The simulator objective is to optimize the movements of vehicles to reduce the total delay time for the entire intersection and prevent crashes simultaneously. Thereafter, the intersection controller uses the simulator output for controlling the speed profile of the driverless vehicles within the intersection study zone. The proposed system is compared to two different intersection control scenarios: an All-way stop control (AWSC) and an Intersection manager with built-in OSDI. For both scenarios, it is assumed that there are four driverless vehicles (one vehicle per approach) willing to cross a four-legged unsignalized intersection concurrently. The results show using Monte Carlo simulation show that the proposed system reduces the total delay by 35 seconds on average compared to traditional AWSC. This research is considered as a first step in developing an unmanned vehicle technology system. The operation of large dynamic systems such as urban traffic networks remains a challenge in control engineering to a great extent due to their sheer size, intrinsic complexity, and nonlinear behavior. Recently, control engineers have looked for unconventional means for modeling and control of complex dynamic systems, in particular the technology of multi-agent systems whose appeal stems from their composite nature, flexibility, and scalability. This paper contributes to this evolving technology by proposing a framework for multi-agent control of linear dynamic systems, which decomposes a centralized model predictive control problem into a network of coupled, but small sub-problems that are solved by the distributed agents. Theoretical results ensure convergence of the distributed iterations to a globally optimal solution. The framework is applied to the signaling split control of traffic networks. Experiments conducted with simulation software indicate that the multi-agent framework attains performance comparable to conventional control. The main advantages of the multi-agent framework are its graceful extension and localized reconfiguration, which require adjustments only in the control strategies of the agents in the vicinity. One way to cope with the increasing demand in transportation networks is to integrate standard solutions with more intelligent measures. This problem has been approached from different sides such as the study of the assignment of the demand in the network, and the investigation of the effects of control measures. However, given that most of these approaches are complex and deal with different levels of abstraction of the original problem, there has been few attempts to address both demand and control in a single tool. This paper presents an overview of ITSUMO, a microscopic traffic simulator whose implementation uses agent technologies with a bottom-up philosophy in mind. We give an overview of the system and some details of its modules (simulation kernel, data management, control, driver and routing, and visualization), followed by an example of its use. I. I NTRODUCTION AND MOTIVATION