Finding Optimal Policy for Queueing Models: New Parameterization
Queueing systems appear in many important real-life applications including
communication networks, transportation and manufacturing systems. Reinforcement
learning (RL) framework is a suitable model for the queueing control problem
where the underlying dynamics are usually unknown and the agent receives little
information from the environment to navigate. In this work, we investigate the
optimization aspects of the queueing model as a RL environment and provide
insight to learn the optimal policy efficiently. We propose a new
parameterization of the policy by using the intrinsic properties of queueing
network systems. Experiments show good performance of our methods with various
load conditions from light to heavy traffic.