Risk Perspective Exploration in Distributional Reinforcement Learning
Distributional reinforcement learning demonstrates state-of-the-art
performance in continuous and discrete control settings with the features of
variance and risk, which can be used to explore. However, the exploration
method employing the risk property is hard to find, although numerous
exploration methods in Distributional RL employ the variance of return
distribution per action. In this paper, we present risk scheduling approaches
that explore risk levels and optimistic behaviors from a risk perspective. We
demonstrate the performance enhancement of the DMIX algorithm using risk
scheduling in a multi-agent setting with comprehensive experiments.