Intrinsic rewards have been very useful for increasing exploration on some important testbeds [1]}, [2]}, [3]}, and they have been used to perform well on problems where the objective outcome metric is unavailable to the agent [4]} or to generate developmental behaviour [5]}. In intrinsic-reward approaches, the agent is rewarded for being in interesting (novel, surprising, uncertainty-reducing, etc.) states. These rewards encourage the agent to stay in or return to the same state repeatedly. Repeatedly visiting the same state has some important benefits for learning.
