Prediction-based Exploration A number of works have used an agent's ability to predict the future to design exploration bonuses [1]}, [2]}, [3]}, [4]}, [5]}, [6]}, [7]}. In [8]}, [9]}, exploration bonuses were calculated from the disagreement between several prediction models. The term “noisy TV” was coined in [5]} based on previous observations [11]}, [2]} that prediction errors due to stochasticity and model misspecification are not helpful for exploration.
