Planning Exploration. Recent breakthroughs concerning exploration in RL have also focused on using the learned environment dynamics to plan to explore. This is the case in [1]} and [2]}, where they use imaginary rollouts from their dynamics models to plan exploratory behaviors, and [3]}, where they combine a model-based planner in latent space [4]} with the Disagreement exploration strategy [5]}.
