Finally, some research in deep RL proposes to tackle exploration by sampling randomly in the space of hierarchical behaviors [1]}, [2]}, [3]}. This induces a form of directed, temporally-extended, random exploration reminiscent of some animal foraging models [4]}.
