Some methods combine model-based intrinsic motivation with pseudo-counts, such as RIDE [1]}, which rewards the agent with for transitions that have an impact on the state representation, and NGU [2]}, which modulates a pseudo-count bonus with the intrinsic rewards provided by RND. Remarkably, combining NGU with an adaptive exploration strategy over the agent's lifetime led Agent57 to outperform human performance in all Atari games [3]}.
