Alternative approaches to modelling the environment's dynamics are based on pseudo-counts [1]}, [2]}, [3]}, which use density estimations techniques to explore less seen areas of the environment, Randomized Prior Functions [4]}, applying statistical bootstrapping and ensembles to the Q-value function model, or Noisy Nets [5]}, applying noise to the value-function network's layers.
