As the Dreamer model uses learned hidden state representations in order to deal with partially observable MDP, we will maximize the entropy of the distribution of these hidden states. To estimate the discounted distribution of hidden states, we use the Mixture Density Network [1]}. It learns via the maximization of log-likelihood and estimates any distribution with a mixture of normal distributions.
