In reinforcement learning, the data distribution is rarely i.i.d. because the training data distribution depends on the policy. Continual learning is therefore naturally adapted to this learning paradigm [1]}.
