Recently, a more generic regularization has been proposed in Mirror Descent Policy Optimization (MDPO) [1]},
which uses a Bregman divergence to regularize the policy update, providing a unified view of the regularization used in various policy optimization methods.
See  [2]} for more regularization theory.
