[1]} apply clipping to the advantage function
when updating the policy via Maximum a Posterior policy Optimization (MPO).
The use of a clipped advantage rigorously defines a total variation distance between
the posterior policy and the prior.
However, clipping the advantage is different from clipping ratios,
and their analysis does not apply to ratio clipping PPO.
