Similar to our AvgPPL,<cite> Zhao et al. (2018)</cite> also employed average Perplexity (though without our length correction terms) as the reward to a policy network trained with reinforcement learning.