On the other hand, we note that while the soft left-to-right and right-to-left losses perform substantially better than the hard loss employed in the original work by<cite> Stern et al. (2019)</cite> , performance does suffer when using parallel decoding for those models, which is generally untrue of the other orderings.