As alternating optimization can be difficult in practice (Salimans et al., 2016) , <cite>Tu & Gimpel</cite> experimented with including several additional terms in the above objective to stabilize training.