It also outperforms the roughly similar model of <cite>Eshel et al. (2017)</cite> on the test set: this gain is due to a combination of factors including the improved training procedure and some small modeling changes.