4 The dropout rate and warmup steps number were set using a hyperparameter search on the dataset from <cite>Noraset et al. (2017)</cite> , during which encoder and decoder vocabulary were merged for computational simplicity and models stopped after 12,000 steps.