For faster convergence, we used the <cite>transformer models</cite> with one more layer normalization as in section 4.2, although the offline results on the dev-other and test-other evaluation sets are slightly worse.