As we compare our full model with the model of <cite>Conneau et al. (2018)</cite> in the without fine-tuning setting, we notice large improvements in all measures across all datasets: 5.1 -7.3% in En→Es, 3 -6% in Es→En, 3.4 -4.3% in En→De, 1 -3% in De→En, 3.4 -4.3% in En→It, and 0.3 -3.7% in It→En.