For selecting the best model, we use the unsupervised validation criterion proposed by <cite>Conneau et al. (2018)</cite> , which correlates highly with the mapping quality. <cite>In this criterion</cite>, 10, 000 most frequent source words along with their nearest neighbors in the target space are considered.