Since our approach follows the same steps as <cite>Conneau et al. (2018),</cite> we first compare our proposed model with <cite>their model</cite> on European (Table 1) , non-European and low-resource languages (Table  2 ) on <cite>their dataset</cite>. In the tables, we present the numbers that <cite>they</cite> reported in <cite>their paper</cite> (<cite>Conneau et al. (2018)</cite> (paper)) as well as the results that we get by running <cite>their code</cite> on our machine (<cite>Conneau et al. (2018)</cite> (code)).