Through extensive experimentations on six different language pairs comprising European, nonEuropean and low-resource languages from two different data sources, we demonstrate that our method outperforms the method of <cite>Conneau et al. (2018)</cite> for all translation tasks in all measures (P@{1,5,10}) across all settings (with and without fine-tuning).