The model and training details are the same as that in <cite>the original work</cite> <cite>(Zoph et al., 2016)</cite> Note that the target language (English) vocabulary is same for all settings and the WPM is learned on the English side of the French-English corpus since it is the largest one amongst all our pairs.