As shown in Figure 1a , when the model of<cite> Conneau et al. (2018)</cite> is applied to English and Italian, the primal model maps the word "three" to the Italian word "tre", but the dual model maps "tre" to "two" instead of "three". We propose to address this issue by exploiting duality, encouraging forward and backward mappings to form a closed loop (Figure 1b ).