Capable of capturing longdistance dependencies with gating (Hochreiter and Schmidhuber, 1997; Cho et al., 2014) and attention<cite> (Bahdanau et al., 2015)</cite> mechanisms, NMT has proven to outperform conventional statistical machine translation systematically across a variety of language pairs (Junczys-Dowmunt et al., 2016) .