For example, previous interactive NMT [ Sanchis-Trilles et al., 2014; Alvaro Peris et al., 2016;<cite> Knowles and Koehn, 2016]</cite> proposes to ask human to revise the translation output from the beginning of a sentence to the end (i.e. from the left to right), and regenerates the partial translation on the right side of the * Equal contribution, part of this work was done while Rongxiang Weng was a research intern at ByteDance AI Lab.