All sentences have been tokenized and the words are segmented using byte pair encoding (BPE) (Sennrich et al., 2016 Model Configuration For a fair comparison, we follow the settings that worked the best for the greedy decoding model in<cite> (Gu et al., 2017)</cite> and set the target delay d ⇤ for the AGENT to 0.7.