In this paper, we limit the evaluation to recurrent architectures for comparison to previous work, including (Luong and Manning, 2016) , (Sennrich et al., 2016) and <cite>(Cherry et al., 2018)</cite> , and leave implementation of hierarchical decoding with feed-forward architectures to future work.