We use the same sequence-to-sequence architecture that produced the top result for <cite>Aharoni and Goldberg (2018)</cite> , "Copy512", which is a one-layer, bi-directional LSTM (cell size 512) with attention (Bahdanau et al., 2014 ) and a copying mechanism (See et al., 2017 ) that dynamically interpolates the standard word distribution with a distribution over the words in the input sentence.