We train RNNG discriminative (RD) and generative (RG) models, following <cite>Dyer et al. (2016)</cite> by using the same hyperparameter settings, and using pretrained word embeddings from Ling et al. (2015) for the discriminative model.