In this paper, we present experiments to isolate the degree to which each gain occurs for each of two state-of-the-art generative neural parsing models: the Recurrent Neural Network Grammar generative parser (RG) of <cite>Dyer et al. (2016)</cite> , and the LSTM language modeling generative parser (LM) of Choe and Charniak (2016) .