Following <cite>Chen and Manning (2014)</cite> , we use the pre-trained word embedding released by Collobert et al. (2011) , and set h = 200 for the hidden layer size, λ = 10 −8 for L2 regularization, and α = 0.01 for the initial learning rate of Adagrad.