For the LSTMs we initialised the weights using uniform distribution U(0.003, 0.003), used Stochastic Gradient Descent (SGD) a learning rate of 0.01, cross entropy loss, padded and truncated sequence to the length of the maximum sequence in the training dataset as stated in the original paper, and we did not "set the clipping threshold of softmax layer as 200" <cite>(Tang et al., 2016a)</cite> as we were unsure what this meant.