Specifically, we propose two major changes to the model by<cite> Filippova et al. (2015)</cite> : (1) We explicitly introduce POS embeddings and dependency relation embeddings into the neural network model.