Especially, it has been shown that the combination of LSTMs (Hochreiter and Schmidhuber, 1997; Gers et al., 2000) , convolutional neural networks (CNNs) (LeCun et al., 1989) , and word-level CRF achieves the state-of-the-art performance<cite> (Ma and Hovy, 2016)</cite> .