extends the BiLSTM model with predicted part-of-speech tags and suffix embeddings as inputs, then<cite> Kasai et al. (2018)</cite> further extends the BiLSTM model with highway connection as well as character CNN as input, and jointly train the supertagging model with parsing model and this work had the state-of-the-art accuracy before our paper on the Penn treebank dataset.