In our case, because we re-use the same training set for multi-task learning, we have made sure our experimental settings exactly match the previous best state-of-the-art method for supertagging <cite>(Kasai et al., 2018)</cite> and we use the same pre-trained word embeddings to ensure a fair comparison.