Further improvements can be obtained on most but not all languages by initialising the word embedding layer with pre-computed word embeddings. We refer to<cite> Plank et al. (2016)</cite> for further details.