Adding such a sub-module to our proposed architecture might diminish the number of mistagged definienda. Another possibility would be to pre-train the model, as was done by<cite> Gadetsky et al. (2018)</cite> : in our case in particular, the encoder could be trained for POS-tagging or lemmatization.