For other languages, one could retrain a language-specific model using the BERT architecture Martin et al., 2019; de Vries et al., 2019] or employ existing pre-trained multilingual BERT-based models [Devlin et al., 2019;<cite> Conneau et al., 2019</cite>;<cite> Conneau and Lample, 2019]</cite> .