Many dedicated language models have been developed. These include AraBERT for Arabic [1]}, Bertje for Dutch de2019bertje, CamemBERT  martin-etal-2020-camembert and FlauBERT  [2]} for French, PhoBERT for Vietnamese [3]}, and the models presented by virtanen2019multilingual for Finnish, dadas2020pre for Polish, and  malmsten2020playing for Swedish. [4]} also create monolingual LMs for 42 languages exploiting Wikipedia data.
