metadata
language: gos
tags:
- BERTje
Wietse de Vries β’ Martijn Bartelds β’ Malvina Nissim β’ Martijn Wieling
Adapting Monolingual Models: Data can be Scarce when Language Similarity is High
This model is part of this paper + code:
Models
The best fine-tuned models for Gronings and West Frisian are available on the HuggingFace model hub:
Lexical layers
These models are identical to BERTje, but with different lexical layers (bert.embeddings.word_embeddings
).
- π€
GroNLP/bert-base-dutch-cased
(Dutch; source language) - π€
GroNLP/bert-base-dutch-cased-gronings
(Gronings) - π€
GroNLP/bert-base-dutch-cased-frisian
(West Frisian)
POS tagging
These models share the same fine-tuned Transformer layers + classification head, but with the retrained lexical layers from the models above.
- π€
GroNLP/bert-base-dutch-cased-upos-alpino
(Dutch) - π€
GroNLP/bert-base-dutch-cased-upos-alpino-gronings
(Gronings) - π€
GroNLP/bert-base-dutch-cased-upos-alpino-frisian
(West Frisian)