Commit
•
3aaf8a8
1
Parent(s):
85549e1
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- multilingual
|
| 4 |
+
tags:
|
| 5 |
+
- STILT
|
| 6 |
+
- retraining
|
| 7 |
+
- multi-task learning
|
| 8 |
+
datasets:
|
| 9 |
+
- SemEval 2022
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
|
| 13 |
+
## Sem-RemmmBERT
|
| 14 |
+
|
| 15 |
+
This is the SemEval MaChAmp Multitask Multilingual BERT model. This model is retrained from remBERT (https://huggingface.co/google/rembertased).
|
| 16 |
+
|
| 17 |
+
The retraining is done based on all SemEval 2022 tasks that are text based, and have annotation on the word, sentence or paragraph level. The retraining is done with MaChAmp (https://machamp-nlp.github.io/), a toolkit focusing on multi-task learning for NLP. More information can be found in the paper (which should be released when the SemEval proceedings are online).
|