monsoon-nlp
commited on
Commit
•
6924d3e
1
Parent(s):
ce955e5
better finetuned run
Browse files
README.md
CHANGED
@@ -18,7 +18,7 @@ Notebook - Finetuning on Maldivian news classification task: https://colab.resea
|
|
18 |
Current performance:
|
19 |
|
20 |
- mBERT: 52%
|
21 |
-
- byt5-dv
|
22 |
- dv-wave (ELECTRA): 89%
|
23 |
- dv-muril: 90.7%
|
24 |
- dv-labse: 91.3-91.5%
|
@@ -33,6 +33,4 @@ as one TFDS dataset.
|
|
33 |
|
34 |
This is based on ByT5-small ... we should try a larger model
|
35 |
|
36 |
-
This needs more time for pretraining
|
37 |
-
|
38 |
-
This needs better finetuning (reformatting batches to get all training data)
|
|
|
18 |
Current performance:
|
19 |
|
20 |
- mBERT: 52%
|
21 |
+
- **byt5-dv**: 81%
|
22 |
- dv-wave (ELECTRA): 89%
|
23 |
- dv-muril: 90.7%
|
24 |
- dv-labse: 91.3-91.5%
|
|
|
33 |
|
34 |
This is based on ByT5-small ... we should try a larger model
|
35 |
|
36 |
+
This needs more time for pretraining
|
|
|
|