Update README.md
Browse files
README.md
CHANGED
@@ -2,6 +2,17 @@
|
|
2 |
language: uk
|
3 |
tags:
|
4 |
- gec
|
|
|
5 |
widget:
|
6 |
-
- text: "я й не думав що
|
7 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
language: uk
|
3 |
tags:
|
4 |
- gec
|
5 |
+
- mbart-50
|
6 |
widget:
|
7 |
+
- text: "я й не думав що комп'ютерна лінгвістика це легкоо."
|
8 |
+
---
|
9 |
+
This model was finetuned on errorful sentences from the `train` subset of [UA-GEC](https://github.com/grammarly/ua-gec) corpus, introduced in [UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language](https://arxiv.org/abs/2103.16997) paper.
|
10 |
+
|
11 |
+
Only sentences containing errors were used; 8,874 sentences for training and 987 sentences for validation. The training arguments were defined as follows:
|
12 |
+
```
|
13 |
+
batch_size = 4
|
14 |
+
num_train_epochs = 3
|
15 |
+
learning_rate=5e-5
|
16 |
+
weight_decay=0.01
|
17 |
+
optim = "adamw_hf"
|
18 |
+
```
|