NyistMilan
commited on
Commit
•
c64ed67
1
Parent(s):
337c528
Adjusted README
Browse filesRemoved "How to use" because it was redundant. Added "Results" and "Parameters"
README.md
CHANGED
@@ -17,5 +17,32 @@ metrics:
|
|
17 |
|
18 |
# Model Card for mT5-small-HunSum-1
|
19 |
|
20 |
-
The mT5-small-HunSum-1 is a Hungarian summarization model, which was trained on the SZTAKI-HLT/HunSum-1 dataset.
|
|
|
21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
|
18 |
# Model Card for mT5-small-HunSum-1
|
19 |
|
20 |
+
The mT5-small-HunSum-1 is a Hungarian abstractive summarization model, which was trained on the [SZTAKI-HLT/HunSum-1 dataset](https://huggingface.co/datasets/SZTAKI-HLT/HunSum-1).
|
21 |
+
The model is a fine-tuning of [google/mt5-small]([google/mt5-small](https://huggingface.co/google/mt5-small)).
|
22 |
|
23 |
+
## Intended uses & limitations
|
24 |
+
|
25 |
+
- **Model type:** Text Summarization
|
26 |
+
- **Language(s) (NLP):** Hungarian
|
27 |
+
- **Resource(s) for more information:**
|
28 |
+
- [GitHub Repo](https://github.com/dorinapetra/summarization)
|
29 |
+
|
30 |
+
## Parameters
|
31 |
+
|
32 |
+
- **Batch Size:** 16
|
33 |
+
- **Learning Rate:** 5e-5
|
34 |
+
- **Weight Decay:** 0.01
|
35 |
+
- **Warmup Steps:** 3000
|
36 |
+
- **Epochs:** 10
|
37 |
+
- **no_repeat_ngram_size:** 3
|
38 |
+
- **num_beams:** 5
|
39 |
+
- **early_stopping:** False
|
40 |
+
- **encoder_no_repeat_ngram_size:** 4
|
41 |
+
|
42 |
+
## Results
|
43 |
+
|
44 |
+
| Metric | Value |
|
45 |
+
| :------------ | :------------------------------------------ |
|
46 |
+
| ROUGE-1 | 36.49 |
|
47 |
+
| ROUGE-2 | 9.50 |
|
48 |
+
| ROUGE-3 | 23.48 |
|