Hugging Face's logo

MubarakB
/
results

Text2Text Generation
Transformers
Safetensors
marian
Generated from Trainer
Inference Endpoints
Model card Files Community
MubarakB commited on
Commit
3c30f2f
•
1 Parent(s): abb3d5e

End of training

Browse files
Files changed (2) hide show
  1. README.md +19 -22
  2. model.safetensors +1 -1
README.md CHANGED
@@ -13,17 +13,14 @@ model-index:
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
16
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/asr-africa-research-team/huggingface/runs/ben1m3wk)
17
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/asr-africa-research-team/huggingface/runs/ben1m3wk)
18
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/asr-africa-research-team/huggingface/runs/ben1m3wk)
19
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/asr-africa-research-team/huggingface/runs/ben1m3wk)
20
  # ft-t5-small-on-info-lg-formal
21
 
22
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the Luganda Formal Data dataset.
23
  It achieves the following results on the evaluation set:
24
- - Loss: 0.1997
25
- - Bleu: 15.1631
26
- - Gen Len: 12.3001
27
 
28
  ## Model description
29
 
@@ -54,21 +51,21 @@ The following hyperparameters were used during training:
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
56
  |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|
57
- | 0.5515 | 1.0 | 846 | 0.3160 | 1.5468 | 12.8596 |
58
- | 0.3157 | 2.0 | 1692 | 0.2813 | 3.6176 | 13.2076 |
59
- | 0.2801 | 3.0 | 2538 | 0.2576 | 5.4512 | 12.9075 |
60
- | 0.2655 | 4.0 | 3384 | 0.2432 | 7.2817 | 12.6248 |
61
- | 0.2468 | 5.0 | 4230 | 0.2307 | 8.9484 | 12.6766 |
62
- | 0.2339 | 6.0 | 5076 | 0.2228 | 10.7122 | 12.475 |
63
- | 0.225 | 7.0 | 5922 | 0.2165 | 11.5595 | 12.4025 |
64
- | 0.2152 | 8.0 | 6768 | 0.2119 | 12.6485 | 12.3446 |
65
- | 0.2094 | 9.0 | 7614 | 0.2079 | 12.9033 | 12.5243 |
66
- | 0.2053 | 10.0 | 8460 | 0.2048 | 13.9509 | 12.4165 |
67
- | 0.2019 | 11.0 | 9306 | 0.2033 | 14.4313 | 12.2947 |
68
- | 0.1975 | 12.0 | 10152 | 0.2014 | 14.6399 | 12.2768 |
69
- | 0.195 | 13.0 | 10998 | 0.2004 | 14.9622 | 12.3094 |
70
- | 0.1927 | 14.0 | 11844 | 0.2000 | 14.8282 | 12.3087 |
71
- | 0.1917 | 15.0 | 12690 | 0.1997 | 15.1631 | 12.3001 |
72
 
73
 
74
  ### Framework versions
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
16
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/asr-africa-research-team/Fine-tuning%20t5-small-on-info-lg-formal/runs/ygeghd7j)
 
 
 
17
  # ft-t5-small-on-info-lg-formal
18
 
19
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the Luganda Formal Data dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.1835
22
+ - Bleu: 13.1429
23
+ - Gen Len: 11.6875
24
 
25
  ## Model description
26
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
53
  |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|
54
+ | 0.5262 | 1.0 | 848 | 0.2851 | 1.1666 | 13.2362 |
55
+ | 0.2935 | 2.0 | 1696 | 0.2537 | 3.5129 | 12.5023 |
56
+ | 0.2618 | 3.0 | 2544 | 0.2336 | 5.6103 | 12.3464 |
57
+ | 0.2477 | 4.0 | 3392 | 0.2212 | 7.2168 | 12.0816 |
58
+ | 0.2316 | 5.0 | 4240 | 0.2108 | 8.234 | 12.1068 |
59
+ | 0.2194 | 6.0 | 5088 | 0.2037 | 9.5519 | 11.8898 |
60
+ | 0.2125 | 7.0 | 5936 | 0.1987 | 10.4096 | 11.6576 |
61
+ | 0.2032 | 8.0 | 6784 | 0.1943 | 10.9817 | 11.8235 |
62
+ | 0.198 | 9.0 | 7632 | 0.1911 | 11.8996 | 11.7366 |
63
+ | 0.1951 | 10.0 | 8480 | 0.1887 | 12.3731 | 11.6503 |
64
+ | 0.1908 | 11.0 | 9328 | 0.1867 | 12.4566 | 11.712 |
65
+ | 0.1866 | 12.0 | 10176 | 0.1851 | 13.0004 | 11.6821 |
66
+ | 0.1846 | 13.0 | 11024 | 0.1841 | 13.2506 | 11.6264 |
67
+ | 0.182 | 14.0 | 11872 | 0.1836 | 13.0856 | 11.6735 |
68
+ | 0.1813 | 15.0 | 12720 | 0.1835 | 13.1429 | 11.6875 |
69
 
70
 
71
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:67a3da3450b18b1ac896739d00b18f12cc3a19f613f8a8a1718d2f5eef3cba1c
3
  size 242041896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38ac614141fc6cb260f8494f5b829d477afed1487002cdf35632adec974c8a2d
3
  size 242041896