End of training

README.md

@@ -1,8 +1,11 @@
 ---
+library_name: transformers
 license: cc-by-nc-4.0
 base_model: facebook/nllb-200-distilled-600M
 tags:
 - generated_from_trainer
+metrics:
+- rouge
 model-index:
 - name: nllb-200-distilled-600M-finetuned-English-to-Twi
   results: []
@@ -14,6 +17,12 @@ should probably proofread and complete it, then remove this comment. -->
 # nllb-200-distilled-600M-finetuned-English-to-Twi
 
 This model is a fine-tuned version of [facebook/nllb-200-distilled-600M](https://huggingface.co/facebook/nllb-200-distilled-600M) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.4246
+- Rouge1: 0.5925
+- Rouge2: 0.3539
+- Rougel: 0.5514
+- Gen Len: 27.4969
 
 ## Model description
 
@@ -38,19 +47,22 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 1
+- num_epochs: 4
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Bleu    | Gen Len |
-|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|
-| No log        | 1.0   | 240  | 5.7634          | 15.8768 | 27.3417 |
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:-------:|
+| No log        | 1.0   | 240  | 2.0578          | 0.5591 | 0.3184 | 0.5159 | 27.4438 |
+| No log        | 2.0   | 480  | 0.6914          | 0.5779 | 0.3392 | 0.5374 | 27.5396 |
+| 2.3488        | 3.0   | 720  | 0.4522          | 0.5901 | 0.3518 | 0.549  | 27.475  |
+| 2.3488        | 4.0   | 960  | 0.4246          | 0.5925 | 0.3539 | 0.5514 | 27.4969 |
 
 
 ### Framework versions
 
-- Transformers 4.41.2
-- Pytorch 2.3.0+cu121
+- Transformers 4.44.2
+- Pytorch 2.4.0+cu121
 - Datasets 2.21.0
 - Tokenizers 0.19.1

config.json

@@ -29,7 +29,7 @@
   "scale_embedding": true,
   "tokenizer_class": "NllbTokenizer",
   "torch_dtype": "float32",
-  "transformers_version": "4.41.2",
+  "transformers_version": "4.44.2",
   "use_cache": true,
   "vocab_size": 256206
 }

generation_config.json

@@ -4,5 +4,5 @@
   "eos_token_id": 2,
   "max_length": 200,
   "pad_token_id": 1,
-  "transformers_version": "4.41.2"
+  "transformers_version": "4.44.2"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7faed4a0569e73bfc4992630c5cba55c567d06dccaf3d21f5d94d1f7b5065810
+oid sha256:e2716791ccd9f8fbe5812b0df03e37f6073e41059291c10606d705512fc97ed5
 size 2460354912

runs/Sep05_20-54-32_c3fd440bba2a/events.out.tfevents.1725569677.c3fd440bba2a.4835.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5ab2b2dd94347673f05bfb5db1a625b14ff368b2b4e043394694f12226075a9c
+size 5405

runs/Sep05_20-54-32_c3fd440bba2a/events.out.tfevents.1725569994.c3fd440bba2a.4835.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b61e9e0059ccbdec7f06c3cf8ba27291b11108ecea1c73d940bee3bf8ffccfaf
+size 7858

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:28e8e28341c32df708520c1c5f8e7e1cb15330d1033fd2222d5e098fb1fd14da
-size 5304
+oid sha256:0d2fb19d7240cde11687c5fa51f389bc6916df3b25cc76d9c9ddfcca0c4160fa
+size 5368