End of training

README.md

@@ -0,0 +1,70 @@
+---
+license: apache-2.0
+base_model: google/mt5-small
+tags:
+- generated_from_trainer
+metrics:
+- rouge
+model-index:
+- name: mt5-small-finetuned-amazon-en-es
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# mt5-small-finetuned-amazon-en-es
+
+This model is a fine-tuned version of [google/mt5-small](https://huggingface.co/google/mt5-small) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.9244
+- Rouge1: 0.5412
+- Rouge2: 0.3832
+- Rougel: 0.4817
+- Rougelsum: 0.4830
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5.6e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 8
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|
+| 1.5355        | 1.0   | 813  | 1.1694          | 0.4857 | 0.2942 | 0.4036 | 0.4050    |
+| 1.4589        | 2.0   | 1626 | 1.0231          | 0.5091 | 0.3331 | 0.4400 | 0.4410    |
+| 1.3205        | 3.0   | 2439 | 1.0102          | 0.5346 | 0.3690 | 0.4722 | 0.4724    |
+| 1.2304        | 4.0   | 3252 | 0.9553          | 0.5380 | 0.3732 | 0.4732 | 0.4740    |
+| 1.1681        | 5.0   | 4065 | 0.9355          | 0.5409 | 0.3735 | 0.4733 | 0.4744    |
+| 1.1245        | 6.0   | 4878 | 0.9136          | 0.5408 | 0.3770 | 0.4775 | 0.4787    |
+| 1.1014        | 7.0   | 5691 | 0.9161          | 0.5430 | 0.3816 | 0.4814 | 0.4828    |
+| 1.0824        | 8.0   | 6504 | 0.9244          | 0.5412 | 0.3832 | 0.4817 | 0.4830    |
+
+
+### Framework versions
+
+- Transformers 4.40.0
+- Pytorch 2.2.1+cu121
+- Datasets 2.19.0
+- Tokenizers 0.19.1

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "decoder_start_token_id": 0,
+  "eos_token_id": 1,
+  "pad_token_id": 0,
+  "transformers_version": "4.40.0"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:59da34f594b158b7ba8619d6b510ad9d7ba0615727e5a7b9f95b3f48d3f896dc
+oid sha256:8a90234f7d13aa4770be0bf2b1d061b4d7d3217744227f8faf967f842c82dd7c
 size 1200729512

runs/Apr23_02-28-12_257b5efbaa3b/events.out.tfevents.1713840383.257b5efbaa3b.773.1

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:43ff480528cf644b1019bc1441be893e2c3c345f7f4aa0ffe1a4f4a651afc90e
-size 10035
+oid sha256:2eb0cdb7b3fe0e74df70c74684b292429d0d77f18e7afc032956fe5bfa6a56b4
+size 10863