End of training

README.md

@@ -0,0 +1,83 @@
+---
+license: apache-2.0
+base_model: google/flan-t5-small
+tags:
+- generated_from_trainer
+metrics:
+- rouge
+model-index:
+- name: t5-summarization-headers-50-epochs
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# t5-summarization-headers-50-epochs
+
+This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 2.2125
+- Rouge: {'rouge1': 0.4117, 'rouge2': 0.2163, 'rougeL': 0.2158, 'rougeLsum': 0.2158}
+- Bert Score: 0.8818
+- Bleurt 20: -0.8026
+- Gen Len: 14.46
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0001
+- train_batch_size: 7
+- eval_batch_size: 7
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 20
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge                                                                       | Bert Score | Bleurt 20 | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------:|:----------:|:---------:|:-------:|
+| 3.0256        | 1.0   | 186  | 2.6300          | {'rouge1': 0.4643, 'rouge2': 0.1902, 'rougeL': 0.1973, 'rougeLsum': 0.1973} | 0.8664     | -0.8801   | 15.55   |
+| 2.734         | 2.0   | 372  | 2.4218          | {'rouge1': 0.4489, 'rouge2': 0.2037, 'rougeL': 0.209, 'rougeLsum': 0.209}   | 0.8737     | -0.8686   | 14.995  |
+| 2.5147        | 3.0   | 558  | 2.3219          | {'rouge1': 0.4363, 'rouge2': 0.1984, 'rougeL': 0.2067, 'rougeLsum': 0.2067} | 0.8742     | -0.8762   | 14.69   |
+| 2.3007        | 4.0   | 744  | 2.2752          | {'rouge1': 0.4465, 'rouge2': 0.2043, 'rougeL': 0.2022, 'rougeLsum': 0.2022} | 0.8761     | -0.8603   | 14.625  |
+| 2.1922        | 5.0   | 930  | 2.2331          | {'rouge1': 0.425, 'rouge2': 0.2033, 'rougeL': 0.2042, 'rougeLsum': 0.2042}  | 0.8779     | -0.829    | 14.87   |
+| 2.1185        | 6.0   | 1116 | 2.2092          | {'rouge1': 0.4231, 'rouge2': 0.2096, 'rougeL': 0.2073, 'rougeLsum': 0.2073} | 0.8783     | -0.8359   | 14.68   |
+| 2.0584        | 7.0   | 1302 | 2.1993          | {'rouge1': 0.4302, 'rouge2': 0.2114, 'rougeL': 0.2126, 'rougeLsum': 0.2126} | 0.8793     | -0.8202   | 15.015  |
+| 2.0189        | 8.0   | 1488 | 2.1872          | {'rouge1': 0.4255, 'rouge2': 0.2086, 'rougeL': 0.2106, 'rougeLsum': 0.2106} | 0.879      | -0.8359   | 14.485  |
+| 1.8933        | 9.0   | 1674 | 2.1967          | {'rouge1': 0.4307, 'rouge2': 0.2175, 'rougeL': 0.2165, 'rougeLsum': 0.2165} | 0.8821     | -0.7803   | 14.865  |
+| 1.8859        | 10.0  | 1860 | 2.1905          | {'rouge1': 0.4342, 'rouge2': 0.2139, 'rougeL': 0.2193, 'rougeLsum': 0.2193} | 0.8828     | -0.7683   | 14.93   |
+| 1.8395        | 11.0  | 2046 | 2.2006          | {'rouge1': 0.42, 'rouge2': 0.2135, 'rougeL': 0.2175, 'rougeLsum': 0.2175}   | 0.8815     | -0.7958   | 14.485  |
+| 1.7848        | 12.0  | 2232 | 2.1970          | {'rouge1': 0.4309, 'rouge2': 0.2096, 'rougeL': 0.2171, 'rougeLsum': 0.2171} | 0.8826     | -0.8131   | 14.51   |
+| 1.7855        | 13.0  | 2418 | 2.2026          | {'rouge1': 0.4218, 'rouge2': 0.2099, 'rougeL': 0.2182, 'rougeLsum': 0.2182} | 0.8812     | -0.8068   | 14.555  |
+| 1.6971        | 14.0  | 2604 | 2.2006          | {'rouge1': 0.4035, 'rouge2': 0.2056, 'rougeL': 0.2109, 'rougeLsum': 0.2109} | 0.8816     | -0.817    | 14.145  |
+| 1.7226        | 15.0  | 2790 | 2.2000          | {'rouge1': 0.413, 'rouge2': 0.2072, 'rougeL': 0.2145, 'rougeLsum': 0.2145}  | 0.8818     | -0.8106   | 14.415  |
+| 1.7164        | 16.0  | 2976 | 2.2067          | {'rouge1': 0.4117, 'rouge2': 0.212, 'rougeL': 0.215, 'rougeLsum': 0.215}    | 0.8815     | -0.8198   | 14.235  |
+| 1.6908        | 17.0  | 3162 | 2.2061          | {'rouge1': 0.4125, 'rouge2': 0.2193, 'rougeL': 0.2154, 'rougeLsum': 0.2154} | 0.8814     | -0.8089   | 14.37   |
+| 1.6865        | 18.0  | 3348 | 2.2088          | {'rouge1': 0.4125, 'rouge2': 0.2173, 'rougeL': 0.217, 'rougeLsum': 0.217}   | 0.8819     | -0.807    | 14.46   |
+| 1.6225        | 19.0  | 3534 | 2.2127          | {'rouge1': 0.4111, 'rouge2': 0.2161, 'rougeL': 0.2123, 'rougeLsum': 0.2123} | 0.8815     | -0.8039   | 14.425  |
+| 1.6304        | 20.0  | 3720 | 2.2125          | {'rouge1': 0.4117, 'rouge2': 0.2163, 'rougeL': 0.2158, 'rougeLsum': 0.2158} | 0.8818     | -0.8026   | 14.46   |
+
+
+### Framework versions
+
+- Transformers 4.35.2
+- Pytorch 2.1.0+cu121
+- Datasets 2.16.1
+- Tokenizers 0.15.0

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "decoder_start_token_id": 0,
+  "eos_token_id": 1,
+  "pad_token_id": 0,
+  "transformers_version": "4.35.2"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b6c88b4c9c27ad5febf6d376c74c04cf306cf5e6ca7e06dd534c7686f2a6aa1b
+oid sha256:1457b343d6ac4c749c4ada575bc410f7fe6fd7cf42b49ae9dcf976da74387960
 size 307867048

runs/Jan09_20-38-47_55e645683601/events.out.tfevents.1704832728.55e645683601.334.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f1b2806ddddb5f896f95340b9e4e651a8baacaa6b189a5a9c7402ee97f07321c
-size 20238
+oid sha256:b209919df9005e8c7a96ec8f4e8b33b34e74ed681570d8a47753a242c7746369
+size 21921

runs/Jan09_20-38-47_55e645683601/events.out.tfevents.1704834585.55e645683601.334.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5fcf471fbe05df9e3305c43affaa4601b9bbcf31ad17caf0b1a8745465c66eda
+size 517