Hugging Face's logo

Vexemous
/
t5-small-finetuned-xsum

Summarization
Transformers
TensorBoard
Safetensors
t5
text2text-generation
Generated from Trainer
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
Vexemous commited on
Commit
1a7843f
•
1 Parent(s): 1fd5fa6

End of training

Browse files
Files changed (4) hide show
  1. README.md +22 -18
  2. generation_config.json +1 -1
  3. model.safetensors +1 -1
  4. runs/Apr25_05-10-30_instance-20240425-123743/events.out.tfevents.1714021842.instance-20240425-123743 +2 -2
README.md CHANGED
@@ -17,12 +17,12 @@ model-index:
17
  name: xsum
18
  type: xsum
19
  config: default
20
- split: validation
21
  args: default
22
  metrics:
23
  - name: Rouge1
24
  type: rouge
25
- value: 29.1562
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,12 +32,12 @@ should probably proofread and complete it, then remove this comment. -->
32
 
33
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the xsum dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 2.4190
36
- - Rouge1: 29.1562
37
- - Rouge2: 8.3597
38
- - Rougel: 23.0368
39
- - Rougelsum: 23.0365
40
- - Gen Len: 18.8217
41
 
42
  ## Model description
43
 
@@ -57,24 +57,28 @@ More information needed
57
 
58
  The following hyperparameters were used during training:
59
  - learning_rate: 2e-05
60
- - train_batch_size: 4
61
- - eval_batch_size: 4
62
  - seed: 42
63
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
64
  - lr_scheduler_type: linear
65
- - num_epochs: 1
66
  - mixed_precision_training: Native AMP
67
 
68
  ### Training results
69
 
70
- | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
71
- |:-------------:|:-----:|:-----:|:---------------:|:-------:|:------:|:-------:|:---------:|:-------:|
72
- | 2.6698 | 1.0 | 51012 | 2.4190 | 29.1562 | 8.3597 | 23.0368 | 23.0365 | 18.8217 |
 
 
 
 
73
 
74
 
75
  ### Framework versions
76
 
77
- - Transformers 4.36.2
78
- - Pytorch 2.1.2+cu121
79
- - Datasets 2.15.0
80
- - Tokenizers 0.15.0
 
17
  name: xsum
18
  type: xsum
19
  config: default
20
+ split: train[:10%]
21
  args: default
22
  metrics:
23
  - name: Rouge1
24
  type: rouge
25
+ value: 27.0616
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
32
 
33
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the xsum dataset.
34
  It achieves the following results on the evaluation set:
35
+ - Loss: 2.5622
36
+ - Rouge1: 27.0616
37
+ - Rouge2: 6.8574
38
+ - Rougel: 21.1087
39
+ - Rougelsum: 21.1175
40
+ - Gen Len: 18.8246
41
 
42
  ## Model description
43
 
 
57
 
58
  The following hyperparameters were used during training:
59
  - learning_rate: 2e-05
60
+ - train_batch_size: 16
61
+ - eval_batch_size: 16
62
  - seed: 42
63
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
64
  - lr_scheduler_type: linear
65
+ - num_epochs: 5
66
  - mixed_precision_training: Native AMP
67
 
68
  ### Training results
69
 
70
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
71
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|:------:|:-------:|:---------:|:-------:|
72
+ | 2.8879 | 1.0 | 1148 | 2.6353 | 25.4786 | 5.8199 | 19.7404 | 19.7497 | 18.8089 |
73
+ | 2.8178 | 2.0 | 2296 | 2.5951 | 26.2963 | 6.4255 | 20.5395 | 20.5304 | 18.8084 |
74
+ | 2.7831 | 3.0 | 3444 | 2.5741 | 26.7181 | 6.7174 | 20.8888 | 20.8914 | 18.806 |
75
+ | 2.7572 | 4.0 | 4592 | 2.5647 | 27.0071 | 6.8335 | 21.108 | 21.1149 | 18.8202 |
76
+ | 2.7476 | 5.0 | 5740 | 2.5622 | 27.0616 | 6.8574 | 21.1087 | 21.1175 | 18.8246 |
77
 
78
 
79
  ### Framework versions
80
 
81
+ - Transformers 4.40.1
82
+ - Pytorch 1.13.1+cu117
83
+ - Datasets 2.19.0
84
+ - Tokenizers 0.19.1
generation_config.json CHANGED
@@ -2,5 +2,5 @@
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
5
- "transformers_version": "4.36.2"
6
  }
 
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
5
+ "transformers_version": "4.40.1"
6
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dfe0783229c71fd55c13ce685f5bffacdd020d641219f94b97d66078988fdbe1
3
  size 242041896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8091371f8eb5e5e26a8039b1b68c8f1a8e3af6310219467574e710327e1c2631
3
  size 242041896
runs/Apr25_05-10-30_instance-20240425-123743/events.out.tfevents.1714021842.instance-20240425-123743 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1033b11e8d074f9b3945fafee9f9560a142db7accbcf1d247cc8699802ffcb3d
3
- size 9844
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4878c090609b1ca30dd3cb66166400466a585e68ae084b757de90af5ca0aa138
3
+ size 10934