Hugging Face's logo

tanatapanun
/
fine-tuned-flan-t5-20-epochs-wang-lab

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
tanatapanun commited on
Commit
a5d8468
•
1 Parent(s): a717b15

Model save

Browse files
Files changed (4) hide show
  1. README.md +84 -0
  2. generation_config.json +6 -0
  3. model.safetensors +1 -1
  4. runs/Dec31_18-23-30_d44b6d7edf02/events.out.tfevents.1704047014.d44b6d7edf02.1137.0 +2 -2
README.md ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/flan-t5-small
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - rouge
8
+ model-index:
9
+ - name: fine-tuned-flan-t5-20-epochs-wang-lab
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # fine-tuned-flan-t5-20-epochs-wang-lab
17
+
18
+ This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on the None dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.7769
21
+ - Rouge1: 0.2685
22
+ - Rouge2: 0.0913
23
+ - Rougel: 0.2316
24
+ - Rougelsum: 0.2318
25
+ - Gen Len: 19.51
26
+
27
+ ## Model description
28
+
29
+ More information needed
30
+
31
+ ## Intended uses & limitations
32
+
33
+ More information needed
34
+
35
+ ## Training and evaluation data
36
+
37
+ More information needed
38
+
39
+ ## Training procedure
40
+
41
+ ### Training hyperparameters
42
+
43
+ The following hyperparameters were used during training:
44
+ - learning_rate: 0.0001
45
+ - train_batch_size: 4
46
+ - eval_batch_size: 4
47
+ - seed: 42
48
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
+ - lr_scheduler_type: linear
50
+ - lr_scheduler_warmup_ratio: 0.1
51
+ - num_epochs: 20
52
+
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
56
+ |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
57
+ | No log | 1.0 | 301 | 0.8814 | 0.2192 | 0.0734 | 0.1907 | 0.1911 | 19.4 |
58
+ | 1.4237 | 2.0 | 602 | 0.8212 | 0.2283 | 0.0703 | 0.1962 | 0.1977 | 19.39 |
59
+ | 1.4237 | 3.0 | 903 | 0.7864 | 0.2324 | 0.0656 | 0.1989 | 0.201 | 19.35 |
60
+ | 0.8542 | 4.0 | 1204 | 0.7753 | 0.2489 | 0.0789 | 0.2142 | 0.2156 | 19.27 |
61
+ | 0.7603 | 5.0 | 1505 | 0.7662 | 0.2458 | 0.0749 | 0.2119 | 0.2131 | 19.29 |
62
+ | 0.7603 | 6.0 | 1806 | 0.7608 | 0.2512 | 0.0896 | 0.2203 | 0.2217 | 19.48 |
63
+ | 0.699 | 7.0 | 2107 | 0.7611 | 0.259 | 0.0836 | 0.23 | 0.2318 | 19.52 |
64
+ | 0.699 | 8.0 | 2408 | 0.7566 | 0.264 | 0.087 | 0.2304 | 0.2312 | 19.43 |
65
+ | 0.646 | 9.0 | 2709 | 0.7558 | 0.2815 | 0.0947 | 0.2447 | 0.2453 | 19.43 |
66
+ | 0.6106 | 10.0 | 3010 | 0.7585 | 0.2692 | 0.0958 | 0.2377 | 0.2374 | 19.5 |
67
+ | 0.6106 | 11.0 | 3311 | 0.7611 | 0.2635 | 0.0997 | 0.2283 | 0.2278 | 19.5 |
68
+ | 0.5944 | 12.0 | 3612 | 0.7639 | 0.2785 | 0.0928 | 0.24 | 0.2403 | 19.46 |
69
+ | 0.5944 | 13.0 | 3913 | 0.7612 | 0.2648 | 0.0886 | 0.231 | 0.2318 | 19.38 |
70
+ | 0.5671 | 14.0 | 4214 | 0.7636 | 0.2786 | 0.0934 | 0.2431 | 0.2428 | 19.48 |
71
+ | 0.5387 | 15.0 | 4515 | 0.7656 | 0.2834 | 0.0938 | 0.2442 | 0.2432 | 19.47 |
72
+ | 0.5387 | 16.0 | 4816 | 0.7717 | 0.278 | 0.0927 | 0.2408 | 0.2403 | 19.48 |
73
+ | 0.5349 | 17.0 | 5117 | 0.7725 | 0.2733 | 0.0912 | 0.2367 | 0.2368 | 19.47 |
74
+ | 0.5349 | 18.0 | 5418 | 0.7761 | 0.2699 | 0.087 | 0.2339 | 0.2332 | 19.5 |
75
+ | 0.5182 | 19.0 | 5719 | 0.7786 | 0.2694 | 0.0874 | 0.2333 | 0.2336 | 19.5 |
76
+ | 0.5141 | 20.0 | 6020 | 0.7769 | 0.2685 | 0.0913 | 0.2316 | 0.2318 | 19.51 |
77
+
78
+
79
+ ### Framework versions
80
+
81
+ - Transformers 4.35.2
82
+ - Pytorch 2.1.0+cu121
83
+ - Datasets 2.16.1
84
+ - Tokenizers 0.15.0
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.35.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2c1f976e89e49be8a57b4519866473dbe0ae447ba9f1791986ebb36aaccae184
3
  size 307867048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1bb10c21072ea6e4c413e3a03074449a9344f1e2e1b8a863960d6677df72a36
3
  size 307867048
runs/Dec31_18-23-30_d44b6d7edf02/events.out.tfevents.1704047014.d44b6d7edf02.1137.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bbcd65fdd202d2323a479f43c8c5a70e5424f6c28540e959536b60528a715181
3
- size 17203
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09ecdbd83fadbb7d45f09407a42f55116e959af5ac77cc8bc028d3c2e538e7c9
3
+ size 18082