arminmehrabian commited on
Commit
135bee0
1 Parent(s): 9c4a078

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -8
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 3.5116
18
 
19
  ## Model description
20
 
@@ -34,19 +34,30 @@ More information needed
34
 
35
  The following hyperparameters were used during training:
36
  - learning_rate: 2e-05
37
- - train_batch_size: 64
38
- - eval_batch_size: 64
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
- - num_epochs: 1
43
 
44
  ### Training results
45
 
46
- | Training Loss | Epoch | Step | Validation Loss |
47
- |:-------------:|:-----:|:-----:|:---------------:|
48
- | 3.7357 | 1.0 | 13655 | 3.6781 |
49
- | 3.5721 | 2.0 | 27310 | 3.5302 |
 
 
 
 
 
 
 
 
 
 
 
50
 
51
 
52
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 3.3055
18
 
19
  ## Model description
20
 
 
34
 
35
  The following hyperparameters were used during training:
36
  - learning_rate: 2e-05
37
+ - train_batch_size: 32
38
+ - eval_batch_size: 32
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
+ - num_epochs: 8
43
 
44
  ### Training results
45
 
46
+ | Training Loss | Epoch | Step | Validation Loss |
47
+ |:-------------:|:-----:|:------:|:---------------:|
48
+ | 3.7357 | 1.0 | 13655 | 3.6781 |
49
+ | 3.5721 | 2.0 | 27310 | 3.5302 |
50
+ | 3.4961 | 3.0 | 40965 | 3.4658 |
51
+ | 3.4406 | 4.0 | 54620 | 3.4242 |
52
+ | 3.4043 | 5.0 | 68275 | 3.3943 |
53
+ | 3.3789 | 6.0 | 81930 | 3.3726 |
54
+ | 3.3576 | 7.0 | 95585 | 3.3538 |
55
+ | 3.3389 | 8.0 | 109240 | 3.3389 |
56
+ | 3.3151 | 9.0 | 122895 | 3.3270 |
57
+ | 3.314 | 5.0 | 136545 | 3.3226 |
58
+ | 3.3044 | 6.0 | 163854 | 3.3124 |
59
+ | 3.2931 | 7.0 | 191163 | 3.3078 |
60
+ | 3.2874 | 8.0 | 218472 | 3.3055 |
61
 
62
 
63
  ### Framework versions