vincentmin commited on
Commit
517d941
1 Parent(s): 62e3244

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -13,6 +13,8 @@ should probably proofread and complete it, then remove this comment. -->
13
  # bloomz-1b1-eli5-pretrained
14
 
15
  This model is a fine-tuned version of [bigscience/bloomz-1b1](https://huggingface.co/bigscience/bloomz-1b1) on an unknown dataset.
 
 
16
 
17
  ## Model description
18
 
@@ -38,10 +40,14 @@ The following hyperparameters were used during training:
38
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
39
  - lr_scheduler_type: cosine
40
  - lr_scheduler_warmup_steps: 100
41
- - training_steps: 5
42
 
43
  ### Training results
44
 
 
 
 
 
45
 
46
 
47
  ### Framework versions
 
13
  # bloomz-1b1-eli5-pretrained
14
 
15
  This model is a fine-tuned version of [bigscience/bloomz-1b1](https://huggingface.co/bigscience/bloomz-1b1) on an unknown dataset.
16
+ It achieves the following results on the evaluation set:
17
+ - Loss: 3.1743
18
 
19
  ## Model description
20
 
 
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: cosine
42
  - lr_scheduler_warmup_steps: 100
43
+ - training_steps: 2500
44
 
45
  ### Training results
46
 
47
+ | Training Loss | Epoch | Step | Validation Loss |
48
+ |:-------------:|:-----:|:----:|:---------------:|
49
+ | 3.2783 | 0.4 | 1000 | 3.1924 |
50
+ | 3.1211 | 0.8 | 2000 | 3.1743 |
51
 
52
 
53
  ### Framework versions