bjbjbj commited on
Commit
50d68d7
1 Parent(s): 5daedaa

End of training

Browse files
Files changed (2) hide show
  1. README.md +11 -11
  2. generation_config.json +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [HuggingFaceTB/SmolLM-135M](https://huggingface.co/HuggingFaceTB/SmolLM-135M) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 3.2262
20
 
21
  ## Model description
22
 
@@ -39,7 +39,7 @@ The following hyperparameters were used during training:
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
42
- - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
  - lr_scheduler_type: cosine
44
  - num_epochs: 2
45
 
@@ -47,17 +47,17 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 3.1445 | 0.32 | 200 | 3.3104 |
51
- | 2.8324 | 0.64 | 400 | 3.2118 |
52
- | 2.6586 | 0.96 | 600 | 3.0967 |
53
- | 1.6904 | 1.28 | 800 | 3.2338 |
54
- | 1.5063 | 1.6 | 1000 | 3.2210 |
55
- | 1.4548 | 1.92 | 1200 | 3.2262 |
56
 
57
 
58
  ### Framework versions
59
 
60
- - Transformers 4.46.3
61
  - Pytorch 2.5.1
62
- - Datasets 2.16.1
63
- - Tokenizers 0.20.3
 
16
 
17
  This model is a fine-tuned version of [HuggingFaceTB/SmolLM-135M](https://huggingface.co/HuggingFaceTB/SmolLM-135M) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 3.2269
20
 
21
  ## Model description
22
 
 
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
42
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: cosine
44
  - num_epochs: 2
45
 
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 3.201 | 0.32 | 200 | 3.3098 |
51
+ | 2.8851 | 0.64 | 400 | 3.2105 |
52
+ | 2.711 | 0.96 | 600 | 3.0995 |
53
+ | 1.7193 | 1.28 | 800 | 3.2433 |
54
+ | 1.5359 | 1.6 | 1000 | 3.2236 |
55
+ | 1.4857 | 1.92 | 1200 | 3.2269 |
56
 
57
 
58
  ### Framework versions
59
 
60
+ - Transformers 4.45.2
61
  - Pytorch 2.5.1
62
+ - Datasets 3.1.0
63
+ - Tokenizers 0.20.1
generation_config.json CHANGED
@@ -2,5 +2,5 @@
2
  "_from_model_config": true,
3
  "bos_token_id": 0,
4
  "eos_token_id": 0,
5
- "transformers_version": "4.46.3"
6
  }
 
2
  "_from_model_config": true,
3
  "bos_token_id": 0,
4
  "eos_token_id": 0,
5
+ "transformers_version": "4.45.2"
6
  }