dadashzadeh commited on
Commit
f7d34b7
1 Parent(s): d0dd3ff

End of training

Browse files
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  license: apache-2.0
3
- base_model: philschmid/tiny-bert-sst2-distilled
4
  tags:
5
  - generated_from_trainer
6
  metrics:
@@ -15,10 +15,10 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # tiny-bert-Sentiment-persian
17
 
18
- This model is a fine-tuned version of [philschmid/tiny-bert-sst2-distilled](https://huggingface.co/philschmid/tiny-bert-sst2-distilled) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.8137
21
- - Accuracy: 0.6423
22
 
23
  ## Model description
24
 
@@ -37,30 +37,24 @@ More information needed
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
- - learning_rate: 1e-08
41
- - train_batch_size: 8
42
- - eval_batch_size: 8
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
- - num_epochs: 12
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|
52
- | 0.8627 | 1.0 | 3576 | 0.8142 | 0.6410 |
53
- | 0.8555 | 2.0 | 7152 | 0.8140 | 0.6415 |
54
- | 0.874 | 3.0 | 10728 | 0.8138 | 0.6419 |
55
- | 0.8566 | 4.0 | 14304 | 0.8137 | 0.6423 |
56
- | 0.8739 | 5.0 | 17880 | 0.8137 | 0.6423 |
57
- | 0.8917 | 6.0 | 21456 | 0.8138 | 0.6432 |
58
- | 0.866 | 7.0 | 25032 | 0.8137 | 0.6432 |
59
- | 0.8613 | 8.0 | 28608 | 0.8137 | 0.6432 |
60
- | 0.875 | 9.0 | 32184 | 0.8137 | 0.6441 |
61
- | 0.8838 | 10.0 | 35760 | 0.8137 | 0.6441 |
62
- | 0.8682 | 11.0 | 39336 | 0.8137 | 0.6441 |
63
- | 0.8736 | 12.0 | 42912 | 0.8137 | 0.6441 |
64
 
65
 
66
  ### Framework versions
 
1
  ---
2
  license: apache-2.0
3
+ base_model: dadashzadeh/tiny-bert-Sentiment-persian
4
  tags:
5
  - generated_from_trainer
6
  metrics:
 
15
 
16
  # tiny-bert-Sentiment-persian
17
 
18
+ This model is a fine-tuned version of [dadashzadeh/tiny-bert-Sentiment-persian](https://huggingface.co/dadashzadeh/tiny-bert-Sentiment-persian) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.7744
21
+ - Accuracy: 0.6570
22
 
23
  ## Model description
24
 
 
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
+ - learning_rate: 2e-05
41
+ - train_batch_size: 12
42
+ - eval_batch_size: 12
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
+ - num_epochs: 6
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|
52
+ | 0.8669 | 1.0 | 2384 | 0.8153 | 0.6354 |
53
+ | 0.8577 | 2.0 | 4768 | 0.7903 | 0.6523 |
54
+ | 0.8537 | 3.0 | 7152 | 0.7873 | 0.6549 |
55
+ | 0.8411 | 4.0 | 9536 | 0.7792 | 0.6531 |
56
+ | 0.8408 | 5.0 | 11920 | 0.8042 | 0.6397 |
57
+ | 0.8432 | 6.0 | 14304 | 0.7744 | 0.6570 |
 
 
 
 
 
 
58
 
59
 
60
  ### Framework versions
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "philschmid/tiny-bert-sst2-distilled",
3
  "architectures": [
4
  "BertForSequenceClassification"
5
  ],
 
1
  {
2
+ "_name_or_path": "dadashzadeh/tiny-bert-Sentiment-persian",
3
  "architectures": [
4
  "BertForSequenceClassification"
5
  ],
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:652715ae4f3405c317651c7181a530f4a5013e9652f8b7d34e0558a71aa079ce
3
  size 17549828
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f942fe0f3b64e3bdc1808105d96c5ad2c8c0bbaba5d74893d236b81cf6caf942
3
  size 17549828
runs/Jul11_00-06-48_0acce8ee3931/events.out.tfevents.1720656411.0acce8ee3931.378.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5374005ee309a8ca4a6cb7c0a4752275ed1cce5ac3ff48030bbe982d07ea9c2c
3
+ size 37025
runs/Jul11_00-21-32_0acce8ee3931/events.out.tfevents.1720657294.0acce8ee3931.378.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34643c0d338c2712b7514d7f9f0a6ec6913883d34a905cdf9f1c167605bc0804
3
+ size 13269
runs/Jul11_00-21-32_0acce8ee3931/events.out.tfevents.1720657609.0acce8ee3931.378.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a23ced10e41259bc998d04265b005bd5edf20fdf95846467898f25403ec4d95e
3
+ size 411
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1a0d23684fd872c3b0b10a1f8ec73e35efc5b6ea439382747e5afadebcc7b4cd
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f5cc681b14ecf4c36b67edfde90ac9fb49830ea28047041d1d7e884c85efb5a
3
  size 5112