dadashzadeh
commited on
Commit
•
8c5a83f
1
Parent(s):
c945286
End of training
Browse files
README.md
CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
17 |
|
18 |
This model is a fine-tuned version of [dadashzadeh/tiny-bert-Sentiment-persian](https://huggingface.co/dadashzadeh/tiny-bert-Sentiment-persian) on an unknown dataset.
|
19 |
It achieves the following results on the evaluation set:
|
20 |
-
- Loss: 0.
|
21 |
-
- Accuracy: 0.
|
22 |
|
23 |
## Model description
|
24 |
|
@@ -38,29 +38,25 @@ More information needed
|
|
38 |
|
39 |
The following hyperparameters were used during training:
|
40 |
- learning_rate: 2e-05
|
41 |
-
- train_batch_size:
|
42 |
-
- eval_batch_size:
|
43 |
- seed: 10
|
44 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
45 |
- lr_scheduler_type: linear
|
46 |
-
- num_epochs:
|
47 |
|
48 |
### Training results
|
49 |
|
50 |
-
| Training Loss | Epoch | Step
|
51 |
-
|
52 |
-
| 0.
|
53 |
-
| 0.
|
54 |
-
| 0.
|
55 |
-
| 0.
|
56 |
-
| 0.
|
57 |
-
| 0.
|
58 |
-
| 0.
|
59 |
-
| 0.
|
60 |
-
| 0.647 | 9.0 | 25749 | 0.6528 | 0.7430 |
|
61 |
-
| 0.6453 | 10.0 | 28610 | 0.6600 | 0.7421 |
|
62 |
-
| 0.6523 | 11.0 | 31471 | 0.6489 | 0.7490 |
|
63 |
-
| 0.6281 | 12.0 | 34332 | 0.6615 | 0.7421 |
|
64 |
|
65 |
|
66 |
### Framework versions
|
|
|
17 |
|
18 |
This model is a fine-tuned version of [dadashzadeh/tiny-bert-Sentiment-persian](https://huggingface.co/dadashzadeh/tiny-bert-Sentiment-persian) on an unknown dataset.
|
19 |
It achieves the following results on the evaluation set:
|
20 |
+
- Loss: 0.6537
|
21 |
+
- Accuracy: 0.7387
|
22 |
|
23 |
## Model description
|
24 |
|
|
|
38 |
|
39 |
The following hyperparameters were used during training:
|
40 |
- learning_rate: 2e-05
|
41 |
+
- train_batch_size: 40
|
42 |
+
- eval_batch_size: 40
|
43 |
- seed: 10
|
44 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
45 |
- lr_scheduler_type: linear
|
46 |
+
- num_epochs: 8
|
47 |
|
48 |
### Training results
|
49 |
|
50 |
+
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
51 |
+
|:-------------:|:-----:|:----:|:---------------:|:--------:|
|
52 |
+
| 0.6273 | 1.0 | 716 | 0.6794 | 0.7201 |
|
53 |
+
| 0.6336 | 2.0 | 1432 | 0.6611 | 0.7348 |
|
54 |
+
| 0.628 | 3.0 | 2148 | 0.6538 | 0.7451 |
|
55 |
+
| 0.6239 | 4.0 | 2864 | 0.6601 | 0.7343 |
|
56 |
+
| 0.6214 | 5.0 | 3580 | 0.6546 | 0.7374 |
|
57 |
+
| 0.618 | 6.0 | 4296 | 0.6476 | 0.7443 |
|
58 |
+
| 0.6136 | 7.0 | 5012 | 0.6484 | 0.7447 |
|
59 |
+
| 0.619 | 8.0 | 5728 | 0.6537 | 0.7387 |
|
|
|
|
|
|
|
|
|
60 |
|
61 |
|
62 |
### Framework versions
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 17549828
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:63737221661f5dbdd608354663c8894bace2cdc52e0f729183e54017135f6bb9
|
3 |
size 17549828
|
runs/Jul11_01-24-52_0acce8ee3931/events.out.tfevents.1720661094.0acce8ee3931.378.14
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0852c9846c0896bade85259d6b2ae19e91703867316ec2ed54319978b55c332c
|
3 |
+
size 10327
|
runs/Jul11_01-24-52_0acce8ee3931/events.out.tfevents.1720661461.0acce8ee3931.378.15
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3063a362f46922211ac3cc141555c049ee7cf0651d1684b24ae5cd878718113a
|
3 |
+
size 411
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5112
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8a1b9f88aff7451fdb929a2e4714299e1e44fe8deb7d881bafc1df295cdc8a68
|
3 |
size 5112
|