Hugging Face's logo

Salmamoori
/
miniLM_finetuned_Emotion_2024_06_15

Text Classification
Transformers
Safetensors
bert
Language
image-Emotion
miniLM
PyTorch
Trainer
SequenceClassification
WeightedLoss
CrossEntropyLoss
F1Score
HuggingFaceHub
Generated from Trainer
Eval Results
Inference Endpoints
Model card Files Community
Salmamoori commited on
Commit
fb41e81
•
1 Parent(s): 00b7e32

End of training

Browse files
Files changed (2) hide show
  1. README.md +10 -15
  2. model.safetensors +1 -1
README.md CHANGED
@@ -32,7 +32,7 @@ model-index:
32
  metrics:
33
  - name: F1
34
  type: f1
35
- value: 0.927424135409491
36
  ---
37
 
38
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -42,8 +42,8 @@ should probably proofread and complete it, then remove this comment. -->
42
 
43
  This model is a fine-tuned version of [microsoft/MiniLM-L12-H384-uncased](https://huggingface.co/microsoft/MiniLM-L12-H384-uncased) on the emotion dataset.
44
  It achieves the following results on the evaluation set:
45
- - Loss: 0.1881
46
- - F1: 0.9274
47
 
48
  ## Model description
49
 
@@ -62,29 +62,24 @@ More information needed
62
  ### Training hyperparameters
63
 
64
  The following hyperparameters were used during training:
65
- - learning_rate: 5e-05
66
  - train_batch_size: 64
67
  - eval_batch_size: 64
68
  - seed: 42
69
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
70
  - lr_scheduler_type: linear
71
- - num_epochs: 10
72
  - mixed_precision_training: Native AMP
73
 
74
  ### Training results
75
 
76
  | Training Loss | Epoch | Step | Validation Loss | F1 |
77
  |:-------------:|:-----:|:----:|:---------------:|:------:|
78
- | 1.1887 | 1.0 | 250 | 0.7672 | 0.7461 |
79
- | 0.5641 | 2.0 | 500 | 0.3698 | 0.9058 |
80
- | 0.3151 | 3.0 | 750 | 0.2783 | 0.9244 |
81
- | 0.2074 | 4.0 | 1000 | 0.2417 | 0.9273 |
82
- | 0.1586 | 5.0 | 1250 | 0.1749 | 0.9301 |
83
- | 0.1287 | 6.0 | 1500 | 0.1945 | 0.9344 |
84
- | 0.1112 | 7.0 | 1750 | 0.2054 | 0.9313 |
85
- | 0.1031 | 8.0 | 2000 | 0.1677 | 0.9308 |
86
- | 0.0819 | 9.0 | 2250 | 0.1862 | 0.9279 |
87
- | 0.0743 | 10.0 | 2500 | 0.1881 | 0.9274 |
88
 
89
 
90
  ### Framework versions
 
32
  metrics:
33
  - name: F1
34
  type: f1
35
+ value: 0.9205262112499766
36
  ---
37
 
38
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
42
 
43
  This model is a fine-tuned version of [microsoft/MiniLM-L12-H384-uncased](https://huggingface.co/microsoft/MiniLM-L12-H384-uncased) on the emotion dataset.
44
  It achieves the following results on the evaluation set:
45
+ - Loss: 0.3634
46
+ - F1: 0.9205
47
 
48
  ## Model description
49
 
 
62
  ### Training hyperparameters
63
 
64
  The following hyperparameters were used during training:
65
+ - learning_rate: 2e-05
66
  - train_batch_size: 64
67
  - eval_batch_size: 64
68
  - seed: 42
69
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
70
  - lr_scheduler_type: linear
71
+ - num_epochs: 5
72
  - mixed_precision_training: Native AMP
73
 
74
  ### Training results
75
 
76
  | Training Loss | Epoch | Step | Validation Loss | F1 |
77
  |:-------------:|:-----:|:----:|:---------------:|:------:|
78
+ | 1.367 | 1.0 | 250 | 1.0076 | 0.5959 |
79
+ | 0.8543 | 2.0 | 500 | 0.6459 | 0.8558 |
80
+ | 0.5709 | 3.0 | 750 | 0.4652 | 0.9057 |
81
+ | 0.43 | 4.0 | 1000 | 0.3902 | 0.9161 |
82
+ | 0.3763 | 5.0 | 1250 | 0.3634 | 0.9205 |
 
 
 
 
 
83
 
84
 
85
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ecfd402bd2c80e90eee10797f3ec7713b26ce9a3fd2a48d85df6abe20316c56a
3
  size 133472536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bf8566c5a49487014a0fe5872e23c0563fde0b73bb06dd114384c4bf04b4520
3
  size 133472536