Salmamoori commited on
Commit
9da6249
1 Parent(s): a174bd6

End of training

Browse files
Files changed (1) hide show
  1. README.md +26 -16
README.md CHANGED
@@ -24,7 +24,7 @@ model-index:
24
  name: Text Classification
25
  type: text-classification
26
  dataset:
27
- name: Emotion
28
  type: emotion
29
  config: split
30
  split: validation
@@ -32,7 +32,7 @@ model-index:
32
  metrics:
33
  - name: F1
34
  type: f1
35
- value: 0.9379095011375947
36
  ---
37
 
38
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -40,10 +40,10 @@ should probably proofread and complete it, then remove this comment. -->
40
 
41
  # miniLM_finetuned_Emotion_2024_06_15
42
 
43
- This model is a fine-tuned version of [microsoft/MiniLM-L12-H384-uncased](https://huggingface.co/microsoft/MiniLM-L12-H384-uncased) on the Emotion dataset.
44
  It achieves the following results on the evaluation set:
45
- - Loss: 0.1659
46
- - F1: 0.9379
47
 
48
  ## Model description
49
 
@@ -68,23 +68,33 @@ The following hyperparameters were used during training:
68
  - seed: 42
69
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
70
  - lr_scheduler_type: linear
71
- - num_epochs: 10
72
  - mixed_precision_training: Native AMP
73
 
74
  ### Training results
75
 
76
  | Training Loss | Epoch | Step | Validation Loss | F1 |
77
  |:-------------:|:-----:|:----:|:---------------:|:------:|
78
- | No log | 1.0 | 250 | 0.6783 | 0.8239 |
79
- | No log | 2.0 | 500 | 0.3368 | 0.9101 |
80
- | No log | 3.0 | 750 | 0.2447 | 0.9346 |
81
- | No log | 4.0 | 1000 | 0.2044 | 0.9273 |
82
- | No log | 5.0 | 1250 | 0.1669 | 0.9350 |
83
- | No log | 6.0 | 1500 | 0.1783 | 0.9386 |
84
- | No log | 7.0 | 1750 | 0.1973 | 0.9313 |
85
- | No log | 8.0 | 2000 | 0.1586 | 0.9385 |
86
- | No log | 9.0 | 2250 | 0.1690 | 0.9352 |
87
- | No log | 10.0 | 2500 | 0.1659 | 0.9379 |
 
 
 
 
 
 
 
 
 
 
88
 
89
 
90
  ### Framework versions
 
24
  name: Text Classification
25
  type: text-classification
26
  dataset:
27
+ name: emotion
28
  type: emotion
29
  config: split
30
  split: validation
 
32
  metrics:
33
  - name: F1
34
  type: f1
35
+ value: 0.9338371108651224
36
  ---
37
 
38
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
40
 
41
  # miniLM_finetuned_Emotion_2024_06_15
42
 
43
+ This model is a fine-tuned version of [microsoft/MiniLM-L12-H384-uncased](https://huggingface.co/microsoft/MiniLM-L12-H384-uncased) on the emotion dataset.
44
  It achieves the following results on the evaluation set:
45
+ - Loss: 0.3029
46
+ - F1: 0.9338
47
 
48
  ## Model description
49
 
 
68
  - seed: 42
69
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
70
  - lr_scheduler_type: linear
71
+ - num_epochs: 20
72
  - mixed_precision_training: Native AMP
73
 
74
  ### Training results
75
 
76
  | Training Loss | Epoch | Step | Validation Loss | F1 |
77
  |:-------------:|:-----:|:----:|:---------------:|:------:|
78
+ | 1.1709 | 1.0 | 250 | 0.7083 | 0.8287 |
79
+ | 0.5045 | 2.0 | 500 | 0.3203 | 0.9235 |
80
+ | 0.2773 | 3.0 | 750 | 0.2222 | 0.9314 |
81
+ | 0.1908 | 4.0 | 1000 | 0.2154 | 0.9306 |
82
+ | 0.1572 | 5.0 | 1250 | 0.1876 | 0.9312 |
83
+ | 0.1342 | 6.0 | 1500 | 0.1890 | 0.9344 |
84
+ | 0.1155 | 7.0 | 1750 | 0.1919 | 0.9331 |
85
+ | 0.1043 | 8.0 | 2000 | 0.1577 | 0.9359 |
86
+ | 0.0885 | 9.0 | 2250 | 0.1912 | 0.9353 |
87
+ | 0.085 | 10.0 | 2500 | 0.2089 | 0.9336 |
88
+ | 0.0715 | 11.0 | 2750 | 0.2269 | 0.9342 |
89
+ | 0.0631 | 12.0 | 3000 | 0.2253 | 0.9326 |
90
+ | 0.0546 | 13.0 | 3250 | 0.2342 | 0.9348 |
91
+ | 0.0472 | 14.0 | 3500 | 0.2348 | 0.9352 |
92
+ | 0.0414 | 15.0 | 3750 | 0.2662 | 0.9365 |
93
+ | 0.036 | 16.0 | 4000 | 0.2725 | 0.9319 |
94
+ | 0.0325 | 17.0 | 4250 | 0.2832 | 0.9341 |
95
+ | 0.0263 | 18.0 | 4500 | 0.2851 | 0.9381 |
96
+ | 0.0226 | 19.0 | 4750 | 0.2979 | 0.9329 |
97
+ | 0.0221 | 20.0 | 5000 | 0.3029 | 0.9338 |
98
 
99
 
100
  ### Framework versions