ricardo-filho
commited on
Commit
•
a498db2
1
Parent(s):
5d65878
update model card README.md
Browse files
README.md
ADDED
@@ -0,0 +1,206 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
tags:
|
4 |
+
- generated_from_trainer
|
5 |
+
model-index:
|
6 |
+
- name: mdeberta_all
|
7 |
+
results: []
|
8 |
+
---
|
9 |
+
|
10 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
11 |
+
should probably proofread and complete it, then remove this comment. -->
|
12 |
+
|
13 |
+
# mdeberta_all
|
14 |
+
|
15 |
+
This model is a fine-tuned version of [microsoft/mdeberta-v3-base](https://huggingface.co/microsoft/mdeberta-v3-base) on an unknown dataset.
|
16 |
+
It achieves the following results on the evaluation set:
|
17 |
+
- Loss: 0.3308
|
18 |
+
- Aerospacemanufacturer Precision: 0.8117
|
19 |
+
- Aerospacemanufacturer Recall: 0.9058
|
20 |
+
- Aerospacemanufacturer F1: 0.8562
|
21 |
+
- Aerospacemanufacturer Number: 138
|
22 |
+
- Anatomicalstructure Precision: 0.716
|
23 |
+
- Anatomicalstructure Recall: 0.7885
|
24 |
+
- Anatomicalstructure F1: 0.7505
|
25 |
+
- Anatomicalstructure Number: 227
|
26 |
+
- Artwork Precision: 0.6028
|
27 |
+
- Artwork Recall: 0.6489
|
28 |
+
- Artwork F1: 0.625
|
29 |
+
- Artwork Number: 131
|
30 |
+
- Artist Precision: 0.7838
|
31 |
+
- Artist Recall: 0.8252
|
32 |
+
- Artist F1: 0.8040
|
33 |
+
- Artist Number: 1722
|
34 |
+
- Athlete Precision: 0.7835
|
35 |
+
- Athlete Recall: 0.7552
|
36 |
+
- Athlete F1: 0.7691
|
37 |
+
- Athlete Number: 719
|
38 |
+
- Carmanufacturer Precision: 0.7953
|
39 |
+
- Carmanufacturer Recall: 0.8553
|
40 |
+
- Carmanufacturer F1: 0.8242
|
41 |
+
- Carmanufacturer Number: 159
|
42 |
+
- Cleric Precision: 0.6630
|
43 |
+
- Cleric Recall: 0.5970
|
44 |
+
- Cleric F1: 0.6283
|
45 |
+
- Cleric Number: 201
|
46 |
+
- Clothing Precision: 0.6296
|
47 |
+
- Clothing Recall: 0.6641
|
48 |
+
- Clothing F1: 0.6464
|
49 |
+
- Clothing Number: 128
|
50 |
+
- Disease Precision: 0.6961
|
51 |
+
- Disease Recall: 0.7172
|
52 |
+
- Disease F1: 0.7065
|
53 |
+
- Disease Number: 198
|
54 |
+
- Drink Precision: 0.8
|
55 |
+
- Drink Recall: 0.8112
|
56 |
+
- Drink F1: 0.8056
|
57 |
+
- Drink Number: 143
|
58 |
+
- Facility Precision: 0.6849
|
59 |
+
- Facility Recall: 0.7304
|
60 |
+
- Facility F1: 0.7069
|
61 |
+
- Facility Number: 497
|
62 |
+
- Food Precision: 0.7156
|
63 |
+
- Food Recall: 0.7056
|
64 |
+
- Food F1: 0.7106
|
65 |
+
- Food Number: 214
|
66 |
+
- Humansettlement Precision: 0.8631
|
67 |
+
- Humansettlement Recall: 0.8845
|
68 |
+
- Humansettlement F1: 0.8737
|
69 |
+
- Humansettlement Number: 1689
|
70 |
+
- Medicalprocedure Precision: 0.7852
|
71 |
+
- Medicalprocedure Recall: 0.7465
|
72 |
+
- Medicalprocedure F1: 0.7653
|
73 |
+
- Medicalprocedure Number: 142
|
74 |
+
- Medication/vaccine Precision: 0.7602
|
75 |
+
- Medication/vaccine Recall: 0.84
|
76 |
+
- Medication/vaccine F1: 0.7981
|
77 |
+
- Medication/vaccine Number: 200
|
78 |
+
- Musicalgrp Precision: 0.7601
|
79 |
+
- Musicalgrp Recall: 0.8091
|
80 |
+
- Musicalgrp F1: 0.7839
|
81 |
+
- Musicalgrp Number: 372
|
82 |
+
- Musicalwork Precision: 0.7506
|
83 |
+
- Musicalwork Recall: 0.7617
|
84 |
+
- Musicalwork F1: 0.7561
|
85 |
+
- Musicalwork Number: 407
|
86 |
+
- Org Precision: 0.6943
|
87 |
+
- Org Recall: 0.7151
|
88 |
+
- Org F1: 0.7046
|
89 |
+
- Org Number: 667
|
90 |
+
- Otherloc Precision: 0.7767
|
91 |
+
- Otherloc Recall: 0.7455
|
92 |
+
- Otherloc F1: 0.7608
|
93 |
+
- Otherloc Number: 224
|
94 |
+
- Otherper Precision: 0.5351
|
95 |
+
- Otherper Recall: 0.5588
|
96 |
+
- Otherper F1: 0.5467
|
97 |
+
- Otherper Number: 859
|
98 |
+
- Otherprod Precision: 0.6453
|
99 |
+
- Otherprod Recall: 0.6513
|
100 |
+
- Otherprod F1: 0.6483
|
101 |
+
- Otherprod Number: 433
|
102 |
+
- Politician Precision: 0.6277
|
103 |
+
- Politician Recall: 0.6153
|
104 |
+
- Politician F1: 0.6214
|
105 |
+
- Politician Number: 603
|
106 |
+
- Privatecorp Precision: 0.8981
|
107 |
+
- Privatecorp Recall: 0.7519
|
108 |
+
- Privatecorp F1: 0.8186
|
109 |
+
- Privatecorp Number: 129
|
110 |
+
- Publiccorp Precision: 0.7362
|
111 |
+
- Publiccorp Recall: 0.7695
|
112 |
+
- Publiccorp F1: 0.7525
|
113 |
+
- Publiccorp Number: 243
|
114 |
+
- Scientist Precision: 0.5178
|
115 |
+
- Scientist Recall: 0.5397
|
116 |
+
- Scientist F1: 0.5285
|
117 |
+
- Scientist Number: 189
|
118 |
+
- Software Precision: 0.7806
|
119 |
+
- Software Recall: 0.7883
|
120 |
+
- Software F1: 0.7844
|
121 |
+
- Software Number: 307
|
122 |
+
- Sportsgrp Precision: 0.8804
|
123 |
+
- Sportsgrp Recall: 0.8987
|
124 |
+
- Sportsgrp F1: 0.8895
|
125 |
+
- Sportsgrp Number: 385
|
126 |
+
- Sportsmanager Precision: 0.6863
|
127 |
+
- Sportsmanager Recall: 0.7216
|
128 |
+
- Sportsmanager F1: 0.7035
|
129 |
+
- Sportsmanager Number: 194
|
130 |
+
- Station Precision: 0.7696
|
131 |
+
- Station Recall: 0.8093
|
132 |
+
- Station F1: 0.7889
|
133 |
+
- Station Number: 194
|
134 |
+
- Symptom Precision: 0.7333
|
135 |
+
- Symptom Recall: 0.7674
|
136 |
+
- Symptom F1: 0.7500
|
137 |
+
- Symptom Number: 129
|
138 |
+
- Vehicle Precision: 0.6471
|
139 |
+
- Vehicle Recall: 0.6942
|
140 |
+
- Vehicle F1: 0.6698
|
141 |
+
- Vehicle Number: 206
|
142 |
+
- Visualwork Precision: 0.7917
|
143 |
+
- Visualwork Recall: 0.8225
|
144 |
+
- Visualwork F1: 0.8068
|
145 |
+
- Visualwork Number: 693
|
146 |
+
- Writtenwork Precision: 0.7255
|
147 |
+
- Writtenwork Recall: 0.7229
|
148 |
+
- Writtenwork F1: 0.7242
|
149 |
+
- Writtenwork Number: 563
|
150 |
+
- Overall Precision: 0.7404
|
151 |
+
- Overall Recall: 0.7600
|
152 |
+
- Overall F1: 0.7501
|
153 |
+
- Overall Accuracy: 0.9437
|
154 |
+
|
155 |
+
## Model description
|
156 |
+
|
157 |
+
More information needed
|
158 |
+
|
159 |
+
## Intended uses & limitations
|
160 |
+
|
161 |
+
More information needed
|
162 |
+
|
163 |
+
## Training and evaluation data
|
164 |
+
|
165 |
+
More information needed
|
166 |
+
|
167 |
+
## Training procedure
|
168 |
+
|
169 |
+
### Training hyperparameters
|
170 |
+
|
171 |
+
The following hyperparameters were used during training:
|
172 |
+
- learning_rate: 1e-05
|
173 |
+
- train_batch_size: 8
|
174 |
+
- eval_batch_size: 8
|
175 |
+
- seed: 42
|
176 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
177 |
+
- lr_scheduler_type: linear
|
178 |
+
- num_epochs: 15.0
|
179 |
+
|
180 |
+
### Training results
|
181 |
+
|
182 |
+
| Training Loss | Epoch | Step | Validation Loss | Aerospacemanufacturer Precision | Aerospacemanufacturer Recall | Aerospacemanufacturer F1 | Aerospacemanufacturer Number | Anatomicalstructure Precision | Anatomicalstructure Recall | Anatomicalstructure F1 | Anatomicalstructure Number | Artwork Precision | Artwork Recall | Artwork F1 | Artwork Number | Artist Precision | Artist Recall | Artist F1 | Artist Number | Athlete Precision | Athlete Recall | Athlete F1 | Athlete Number | Carmanufacturer Precision | Carmanufacturer Recall | Carmanufacturer F1 | Carmanufacturer Number | Cleric Precision | Cleric Recall | Cleric F1 | Cleric Number | Clothing Precision | Clothing Recall | Clothing F1 | Clothing Number | Disease Precision | Disease Recall | Disease F1 | Disease Number | Drink Precision | Drink Recall | Drink F1 | Drink Number | Facility Precision | Facility Recall | Facility F1 | Facility Number | Food Precision | Food Recall | Food F1 | Food Number | Humansettlement Precision | Humansettlement Recall | Humansettlement F1 | Humansettlement Number | Medicalprocedure Precision | Medicalprocedure Recall | Medicalprocedure F1 | Medicalprocedure Number | Medication/vaccine Precision | Medication/vaccine Recall | Medication/vaccine F1 | Medication/vaccine Number | Musicalgrp Precision | Musicalgrp Recall | Musicalgrp F1 | Musicalgrp Number | Musicalwork Precision | Musicalwork Recall | Musicalwork F1 | Musicalwork Number | Org Precision | Org Recall | Org F1 | Org Number | Otherloc Precision | Otherloc Recall | Otherloc F1 | Otherloc Number | Otherper Precision | Otherper Recall | Otherper F1 | Otherper Number | Otherprod Precision | Otherprod Recall | Otherprod F1 | Otherprod Number | Politician Precision | Politician Recall | Politician F1 | Politician Number | Privatecorp Precision | Privatecorp Recall | Privatecorp F1 | Privatecorp Number | Publiccorp Precision | Publiccorp Recall | Publiccorp F1 | Publiccorp Number | Scientist Precision | Scientist Recall | Scientist F1 | Scientist Number | Software Precision | Software Recall | Software F1 | Software Number | Sportsgrp Precision | Sportsgrp Recall | Sportsgrp F1 | Sportsgrp Number | Sportsmanager Precision | Sportsmanager Recall | Sportsmanager F1 | Sportsmanager Number | Station Precision | Station Recall | Station F1 | Station Number | Symptom Precision | Symptom Recall | Symptom F1 | Symptom Number | Vehicle Precision | Vehicle Recall | Vehicle F1 | Vehicle Number | Visualwork Precision | Visualwork Recall | Visualwork F1 | Visualwork Number | Writtenwork Precision | Writtenwork Recall | Writtenwork F1 | Writtenwork Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|
183 |
+
|:-------------:|:-----:|:------:|:---------------:|:-------------------------------:|:----------------------------:|:------------------------:|:----------------------------:|:-----------------------------:|:--------------------------:|:----------------------:|:--------------------------:|:-----------------:|:--------------:|:----------:|:--------------:|:----------------:|:-------------:|:---------:|:-------------:|:-----------------:|:--------------:|:----------:|:--------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:-----------------:|:--------------:|:----------:|:--------------:|:---------------:|:------------:|:--------:|:------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:----------------------------:|:-------------------------:|:---------------------:|:-------------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-------------:|:----------:|:------:|:----------:|:------------------:|:---------------:|:-----------:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:-------------------:|:----------------:|:------------:|:----------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:-------------------:|:----------------:|:------------:|:----------------:|:------------------:|:---------------:|:-----------:|:---------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:-----------------:|:--------------:|:----------:|:--------------:|:-----------------:|:--------------:|:----------:|:--------------:|:-----------------:|:--------------:|:----------:|:--------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
|
184 |
+
| 0.2881 | 1.0 | 21353 | 0.2534 | 0.5191 | 0.6884 | 0.5919 | 138 | 0.5693 | 0.6872 | 0.6228 | 227 | 0.4366 | 0.4733 | 0.4542 | 131 | 0.7109 | 0.8055 | 0.7552 | 1722 | 0.6782 | 0.6801 | 0.6792 | 719 | 0.6552 | 0.7170 | 0.6847 | 159 | 0.4874 | 0.4826 | 0.485 | 201 | 0.4639 | 0.6016 | 0.5238 | 128 | 0.4799 | 0.7222 | 0.5766 | 198 | 0.55 | 0.6923 | 0.6130 | 143 | 0.5305 | 0.6640 | 0.5898 | 497 | 0.4042 | 0.7196 | 0.5176 | 214 | 0.8164 | 0.8792 | 0.8466 | 1689 | 0.5799 | 0.6901 | 0.6302 | 142 | 0.5945 | 0.755 | 0.6652 | 200 | 0.7445 | 0.6425 | 0.6898 | 372 | 0.6667 | 0.6634 | 0.6650 | 407 | 0.5585 | 0.5652 | 0.5618 | 667 | 0.6724 | 0.5223 | 0.5879 | 224 | 0.3835 | 0.4773 | 0.4253 | 859 | 0.5237 | 0.4596 | 0.4895 | 433 | 0.5176 | 0.4643 | 0.4895 | 603 | 0.4688 | 0.1163 | 0.1863 | 129 | 0.4207 | 0.6008 | 0.4949 | 243 | 0.4099 | 0.3492 | 0.3771 | 189 | 0.6686 | 0.7362 | 0.7008 | 307 | 0.7688 | 0.7948 | 0.7816 | 385 | 0.5136 | 0.5825 | 0.5459 | 194 | 0.6667 | 0.8041 | 0.7290 | 194 | 0.5588 | 0.1473 | 0.2331 | 129 | 0.4910 | 0.5291 | 0.5093 | 206 | 0.6662 | 0.7489 | 0.7052 | 693 | 0.6180 | 0.5861 | 0.6016 | 563 | 0.6136 | 0.6640 | 0.6378 | 0.9220 |
|
185 |
+
| 0.2195 | 2.0 | 42706 | 0.2288 | 0.6409 | 0.8406 | 0.7273 | 138 | 0.6908 | 0.6300 | 0.6590 | 227 | 0.5625 | 0.5496 | 0.5560 | 131 | 0.7336 | 0.8124 | 0.7710 | 1722 | 0.6466 | 0.8067 | 0.7178 | 719 | 0.6095 | 0.8050 | 0.6938 | 159 | 0.5848 | 0.4975 | 0.5376 | 201 | 0.5260 | 0.6328 | 0.5745 | 128 | 0.5427 | 0.6414 | 0.5880 | 198 | 0.7042 | 0.6993 | 0.7018 | 143 | 0.6157 | 0.7123 | 0.6604 | 497 | 0.6140 | 0.4907 | 0.5455 | 214 | 0.8454 | 0.8745 | 0.8597 | 1689 | 0.6125 | 0.6901 | 0.6490 | 142 | 0.6898 | 0.745 | 0.7163 | 200 | 0.7299 | 0.7339 | 0.7319 | 372 | 0.6901 | 0.7224 | 0.7059 | 407 | 0.6224 | 0.5907 | 0.6062 | 667 | 0.7312 | 0.6071 | 0.6634 | 224 | 0.4851 | 0.4750 | 0.4800 | 859 | 0.5994 | 0.4804 | 0.5333 | 433 | 0.5675 | 0.5091 | 0.5367 | 603 | 0.6905 | 0.4496 | 0.5446 | 129 | 0.5516 | 0.6379 | 0.5916 | 243 | 0.4570 | 0.3651 | 0.4059 | 189 | 0.7508 | 0.7459 | 0.7484 | 307 | 0.7833 | 0.8260 | 0.8040 | 385 | 0.7071 | 0.5103 | 0.5928 | 194 | 0.6920 | 0.7990 | 0.7416 | 194 | 0.4590 | 0.4341 | 0.4462 | 129 | 0.4717 | 0.7282 | 0.5725 | 206 | 0.7275 | 0.7821 | 0.7538 | 693 | 0.6618 | 0.6430 | 0.6523 | 563 | 0.6711 | 0.6946 | 0.6827 | 0.9317 |
|
186 |
+
| 0.1965 | 3.0 | 64059 | 0.2148 | 0.7073 | 0.8406 | 0.7682 | 138 | 0.6762 | 0.7269 | 0.7006 | 227 | 0.5802 | 0.5802 | 0.5802 | 131 | 0.7565 | 0.7938 | 0.7747 | 1722 | 0.7195 | 0.7636 | 0.7409 | 719 | 0.6806 | 0.8176 | 0.7429 | 159 | 0.6867 | 0.5124 | 0.5869 | 201 | 0.5797 | 0.625 | 0.6015 | 128 | 0.6262 | 0.6768 | 0.6505 | 198 | 0.7296 | 0.8112 | 0.7682 | 143 | 0.6439 | 0.7203 | 0.6800 | 497 | 0.6786 | 0.5327 | 0.5969 | 214 | 0.8594 | 0.8792 | 0.8692 | 1689 | 0.6545 | 0.7606 | 0.7036 | 142 | 0.7183 | 0.765 | 0.7409 | 200 | 0.7132 | 0.7688 | 0.7400 | 372 | 0.7513 | 0.7052 | 0.7275 | 407 | 0.6335 | 0.6117 | 0.6224 | 667 | 0.7514 | 0.6205 | 0.6797 | 224 | 0.4558 | 0.5821 | 0.5112 | 859 | 0.6076 | 0.5543 | 0.5797 | 433 | 0.6228 | 0.4793 | 0.5417 | 603 | 0.7159 | 0.4884 | 0.5806 | 129 | 0.56 | 0.6914 | 0.6188 | 243 | 0.4545 | 0.4497 | 0.4521 | 189 | 0.7159 | 0.8046 | 0.7577 | 307 | 0.7845 | 0.8701 | 0.8251 | 385 | 0.6667 | 0.5361 | 0.5943 | 194 | 0.7406 | 0.8093 | 0.7734 | 194 | 0.6316 | 0.5581 | 0.5926 | 129 | 0.5514 | 0.6505 | 0.5969 | 206 | 0.7538 | 0.7951 | 0.7739 | 693 | 0.6913 | 0.6803 | 0.6858 | 563 | 0.6928 | 0.7142 | 0.7033 | 0.9355 |
|
187 |
+
| 0.1665 | 4.0 | 85412 | 0.2193 | 0.7917 | 0.8261 | 0.8085 | 138 | 0.7069 | 0.7225 | 0.7146 | 227 | 0.5867 | 0.6718 | 0.6263 | 131 | 0.7710 | 0.7938 | 0.7823 | 1722 | 0.6962 | 0.7650 | 0.7290 | 719 | 0.7904 | 0.8302 | 0.8098 | 159 | 0.6221 | 0.5323 | 0.5737 | 201 | 0.5743 | 0.6641 | 0.6159 | 128 | 0.5966 | 0.7172 | 0.6514 | 198 | 0.7914 | 0.7692 | 0.7801 | 143 | 0.6395 | 0.7103 | 0.6730 | 497 | 0.6422 | 0.6121 | 0.6268 | 214 | 0.8338 | 0.9059 | 0.8683 | 1689 | 0.6711 | 0.7183 | 0.6939 | 142 | 0.7635 | 0.775 | 0.7692 | 200 | 0.7669 | 0.7608 | 0.7638 | 372 | 0.6872 | 0.7936 | 0.7366 | 407 | 0.7100 | 0.5982 | 0.6493 | 667 | 0.7181 | 0.7277 | 0.7228 | 224 | 0.4765 | 0.5553 | 0.5129 | 859 | 0.6225 | 0.5866 | 0.6040 | 433 | 0.6078 | 0.5191 | 0.5599 | 603 | 0.7222 | 0.5039 | 0.5936 | 129 | 0.6065 | 0.7737 | 0.6799 | 243 | 0.4783 | 0.5238 | 0.5 | 189 | 0.7313 | 0.7980 | 0.7632 | 307 | 0.8401 | 0.8597 | 0.8498 | 385 | 0.6058 | 0.6495 | 0.6269 | 194 | 0.7512 | 0.7938 | 0.7719 | 194 | 0.6983 | 0.6279 | 0.6612 | 129 | 0.5804 | 0.7184 | 0.6421 | 206 | 0.7571 | 0.8052 | 0.7804 | 693 | 0.6916 | 0.6892 | 0.6904 | 563 | 0.7012 | 0.7309 | 0.7158 | 0.9375 |
|
188 |
+
| 0.1314 | 5.0 | 106765 | 0.2272 | 0.7707 | 0.8768 | 0.8203 | 138 | 0.7137 | 0.7577 | 0.7350 | 227 | 0.6058 | 0.6336 | 0.6194 | 131 | 0.7229 | 0.8513 | 0.7819 | 1722 | 0.7361 | 0.7761 | 0.7556 | 719 | 0.6839 | 0.8302 | 0.7500 | 159 | 0.5845 | 0.6020 | 0.5931 | 201 | 0.6148 | 0.6484 | 0.6312 | 128 | 0.6121 | 0.7172 | 0.6605 | 198 | 0.6970 | 0.8042 | 0.7468 | 143 | 0.6438 | 0.6982 | 0.6699 | 497 | 0.6197 | 0.6776 | 0.6473 | 214 | 0.8390 | 0.8887 | 0.8631 | 1689 | 0.7333 | 0.6972 | 0.7148 | 142 | 0.7443 | 0.815 | 0.7780 | 200 | 0.7217 | 0.7876 | 0.7532 | 372 | 0.7113 | 0.7568 | 0.7333 | 407 | 0.6682 | 0.6522 | 0.6601 | 667 | 0.7136 | 0.7009 | 0.7072 | 224 | 0.5351 | 0.4796 | 0.5058 | 859 | 0.5930 | 0.6259 | 0.6090 | 433 | 0.6112 | 0.5240 | 0.5643 | 603 | 0.7767 | 0.6202 | 0.6897 | 129 | 0.6254 | 0.7284 | 0.6730 | 243 | 0.4815 | 0.4815 | 0.4815 | 189 | 0.7654 | 0.8078 | 0.7861 | 307 | 0.7611 | 0.8935 | 0.8220 | 385 | 0.6667 | 0.6082 | 0.6361 | 194 | 0.7828 | 0.7990 | 0.7908 | 194 | 0.6692 | 0.6899 | 0.6794 | 129 | 0.5983 | 0.6942 | 0.6427 | 206 | 0.7584 | 0.8153 | 0.7858 | 693 | 0.6740 | 0.7052 | 0.6892 | 563 | 0.7006 | 0.7401 | 0.7198 | 0.9378 |
|
189 |
+
| 0.1224 | 6.0 | 128118 | 0.2275 | 0.8286 | 0.8406 | 0.8345 | 138 | 0.6898 | 0.7445 | 0.7161 | 227 | 0.6013 | 0.7252 | 0.6574 | 131 | 0.7574 | 0.8415 | 0.7972 | 1722 | 0.7400 | 0.7483 | 0.7441 | 719 | 0.8084 | 0.8491 | 0.8282 | 159 | 0.7055 | 0.5721 | 0.6319 | 201 | 0.6061 | 0.625 | 0.6154 | 128 | 0.7090 | 0.6768 | 0.6925 | 198 | 0.7868 | 0.7483 | 0.7670 | 143 | 0.6454 | 0.7545 | 0.6957 | 497 | 0.6287 | 0.6963 | 0.6608 | 214 | 0.8548 | 0.8851 | 0.8697 | 1689 | 0.7669 | 0.7183 | 0.7418 | 142 | 0.75 | 0.825 | 0.7857 | 200 | 0.7130 | 0.8280 | 0.7662 | 372 | 0.6848 | 0.8059 | 0.7404 | 407 | 0.7112 | 0.6462 | 0.6771 | 667 | 0.7879 | 0.6964 | 0.7393 | 224 | 0.5378 | 0.5378 | 0.5378 | 859 | 0.6554 | 0.5797 | 0.6152 | 433 | 0.5946 | 0.5887 | 0.5917 | 603 | 0.8131 | 0.6744 | 0.7373 | 129 | 0.6483 | 0.7737 | 0.7054 | 243 | 0.5537 | 0.5185 | 0.5355 | 189 | 0.7704 | 0.7980 | 0.784 | 307 | 0.8415 | 0.8961 | 0.8679 | 385 | 0.6566 | 0.6701 | 0.6633 | 194 | 0.7879 | 0.8041 | 0.7959 | 194 | 0.6159 | 0.7829 | 0.6894 | 129 | 0.5887 | 0.7087 | 0.6432 | 206 | 0.7864 | 0.8023 | 0.7943 | 693 | 0.7388 | 0.6732 | 0.7045 | 563 | 0.7221 | 0.7475 | 0.7346 | 0.9406 |
|
190 |
+
| 0.0964 | 7.0 | 149471 | 0.2456 | 0.7947 | 0.8696 | 0.8304 | 138 | 0.7107 | 0.7577 | 0.7335 | 227 | 0.6522 | 0.6870 | 0.6691 | 131 | 0.7780 | 0.8182 | 0.7976 | 1722 | 0.7546 | 0.7483 | 0.7514 | 719 | 0.7870 | 0.8365 | 0.8110 | 159 | 0.6020 | 0.6020 | 0.6020 | 201 | 0.58 | 0.6797 | 0.6259 | 128 | 0.6129 | 0.7677 | 0.6816 | 198 | 0.7468 | 0.8252 | 0.7841 | 143 | 0.6642 | 0.7284 | 0.6948 | 497 | 0.6840 | 0.6776 | 0.6808 | 214 | 0.8586 | 0.8810 | 0.8697 | 1689 | 0.7836 | 0.7394 | 0.7609 | 142 | 0.7082 | 0.825 | 0.7621 | 200 | 0.7731 | 0.7876 | 0.7803 | 372 | 0.7606 | 0.7494 | 0.7550 | 407 | 0.6726 | 0.6837 | 0.6781 | 667 | 0.7581 | 0.7277 | 0.7426 | 224 | 0.5176 | 0.5634 | 0.5396 | 859 | 0.6599 | 0.6005 | 0.6288 | 433 | 0.5938 | 0.5672 | 0.5802 | 603 | 0.8776 | 0.6667 | 0.7577 | 129 | 0.7198 | 0.7613 | 0.74 | 243 | 0.5078 | 0.5185 | 0.5131 | 189 | 0.7933 | 0.7752 | 0.7842 | 307 | 0.8033 | 0.8909 | 0.8448 | 385 | 0.6071 | 0.7010 | 0.6507 | 194 | 0.7429 | 0.8041 | 0.7723 | 194 | 0.7321 | 0.6357 | 0.6805 | 129 | 0.5775 | 0.7233 | 0.6422 | 206 | 0.7858 | 0.7994 | 0.7926 | 693 | 0.6678 | 0.7282 | 0.6967 | 563 | 0.7199 | 0.7475 | 0.7334 | 0.9403 |
|
191 |
+
| 0.0838 | 8.0 | 170824 | 0.2562 | 0.7722 | 0.8841 | 0.8243 | 138 | 0.6929 | 0.7753 | 0.7318 | 227 | 0.6483 | 0.7176 | 0.6812 | 131 | 0.7859 | 0.8101 | 0.7978 | 1722 | 0.7419 | 0.7316 | 0.7367 | 719 | 0.7389 | 0.8365 | 0.7847 | 159 | 0.5797 | 0.5970 | 0.5882 | 201 | 0.5878 | 0.6797 | 0.6304 | 128 | 0.6574 | 0.7172 | 0.6860 | 198 | 0.7597 | 0.8182 | 0.7879 | 143 | 0.7108 | 0.7123 | 0.7116 | 497 | 0.6511 | 0.7150 | 0.6815 | 214 | 0.8791 | 0.8822 | 0.8806 | 1689 | 0.75 | 0.7606 | 0.7552 | 142 | 0.7594 | 0.805 | 0.7816 | 200 | 0.7842 | 0.8011 | 0.7926 | 372 | 0.7395 | 0.7813 | 0.7599 | 407 | 0.6965 | 0.6777 | 0.6869 | 667 | 0.7179 | 0.75 | 0.7336 | 224 | 0.5081 | 0.5809 | 0.5421 | 859 | 0.6327 | 0.6166 | 0.6246 | 433 | 0.6094 | 0.5821 | 0.5954 | 603 | 0.8776 | 0.6667 | 0.7577 | 129 | 0.7059 | 0.7407 | 0.7229 | 243 | 0.5444 | 0.5185 | 0.5312 | 189 | 0.7722 | 0.7948 | 0.7833 | 307 | 0.8067 | 0.8779 | 0.8408 | 385 | 0.6408 | 0.6804 | 0.6600 | 194 | 0.7546 | 0.8402 | 0.7951 | 194 | 0.6831 | 0.7519 | 0.7159 | 129 | 0.6255 | 0.7136 | 0.6667 | 206 | 0.7392 | 0.8427 | 0.7876 | 693 | 0.7289 | 0.7069 | 0.7178 | 563 | 0.7242 | 0.7514 | 0.7376 | 0.9414 |
|
192 |
+
| 0.0753 | 9.0 | 192177 | 0.2708 | 0.8026 | 0.8841 | 0.8414 | 138 | 0.7054 | 0.8018 | 0.7505 | 227 | 0.6277 | 0.6565 | 0.6418 | 131 | 0.7762 | 0.8380 | 0.8059 | 1722 | 0.7552 | 0.7552 | 0.7552 | 719 | 0.7701 | 0.8428 | 0.8048 | 159 | 0.6610 | 0.5821 | 0.6190 | 201 | 0.5915 | 0.6562 | 0.6222 | 128 | 0.6575 | 0.7273 | 0.6906 | 198 | 0.7887 | 0.7832 | 0.7860 | 143 | 0.7050 | 0.7163 | 0.7106 | 497 | 0.6270 | 0.7383 | 0.6781 | 214 | 0.8441 | 0.8881 | 0.8656 | 1689 | 0.7589 | 0.7535 | 0.7562 | 142 | 0.7125 | 0.855 | 0.7773 | 200 | 0.755 | 0.8118 | 0.7824 | 372 | 0.7512 | 0.8010 | 0.7753 | 407 | 0.6788 | 0.6972 | 0.6879 | 667 | 0.7830 | 0.7411 | 0.7615 | 224 | 0.5155 | 0.5821 | 0.5467 | 859 | 0.6386 | 0.6490 | 0.6438 | 433 | 0.6629 | 0.5804 | 0.6189 | 603 | 0.8598 | 0.7132 | 0.7797 | 129 | 0.6667 | 0.7490 | 0.7054 | 243 | 0.4787 | 0.5344 | 0.505 | 189 | 0.7610 | 0.7883 | 0.7744 | 307 | 0.8285 | 0.8909 | 0.8586 | 385 | 0.7027 | 0.6701 | 0.6860 | 194 | 0.7778 | 0.8299 | 0.8030 | 194 | 0.6923 | 0.7674 | 0.7279 | 129 | 0.6396 | 0.6893 | 0.6636 | 206 | 0.7879 | 0.8095 | 0.7986 | 693 | 0.7110 | 0.7123 | 0.7116 | 563 | 0.7258 | 0.7593 | 0.7422 | 0.9424 |
|
193 |
+
| 0.0574 | 10.0 | 213530 | 0.2862 | 0.8 | 0.8986 | 0.8464 | 138 | 0.7375 | 0.7797 | 0.7580 | 227 | 0.6471 | 0.6718 | 0.6592 | 131 | 0.7831 | 0.8008 | 0.7918 | 1722 | 0.6997 | 0.7747 | 0.7353 | 719 | 0.7714 | 0.8491 | 0.8084 | 159 | 0.6091 | 0.5970 | 0.6030 | 201 | 0.6357 | 0.6406 | 0.6381 | 128 | 0.7 | 0.7071 | 0.7035 | 198 | 0.7436 | 0.8112 | 0.7759 | 143 | 0.6729 | 0.7243 | 0.6977 | 497 | 0.6830 | 0.7150 | 0.6986 | 214 | 0.8627 | 0.8857 | 0.8741 | 1689 | 0.7483 | 0.7535 | 0.7509 | 142 | 0.7611 | 0.86 | 0.8075 | 200 | 0.7846 | 0.8226 | 0.8031 | 372 | 0.7640 | 0.7715 | 0.7677 | 407 | 0.6921 | 0.6942 | 0.6931 | 667 | 0.7478 | 0.7545 | 0.7511 | 224 | 0.5079 | 0.5960 | 0.5485 | 859 | 0.6457 | 0.6397 | 0.6427 | 433 | 0.6223 | 0.5821 | 0.6015 | 603 | 0.8704 | 0.7287 | 0.7932 | 129 | 0.7041 | 0.7737 | 0.7373 | 243 | 0.5073 | 0.5503 | 0.5279 | 189 | 0.7680 | 0.7980 | 0.7827 | 307 | 0.8658 | 0.8883 | 0.8769 | 385 | 0.7111 | 0.6598 | 0.6845 | 194 | 0.7681 | 0.8196 | 0.7930 | 194 | 0.7197 | 0.7364 | 0.7280 | 129 | 0.6192 | 0.7184 | 0.6652 | 206 | 0.7922 | 0.8196 | 0.8057 | 693 | 0.7206 | 0.7194 | 0.72 | 563 | 0.7282 | 0.7572 | 0.7424 | 0.9424 |
|
194 |
+
| 0.0568 | 11.0 | 234883 | 0.2951 | 0.8026 | 0.8841 | 0.8414 | 138 | 0.7458 | 0.7753 | 0.7603 | 227 | 0.6241 | 0.6718 | 0.6471 | 131 | 0.7737 | 0.8240 | 0.7981 | 1722 | 0.7646 | 0.7455 | 0.7549 | 719 | 0.8121 | 0.8428 | 0.8272 | 159 | 0.6685 | 0.5920 | 0.6280 | 201 | 0.6870 | 0.6172 | 0.6502 | 128 | 0.7150 | 0.6970 | 0.7059 | 198 | 0.7872 | 0.7762 | 0.7817 | 143 | 0.6631 | 0.7485 | 0.7032 | 497 | 0.6842 | 0.6682 | 0.6761 | 214 | 0.8594 | 0.8828 | 0.8709 | 1689 | 0.7863 | 0.7254 | 0.7546 | 142 | 0.7824 | 0.845 | 0.8125 | 200 | 0.7628 | 0.8038 | 0.7827 | 372 | 0.7664 | 0.7740 | 0.7702 | 407 | 0.7232 | 0.6777 | 0.6997 | 667 | 0.7820 | 0.7366 | 0.7586 | 224 | 0.5362 | 0.5949 | 0.5640 | 859 | 0.6306 | 0.6467 | 0.6385 | 433 | 0.6472 | 0.5871 | 0.6157 | 603 | 0.8857 | 0.7209 | 0.7949 | 129 | 0.7138 | 0.7901 | 0.7500 | 243 | 0.5075 | 0.5397 | 0.5231 | 189 | 0.7834 | 0.8013 | 0.7923 | 307 | 0.8561 | 0.8961 | 0.8756 | 385 | 0.6809 | 0.6598 | 0.6702 | 194 | 0.7656 | 0.8247 | 0.7940 | 194 | 0.6736 | 0.7519 | 0.7106 | 129 | 0.6262 | 0.6505 | 0.6381 | 206 | 0.7892 | 0.8211 | 0.8048 | 693 | 0.7561 | 0.7105 | 0.7326 | 563 | 0.7390 | 0.7548 | 0.7468 | 0.9431 |
|
195 |
+
| 0.0465 | 12.0 | 256236 | 0.3103 | 0.8194 | 0.9203 | 0.8669 | 138 | 0.7031 | 0.7930 | 0.7453 | 227 | 0.5867 | 0.6718 | 0.6263 | 131 | 0.7829 | 0.8211 | 0.8016 | 1722 | 0.7582 | 0.7413 | 0.7496 | 719 | 0.8059 | 0.8616 | 0.8328 | 159 | 0.6648 | 0.5920 | 0.6263 | 201 | 0.6385 | 0.6484 | 0.6434 | 128 | 0.6827 | 0.7172 | 0.6995 | 198 | 0.7778 | 0.8322 | 0.8041 | 143 | 0.6679 | 0.7324 | 0.6987 | 497 | 0.6864 | 0.7056 | 0.6959 | 214 | 0.8473 | 0.8905 | 0.8684 | 1689 | 0.7552 | 0.7606 | 0.7579 | 142 | 0.7362 | 0.865 | 0.7954 | 200 | 0.7487 | 0.8011 | 0.7740 | 372 | 0.7470 | 0.7764 | 0.7614 | 407 | 0.7042 | 0.7031 | 0.7037 | 667 | 0.7435 | 0.7634 | 0.7533 | 224 | 0.5438 | 0.5856 | 0.5639 | 859 | 0.6261 | 0.6536 | 0.6395 | 433 | 0.6442 | 0.6186 | 0.6311 | 603 | 0.8482 | 0.7364 | 0.7884 | 129 | 0.7283 | 0.7613 | 0.7445 | 243 | 0.5075 | 0.5397 | 0.5231 | 189 | 0.7915 | 0.7915 | 0.7915 | 307 | 0.8564 | 0.8987 | 0.8771 | 385 | 0.6211 | 0.7268 | 0.6698 | 194 | 0.7633 | 0.8144 | 0.7880 | 194 | 0.7313 | 0.7597 | 0.7452 | 129 | 0.6450 | 0.7233 | 0.6819 | 206 | 0.7758 | 0.8139 | 0.7944 | 693 | 0.7189 | 0.7176 | 0.7182 | 563 | 0.7312 | 0.7621 | 0.7464 | 0.9428 |
|
196 |
+
| 0.0459 | 13.0 | 277589 | 0.3141 | 0.8267 | 0.8986 | 0.8611 | 138 | 0.7254 | 0.7797 | 0.7516 | 227 | 0.6099 | 0.6565 | 0.6324 | 131 | 0.7929 | 0.8182 | 0.8054 | 1722 | 0.7562 | 0.7677 | 0.7619 | 719 | 0.8084 | 0.8491 | 0.8282 | 159 | 0.6302 | 0.6020 | 0.6158 | 201 | 0.6412 | 0.6562 | 0.6486 | 128 | 0.6931 | 0.7071 | 0.7000 | 198 | 0.7770 | 0.8042 | 0.7904 | 143 | 0.6834 | 0.7384 | 0.7099 | 497 | 0.6967 | 0.6869 | 0.6918 | 214 | 0.8631 | 0.8845 | 0.8737 | 1689 | 0.7939 | 0.7324 | 0.7619 | 142 | 0.7830 | 0.83 | 0.8058 | 200 | 0.7822 | 0.8011 | 0.7915 | 372 | 0.7482 | 0.7740 | 0.7609 | 407 | 0.6982 | 0.6972 | 0.6977 | 667 | 0.7867 | 0.7411 | 0.7632 | 224 | 0.5323 | 0.5856 | 0.5576 | 859 | 0.6469 | 0.6559 | 0.6514 | 433 | 0.6512 | 0.6036 | 0.6265 | 603 | 0.8611 | 0.7209 | 0.7848 | 129 | 0.7287 | 0.7737 | 0.7505 | 243 | 0.5185 | 0.5185 | 0.5185 | 189 | 0.7910 | 0.8013 | 0.7961 | 307 | 0.8715 | 0.8987 | 0.8849 | 385 | 0.7283 | 0.6907 | 0.7090 | 194 | 0.7512 | 0.7938 | 0.7719 | 194 | 0.7313 | 0.7597 | 0.7452 | 129 | 0.6147 | 0.6893 | 0.6499 | 206 | 0.7947 | 0.8268 | 0.8105 | 693 | 0.7170 | 0.7247 | 0.7208 | 563 | 0.7406 | 0.7588 | 0.7496 | 0.9436 |
|
197 |
+
| 0.0386 | 14.0 | 298942 | 0.3268 | 0.8333 | 0.9058 | 0.8681 | 138 | 0.7092 | 0.7841 | 0.7448 | 227 | 0.6028 | 0.6489 | 0.625 | 131 | 0.7848 | 0.8153 | 0.7998 | 1722 | 0.7701 | 0.7594 | 0.7647 | 719 | 0.8047 | 0.8553 | 0.8293 | 159 | 0.6373 | 0.6119 | 0.6244 | 201 | 0.6204 | 0.6641 | 0.6415 | 128 | 0.6794 | 0.7172 | 0.6978 | 198 | 0.7986 | 0.8042 | 0.8014 | 143 | 0.6691 | 0.7324 | 0.6993 | 497 | 0.7109 | 0.7009 | 0.7059 | 214 | 0.8624 | 0.8834 | 0.8728 | 1689 | 0.7754 | 0.7535 | 0.7643 | 142 | 0.7757 | 0.83 | 0.8019 | 200 | 0.7712 | 0.8065 | 0.7884 | 372 | 0.7621 | 0.7715 | 0.7668 | 407 | 0.6782 | 0.7076 | 0.6926 | 667 | 0.7661 | 0.7455 | 0.7557 | 224 | 0.5417 | 0.5669 | 0.5540 | 859 | 0.6388 | 0.6536 | 0.6461 | 433 | 0.6160 | 0.6119 | 0.6140 | 603 | 0.8889 | 0.7442 | 0.8101 | 129 | 0.7431 | 0.7737 | 0.7581 | 243 | 0.5025 | 0.5397 | 0.5204 | 189 | 0.7915 | 0.7915 | 0.7915 | 307 | 0.8618 | 0.8909 | 0.8761 | 385 | 0.6699 | 0.7113 | 0.6900 | 194 | 0.7621 | 0.8093 | 0.7850 | 194 | 0.7226 | 0.7674 | 0.7444 | 129 | 0.6384 | 0.6942 | 0.6651 | 206 | 0.7872 | 0.8167 | 0.8017 | 693 | 0.7140 | 0.7229 | 0.7184 | 563 | 0.7358 | 0.7585 | 0.7470 | 0.9435 |
|
198 |
+
| 0.037 | 15.0 | 320295 | 0.3308 | 0.8117 | 0.9058 | 0.8562 | 138 | 0.716 | 0.7885 | 0.7505 | 227 | 0.6028 | 0.6489 | 0.625 | 131 | 0.7838 | 0.8252 | 0.8040 | 1722 | 0.7835 | 0.7552 | 0.7691 | 719 | 0.7953 | 0.8553 | 0.8242 | 159 | 0.6630 | 0.5970 | 0.6283 | 201 | 0.6296 | 0.6641 | 0.6464 | 128 | 0.6961 | 0.7172 | 0.7065 | 198 | 0.8 | 0.8112 | 0.8056 | 143 | 0.6849 | 0.7304 | 0.7069 | 497 | 0.7156 | 0.7056 | 0.7106 | 214 | 0.8631 | 0.8845 | 0.8737 | 1689 | 0.7852 | 0.7465 | 0.7653 | 142 | 0.7602 | 0.84 | 0.7981 | 200 | 0.7601 | 0.8091 | 0.7839 | 372 | 0.7506 | 0.7617 | 0.7561 | 407 | 0.6943 | 0.7151 | 0.7046 | 667 | 0.7767 | 0.7455 | 0.7608 | 224 | 0.5351 | 0.5588 | 0.5467 | 859 | 0.6453 | 0.6513 | 0.6483 | 433 | 0.6277 | 0.6153 | 0.6214 | 603 | 0.8981 | 0.7519 | 0.8186 | 129 | 0.7362 | 0.7695 | 0.7525 | 243 | 0.5178 | 0.5397 | 0.5285 | 189 | 0.7806 | 0.7883 | 0.7844 | 307 | 0.8804 | 0.8987 | 0.8895 | 385 | 0.6863 | 0.7216 | 0.7035 | 194 | 0.7696 | 0.8093 | 0.7889 | 194 | 0.7333 | 0.7674 | 0.7500 | 129 | 0.6471 | 0.6942 | 0.6698 | 206 | 0.7917 | 0.8225 | 0.8068 | 693 | 0.7255 | 0.7229 | 0.7242 | 563 | 0.7404 | 0.7600 | 0.7501 | 0.9437 |
|
199 |
+
|
200 |
+
|
201 |
+
### Framework versions
|
202 |
+
|
203 |
+
- Transformers 4.26.0.dev0
|
204 |
+
- Pytorch 1.12.1+cu113
|
205 |
+
- Datasets 2.7.1
|
206 |
+
- Tokenizers 0.13.2
|