File size: 50,662 Bytes
a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 d9dc71b a498db2 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 |
---
license: mit
tags:
- generated_from_trainer
model-index:
- name: mdeberta_all
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# mdeberta_all
This model is a fine-tuned version of [microsoft/mdeberta-v3-base](https://huggingface.co/microsoft/mdeberta-v3-base) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2148
- Aerospacemanufacturer Precision: 0.7073
- Aerospacemanufacturer Recall: 0.8406
- Aerospacemanufacturer F1: 0.7682
- Aerospacemanufacturer Number: 138
- Anatomicalstructure Precision: 0.6762
- Anatomicalstructure Recall: 0.7269
- Anatomicalstructure F1: 0.7006
- Anatomicalstructure Number: 227
- Artwork Precision: 0.5802
- Artwork Recall: 0.5802
- Artwork F1: 0.5802
- Artwork Number: 131
- Artist Precision: 0.7565
- Artist Recall: 0.7938
- Artist F1: 0.7747
- Artist Number: 1722
- Athlete Precision: 0.7195
- Athlete Recall: 0.7636
- Athlete F1: 0.7409
- Athlete Number: 719
- Carmanufacturer Precision: 0.6806
- Carmanufacturer Recall: 0.8176
- Carmanufacturer F1: 0.7429
- Carmanufacturer Number: 159
- Cleric Precision: 0.6867
- Cleric Recall: 0.5124
- Cleric F1: 0.5869
- Cleric Number: 201
- Clothing Precision: 0.5797
- Clothing Recall: 0.625
- Clothing F1: 0.6015
- Clothing Number: 128
- Disease Precision: 0.6262
- Disease Recall: 0.6768
- Disease F1: 0.6505
- Disease Number: 198
- Drink Precision: 0.7296
- Drink Recall: 0.8112
- Drink F1: 0.7682
- Drink Number: 143
- Facility Precision: 0.6439
- Facility Recall: 0.7203
- Facility F1: 0.6800
- Facility Number: 497
- Food Precision: 0.6786
- Food Recall: 0.5327
- Food F1: 0.5969
- Food Number: 214
- Humansettlement Precision: 0.8594
- Humansettlement Recall: 0.8792
- Humansettlement F1: 0.8692
- Humansettlement Number: 1689
- Medicalprocedure Precision: 0.6545
- Medicalprocedure Recall: 0.7606
- Medicalprocedure F1: 0.7036
- Medicalprocedure Number: 142
- Medication/vaccine Precision: 0.7183
- Medication/vaccine Recall: 0.765
- Medication/vaccine F1: 0.7409
- Medication/vaccine Number: 200
- Musicalgrp Precision: 0.7132
- Musicalgrp Recall: 0.7688
- Musicalgrp F1: 0.7400
- Musicalgrp Number: 372
- Musicalwork Precision: 0.7513
- Musicalwork Recall: 0.7052
- Musicalwork F1: 0.7275
- Musicalwork Number: 407
- Org Precision: 0.6335
- Org Recall: 0.6117
- Org F1: 0.6224
- Org Number: 667
- Otherloc Precision: 0.7514
- Otherloc Recall: 0.6205
- Otherloc F1: 0.6797
- Otherloc Number: 224
- Otherper Precision: 0.4558
- Otherper Recall: 0.5821
- Otherper F1: 0.5112
- Otherper Number: 859
- Otherprod Precision: 0.6076
- Otherprod Recall: 0.5543
- Otherprod F1: 0.5797
- Otherprod Number: 433
- Politician Precision: 0.6228
- Politician Recall: 0.4793
- Politician F1: 0.5417
- Politician Number: 603
- Privatecorp Precision: 0.7159
- Privatecorp Recall: 0.4884
- Privatecorp F1: 0.5806
- Privatecorp Number: 129
- Publiccorp Precision: 0.56
- Publiccorp Recall: 0.6914
- Publiccorp F1: 0.6188
- Publiccorp Number: 243
- Scientist Precision: 0.4545
- Scientist Recall: 0.4497
- Scientist F1: 0.4521
- Scientist Number: 189
- Software Precision: 0.7159
- Software Recall: 0.8046
- Software F1: 0.7577
- Software Number: 307
- Sportsgrp Precision: 0.7845
- Sportsgrp Recall: 0.8701
- Sportsgrp F1: 0.8251
- Sportsgrp Number: 385
- Sportsmanager Precision: 0.6667
- Sportsmanager Recall: 0.5361
- Sportsmanager F1: 0.5943
- Sportsmanager Number: 194
- Station Precision: 0.7406
- Station Recall: 0.8093
- Station F1: 0.7734
- Station Number: 194
- Symptom Precision: 0.6316
- Symptom Recall: 0.5581
- Symptom F1: 0.5926
- Symptom Number: 129
- Vehicle Precision: 0.5514
- Vehicle Recall: 0.6505
- Vehicle F1: 0.5969
- Vehicle Number: 206
- Visualwork Precision: 0.7538
- Visualwork Recall: 0.7951
- Visualwork F1: 0.7739
- Visualwork Number: 693
- Writtenwork Precision: 0.6913
- Writtenwork Recall: 0.6803
- Writtenwork F1: 0.6858
- Writtenwork Number: 563
- Overall Precision: 0.6928
- Overall Recall: 0.7142
- Overall F1: 0.7033
- Overall Accuracy: 0.9355
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 15.0
### Training results
| Training Loss | Epoch | Step | Validation Loss | Aerospacemanufacturer Precision | Aerospacemanufacturer Recall | Aerospacemanufacturer F1 | Aerospacemanufacturer Number | Anatomicalstructure Precision | Anatomicalstructure Recall | Anatomicalstructure F1 | Anatomicalstructure Number | Artwork Precision | Artwork Recall | Artwork F1 | Artwork Number | Artist Precision | Artist Recall | Artist F1 | Artist Number | Athlete Precision | Athlete Recall | Athlete F1 | Athlete Number | Carmanufacturer Precision | Carmanufacturer Recall | Carmanufacturer F1 | Carmanufacturer Number | Cleric Precision | Cleric Recall | Cleric F1 | Cleric Number | Clothing Precision | Clothing Recall | Clothing F1 | Clothing Number | Disease Precision | Disease Recall | Disease F1 | Disease Number | Drink Precision | Drink Recall | Drink F1 | Drink Number | Facility Precision | Facility Recall | Facility F1 | Facility Number | Food Precision | Food Recall | Food F1 | Food Number | Humansettlement Precision | Humansettlement Recall | Humansettlement F1 | Humansettlement Number | Medicalprocedure Precision | Medicalprocedure Recall | Medicalprocedure F1 | Medicalprocedure Number | Medication/vaccine Precision | Medication/vaccine Recall | Medication/vaccine F1 | Medication/vaccine Number | Musicalgrp Precision | Musicalgrp Recall | Musicalgrp F1 | Musicalgrp Number | Musicalwork Precision | Musicalwork Recall | Musicalwork F1 | Musicalwork Number | Org Precision | Org Recall | Org F1 | Org Number | Otherloc Precision | Otherloc Recall | Otherloc F1 | Otherloc Number | Otherper Precision | Otherper Recall | Otherper F1 | Otherper Number | Otherprod Precision | Otherprod Recall | Otherprod F1 | Otherprod Number | Politician Precision | Politician Recall | Politician F1 | Politician Number | Privatecorp Precision | Privatecorp Recall | Privatecorp F1 | Privatecorp Number | Publiccorp Precision | Publiccorp Recall | Publiccorp F1 | Publiccorp Number | Scientist Precision | Scientist Recall | Scientist F1 | Scientist Number | Software Precision | Software Recall | Software F1 | Software Number | Sportsgrp Precision | Sportsgrp Recall | Sportsgrp F1 | Sportsgrp Number | Sportsmanager Precision | Sportsmanager Recall | Sportsmanager F1 | Sportsmanager Number | Station Precision | Station Recall | Station F1 | Station Number | Symptom Precision | Symptom Recall | Symptom F1 | Symptom Number | Vehicle Precision | Vehicle Recall | Vehicle F1 | Vehicle Number | Visualwork Precision | Visualwork Recall | Visualwork F1 | Visualwork Number | Writtenwork Precision | Writtenwork Recall | Writtenwork F1 | Writtenwork Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:------:|:---------------:|:-------------------------------:|:----------------------------:|:------------------------:|:----------------------------:|:-----------------------------:|:--------------------------:|:----------------------:|:--------------------------:|:-----------------:|:--------------:|:----------:|:--------------:|:----------------:|:-------------:|:---------:|:-------------:|:-----------------:|:--------------:|:----------:|:--------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:-----------------:|:--------------:|:----------:|:--------------:|:---------------:|:------------:|:--------:|:------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:----------------------------:|:-------------------------:|:---------------------:|:-------------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-------------:|:----------:|:------:|:----------:|:------------------:|:---------------:|:-----------:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:-------------------:|:----------------:|:------------:|:----------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:-------------------:|:----------------:|:------------:|:----------------:|:------------------:|:---------------:|:-----------:|:---------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:-----------------:|:--------------:|:----------:|:--------------:|:-----------------:|:--------------:|:----------:|:--------------:|:-----------------:|:--------------:|:----------:|:--------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.2881 | 1.0 | 21353 | 0.2534 | 0.5191 | 0.6884 | 0.5919 | 138 | 0.5693 | 0.6872 | 0.6228 | 227 | 0.4366 | 0.4733 | 0.4542 | 131 | 0.7109 | 0.8055 | 0.7552 | 1722 | 0.6782 | 0.6801 | 0.6792 | 719 | 0.6552 | 0.7170 | 0.6847 | 159 | 0.4874 | 0.4826 | 0.485 | 201 | 0.4639 | 0.6016 | 0.5238 | 128 | 0.4799 | 0.7222 | 0.5766 | 198 | 0.55 | 0.6923 | 0.6130 | 143 | 0.5305 | 0.6640 | 0.5898 | 497 | 0.4042 | 0.7196 | 0.5176 | 214 | 0.8164 | 0.8792 | 0.8466 | 1689 | 0.5799 | 0.6901 | 0.6302 | 142 | 0.5945 | 0.755 | 0.6652 | 200 | 0.7445 | 0.6425 | 0.6898 | 372 | 0.6667 | 0.6634 | 0.6650 | 407 | 0.5585 | 0.5652 | 0.5618 | 667 | 0.6724 | 0.5223 | 0.5879 | 224 | 0.3835 | 0.4773 | 0.4253 | 859 | 0.5237 | 0.4596 | 0.4895 | 433 | 0.5176 | 0.4643 | 0.4895 | 603 | 0.4688 | 0.1163 | 0.1863 | 129 | 0.4207 | 0.6008 | 0.4949 | 243 | 0.4099 | 0.3492 | 0.3771 | 189 | 0.6686 | 0.7362 | 0.7008 | 307 | 0.7688 | 0.7948 | 0.7816 | 385 | 0.5136 | 0.5825 | 0.5459 | 194 | 0.6667 | 0.8041 | 0.7290 | 194 | 0.5588 | 0.1473 | 0.2331 | 129 | 0.4910 | 0.5291 | 0.5093 | 206 | 0.6662 | 0.7489 | 0.7052 | 693 | 0.6180 | 0.5861 | 0.6016 | 563 | 0.6136 | 0.6640 | 0.6378 | 0.9220 |
| 0.2195 | 2.0 | 42706 | 0.2288 | 0.6409 | 0.8406 | 0.7273 | 138 | 0.6908 | 0.6300 | 0.6590 | 227 | 0.5625 | 0.5496 | 0.5560 | 131 | 0.7336 | 0.8124 | 0.7710 | 1722 | 0.6466 | 0.8067 | 0.7178 | 719 | 0.6095 | 0.8050 | 0.6938 | 159 | 0.5848 | 0.4975 | 0.5376 | 201 | 0.5260 | 0.6328 | 0.5745 | 128 | 0.5427 | 0.6414 | 0.5880 | 198 | 0.7042 | 0.6993 | 0.7018 | 143 | 0.6157 | 0.7123 | 0.6604 | 497 | 0.6140 | 0.4907 | 0.5455 | 214 | 0.8454 | 0.8745 | 0.8597 | 1689 | 0.6125 | 0.6901 | 0.6490 | 142 | 0.6898 | 0.745 | 0.7163 | 200 | 0.7299 | 0.7339 | 0.7319 | 372 | 0.6901 | 0.7224 | 0.7059 | 407 | 0.6224 | 0.5907 | 0.6062 | 667 | 0.7312 | 0.6071 | 0.6634 | 224 | 0.4851 | 0.4750 | 0.4800 | 859 | 0.5994 | 0.4804 | 0.5333 | 433 | 0.5675 | 0.5091 | 0.5367 | 603 | 0.6905 | 0.4496 | 0.5446 | 129 | 0.5516 | 0.6379 | 0.5916 | 243 | 0.4570 | 0.3651 | 0.4059 | 189 | 0.7508 | 0.7459 | 0.7484 | 307 | 0.7833 | 0.8260 | 0.8040 | 385 | 0.7071 | 0.5103 | 0.5928 | 194 | 0.6920 | 0.7990 | 0.7416 | 194 | 0.4590 | 0.4341 | 0.4462 | 129 | 0.4717 | 0.7282 | 0.5725 | 206 | 0.7275 | 0.7821 | 0.7538 | 693 | 0.6618 | 0.6430 | 0.6523 | 563 | 0.6711 | 0.6946 | 0.6827 | 0.9317 |
| 0.1965 | 3.0 | 64059 | 0.2148 | 0.7073 | 0.8406 | 0.7682 | 138 | 0.6762 | 0.7269 | 0.7006 | 227 | 0.5802 | 0.5802 | 0.5802 | 131 | 0.7565 | 0.7938 | 0.7747 | 1722 | 0.7195 | 0.7636 | 0.7409 | 719 | 0.6806 | 0.8176 | 0.7429 | 159 | 0.6867 | 0.5124 | 0.5869 | 201 | 0.5797 | 0.625 | 0.6015 | 128 | 0.6262 | 0.6768 | 0.6505 | 198 | 0.7296 | 0.8112 | 0.7682 | 143 | 0.6439 | 0.7203 | 0.6800 | 497 | 0.6786 | 0.5327 | 0.5969 | 214 | 0.8594 | 0.8792 | 0.8692 | 1689 | 0.6545 | 0.7606 | 0.7036 | 142 | 0.7183 | 0.765 | 0.7409 | 200 | 0.7132 | 0.7688 | 0.7400 | 372 | 0.7513 | 0.7052 | 0.7275 | 407 | 0.6335 | 0.6117 | 0.6224 | 667 | 0.7514 | 0.6205 | 0.6797 | 224 | 0.4558 | 0.5821 | 0.5112 | 859 | 0.6076 | 0.5543 | 0.5797 | 433 | 0.6228 | 0.4793 | 0.5417 | 603 | 0.7159 | 0.4884 | 0.5806 | 129 | 0.56 | 0.6914 | 0.6188 | 243 | 0.4545 | 0.4497 | 0.4521 | 189 | 0.7159 | 0.8046 | 0.7577 | 307 | 0.7845 | 0.8701 | 0.8251 | 385 | 0.6667 | 0.5361 | 0.5943 | 194 | 0.7406 | 0.8093 | 0.7734 | 194 | 0.6316 | 0.5581 | 0.5926 | 129 | 0.5514 | 0.6505 | 0.5969 | 206 | 0.7538 | 0.7951 | 0.7739 | 693 | 0.6913 | 0.6803 | 0.6858 | 563 | 0.6928 | 0.7142 | 0.7033 | 0.9355 |
| 0.1665 | 4.0 | 85412 | 0.2193 | 0.7917 | 0.8261 | 0.8085 | 138 | 0.7069 | 0.7225 | 0.7146 | 227 | 0.5867 | 0.6718 | 0.6263 | 131 | 0.7710 | 0.7938 | 0.7823 | 1722 | 0.6962 | 0.7650 | 0.7290 | 719 | 0.7904 | 0.8302 | 0.8098 | 159 | 0.6221 | 0.5323 | 0.5737 | 201 | 0.5743 | 0.6641 | 0.6159 | 128 | 0.5966 | 0.7172 | 0.6514 | 198 | 0.7914 | 0.7692 | 0.7801 | 143 | 0.6395 | 0.7103 | 0.6730 | 497 | 0.6422 | 0.6121 | 0.6268 | 214 | 0.8338 | 0.9059 | 0.8683 | 1689 | 0.6711 | 0.7183 | 0.6939 | 142 | 0.7635 | 0.775 | 0.7692 | 200 | 0.7669 | 0.7608 | 0.7638 | 372 | 0.6872 | 0.7936 | 0.7366 | 407 | 0.7100 | 0.5982 | 0.6493 | 667 | 0.7181 | 0.7277 | 0.7228 | 224 | 0.4765 | 0.5553 | 0.5129 | 859 | 0.6225 | 0.5866 | 0.6040 | 433 | 0.6078 | 0.5191 | 0.5599 | 603 | 0.7222 | 0.5039 | 0.5936 | 129 | 0.6065 | 0.7737 | 0.6799 | 243 | 0.4783 | 0.5238 | 0.5 | 189 | 0.7313 | 0.7980 | 0.7632 | 307 | 0.8401 | 0.8597 | 0.8498 | 385 | 0.6058 | 0.6495 | 0.6269 | 194 | 0.7512 | 0.7938 | 0.7719 | 194 | 0.6983 | 0.6279 | 0.6612 | 129 | 0.5804 | 0.7184 | 0.6421 | 206 | 0.7571 | 0.8052 | 0.7804 | 693 | 0.6916 | 0.6892 | 0.6904 | 563 | 0.7012 | 0.7309 | 0.7158 | 0.9375 |
| 0.1314 | 5.0 | 106765 | 0.2272 | 0.7707 | 0.8768 | 0.8203 | 138 | 0.7137 | 0.7577 | 0.7350 | 227 | 0.6058 | 0.6336 | 0.6194 | 131 | 0.7229 | 0.8513 | 0.7819 | 1722 | 0.7361 | 0.7761 | 0.7556 | 719 | 0.6839 | 0.8302 | 0.7500 | 159 | 0.5845 | 0.6020 | 0.5931 | 201 | 0.6148 | 0.6484 | 0.6312 | 128 | 0.6121 | 0.7172 | 0.6605 | 198 | 0.6970 | 0.8042 | 0.7468 | 143 | 0.6438 | 0.6982 | 0.6699 | 497 | 0.6197 | 0.6776 | 0.6473 | 214 | 0.8390 | 0.8887 | 0.8631 | 1689 | 0.7333 | 0.6972 | 0.7148 | 142 | 0.7443 | 0.815 | 0.7780 | 200 | 0.7217 | 0.7876 | 0.7532 | 372 | 0.7113 | 0.7568 | 0.7333 | 407 | 0.6682 | 0.6522 | 0.6601 | 667 | 0.7136 | 0.7009 | 0.7072 | 224 | 0.5351 | 0.4796 | 0.5058 | 859 | 0.5930 | 0.6259 | 0.6090 | 433 | 0.6112 | 0.5240 | 0.5643 | 603 | 0.7767 | 0.6202 | 0.6897 | 129 | 0.6254 | 0.7284 | 0.6730 | 243 | 0.4815 | 0.4815 | 0.4815 | 189 | 0.7654 | 0.8078 | 0.7861 | 307 | 0.7611 | 0.8935 | 0.8220 | 385 | 0.6667 | 0.6082 | 0.6361 | 194 | 0.7828 | 0.7990 | 0.7908 | 194 | 0.6692 | 0.6899 | 0.6794 | 129 | 0.5983 | 0.6942 | 0.6427 | 206 | 0.7584 | 0.8153 | 0.7858 | 693 | 0.6740 | 0.7052 | 0.6892 | 563 | 0.7006 | 0.7401 | 0.7198 | 0.9378 |
| 0.1224 | 6.0 | 128118 | 0.2275 | 0.8286 | 0.8406 | 0.8345 | 138 | 0.6898 | 0.7445 | 0.7161 | 227 | 0.6013 | 0.7252 | 0.6574 | 131 | 0.7574 | 0.8415 | 0.7972 | 1722 | 0.7400 | 0.7483 | 0.7441 | 719 | 0.8084 | 0.8491 | 0.8282 | 159 | 0.7055 | 0.5721 | 0.6319 | 201 | 0.6061 | 0.625 | 0.6154 | 128 | 0.7090 | 0.6768 | 0.6925 | 198 | 0.7868 | 0.7483 | 0.7670 | 143 | 0.6454 | 0.7545 | 0.6957 | 497 | 0.6287 | 0.6963 | 0.6608 | 214 | 0.8548 | 0.8851 | 0.8697 | 1689 | 0.7669 | 0.7183 | 0.7418 | 142 | 0.75 | 0.825 | 0.7857 | 200 | 0.7130 | 0.8280 | 0.7662 | 372 | 0.6848 | 0.8059 | 0.7404 | 407 | 0.7112 | 0.6462 | 0.6771 | 667 | 0.7879 | 0.6964 | 0.7393 | 224 | 0.5378 | 0.5378 | 0.5378 | 859 | 0.6554 | 0.5797 | 0.6152 | 433 | 0.5946 | 0.5887 | 0.5917 | 603 | 0.8131 | 0.6744 | 0.7373 | 129 | 0.6483 | 0.7737 | 0.7054 | 243 | 0.5537 | 0.5185 | 0.5355 | 189 | 0.7704 | 0.7980 | 0.784 | 307 | 0.8415 | 0.8961 | 0.8679 | 385 | 0.6566 | 0.6701 | 0.6633 | 194 | 0.7879 | 0.8041 | 0.7959 | 194 | 0.6159 | 0.7829 | 0.6894 | 129 | 0.5887 | 0.7087 | 0.6432 | 206 | 0.7864 | 0.8023 | 0.7943 | 693 | 0.7388 | 0.6732 | 0.7045 | 563 | 0.7221 | 0.7475 | 0.7346 | 0.9406 |
| 0.0964 | 7.0 | 149471 | 0.2456 | 0.7947 | 0.8696 | 0.8304 | 138 | 0.7107 | 0.7577 | 0.7335 | 227 | 0.6522 | 0.6870 | 0.6691 | 131 | 0.7780 | 0.8182 | 0.7976 | 1722 | 0.7546 | 0.7483 | 0.7514 | 719 | 0.7870 | 0.8365 | 0.8110 | 159 | 0.6020 | 0.6020 | 0.6020 | 201 | 0.58 | 0.6797 | 0.6259 | 128 | 0.6129 | 0.7677 | 0.6816 | 198 | 0.7468 | 0.8252 | 0.7841 | 143 | 0.6642 | 0.7284 | 0.6948 | 497 | 0.6840 | 0.6776 | 0.6808 | 214 | 0.8586 | 0.8810 | 0.8697 | 1689 | 0.7836 | 0.7394 | 0.7609 | 142 | 0.7082 | 0.825 | 0.7621 | 200 | 0.7731 | 0.7876 | 0.7803 | 372 | 0.7606 | 0.7494 | 0.7550 | 407 | 0.6726 | 0.6837 | 0.6781 | 667 | 0.7581 | 0.7277 | 0.7426 | 224 | 0.5176 | 0.5634 | 0.5396 | 859 | 0.6599 | 0.6005 | 0.6288 | 433 | 0.5938 | 0.5672 | 0.5802 | 603 | 0.8776 | 0.6667 | 0.7577 | 129 | 0.7198 | 0.7613 | 0.74 | 243 | 0.5078 | 0.5185 | 0.5131 | 189 | 0.7933 | 0.7752 | 0.7842 | 307 | 0.8033 | 0.8909 | 0.8448 | 385 | 0.6071 | 0.7010 | 0.6507 | 194 | 0.7429 | 0.8041 | 0.7723 | 194 | 0.7321 | 0.6357 | 0.6805 | 129 | 0.5775 | 0.7233 | 0.6422 | 206 | 0.7858 | 0.7994 | 0.7926 | 693 | 0.6678 | 0.7282 | 0.6967 | 563 | 0.7199 | 0.7475 | 0.7334 | 0.9403 |
| 0.0838 | 8.0 | 170824 | 0.2562 | 0.7722 | 0.8841 | 0.8243 | 138 | 0.6929 | 0.7753 | 0.7318 | 227 | 0.6483 | 0.7176 | 0.6812 | 131 | 0.7859 | 0.8101 | 0.7978 | 1722 | 0.7419 | 0.7316 | 0.7367 | 719 | 0.7389 | 0.8365 | 0.7847 | 159 | 0.5797 | 0.5970 | 0.5882 | 201 | 0.5878 | 0.6797 | 0.6304 | 128 | 0.6574 | 0.7172 | 0.6860 | 198 | 0.7597 | 0.8182 | 0.7879 | 143 | 0.7108 | 0.7123 | 0.7116 | 497 | 0.6511 | 0.7150 | 0.6815 | 214 | 0.8791 | 0.8822 | 0.8806 | 1689 | 0.75 | 0.7606 | 0.7552 | 142 | 0.7594 | 0.805 | 0.7816 | 200 | 0.7842 | 0.8011 | 0.7926 | 372 | 0.7395 | 0.7813 | 0.7599 | 407 | 0.6965 | 0.6777 | 0.6869 | 667 | 0.7179 | 0.75 | 0.7336 | 224 | 0.5081 | 0.5809 | 0.5421 | 859 | 0.6327 | 0.6166 | 0.6246 | 433 | 0.6094 | 0.5821 | 0.5954 | 603 | 0.8776 | 0.6667 | 0.7577 | 129 | 0.7059 | 0.7407 | 0.7229 | 243 | 0.5444 | 0.5185 | 0.5312 | 189 | 0.7722 | 0.7948 | 0.7833 | 307 | 0.8067 | 0.8779 | 0.8408 | 385 | 0.6408 | 0.6804 | 0.6600 | 194 | 0.7546 | 0.8402 | 0.7951 | 194 | 0.6831 | 0.7519 | 0.7159 | 129 | 0.6255 | 0.7136 | 0.6667 | 206 | 0.7392 | 0.8427 | 0.7876 | 693 | 0.7289 | 0.7069 | 0.7178 | 563 | 0.7242 | 0.7514 | 0.7376 | 0.9414 |
| 0.0753 | 9.0 | 192177 | 0.2708 | 0.8026 | 0.8841 | 0.8414 | 138 | 0.7054 | 0.8018 | 0.7505 | 227 | 0.6277 | 0.6565 | 0.6418 | 131 | 0.7762 | 0.8380 | 0.8059 | 1722 | 0.7552 | 0.7552 | 0.7552 | 719 | 0.7701 | 0.8428 | 0.8048 | 159 | 0.6610 | 0.5821 | 0.6190 | 201 | 0.5915 | 0.6562 | 0.6222 | 128 | 0.6575 | 0.7273 | 0.6906 | 198 | 0.7887 | 0.7832 | 0.7860 | 143 | 0.7050 | 0.7163 | 0.7106 | 497 | 0.6270 | 0.7383 | 0.6781 | 214 | 0.8441 | 0.8881 | 0.8656 | 1689 | 0.7589 | 0.7535 | 0.7562 | 142 | 0.7125 | 0.855 | 0.7773 | 200 | 0.755 | 0.8118 | 0.7824 | 372 | 0.7512 | 0.8010 | 0.7753 | 407 | 0.6788 | 0.6972 | 0.6879 | 667 | 0.7830 | 0.7411 | 0.7615 | 224 | 0.5155 | 0.5821 | 0.5467 | 859 | 0.6386 | 0.6490 | 0.6438 | 433 | 0.6629 | 0.5804 | 0.6189 | 603 | 0.8598 | 0.7132 | 0.7797 | 129 | 0.6667 | 0.7490 | 0.7054 | 243 | 0.4787 | 0.5344 | 0.505 | 189 | 0.7610 | 0.7883 | 0.7744 | 307 | 0.8285 | 0.8909 | 0.8586 | 385 | 0.7027 | 0.6701 | 0.6860 | 194 | 0.7778 | 0.8299 | 0.8030 | 194 | 0.6923 | 0.7674 | 0.7279 | 129 | 0.6396 | 0.6893 | 0.6636 | 206 | 0.7879 | 0.8095 | 0.7986 | 693 | 0.7110 | 0.7123 | 0.7116 | 563 | 0.7258 | 0.7593 | 0.7422 | 0.9424 |
| 0.0574 | 10.0 | 213530 | 0.2862 | 0.8 | 0.8986 | 0.8464 | 138 | 0.7375 | 0.7797 | 0.7580 | 227 | 0.6471 | 0.6718 | 0.6592 | 131 | 0.7831 | 0.8008 | 0.7918 | 1722 | 0.6997 | 0.7747 | 0.7353 | 719 | 0.7714 | 0.8491 | 0.8084 | 159 | 0.6091 | 0.5970 | 0.6030 | 201 | 0.6357 | 0.6406 | 0.6381 | 128 | 0.7 | 0.7071 | 0.7035 | 198 | 0.7436 | 0.8112 | 0.7759 | 143 | 0.6729 | 0.7243 | 0.6977 | 497 | 0.6830 | 0.7150 | 0.6986 | 214 | 0.8627 | 0.8857 | 0.8741 | 1689 | 0.7483 | 0.7535 | 0.7509 | 142 | 0.7611 | 0.86 | 0.8075 | 200 | 0.7846 | 0.8226 | 0.8031 | 372 | 0.7640 | 0.7715 | 0.7677 | 407 | 0.6921 | 0.6942 | 0.6931 | 667 | 0.7478 | 0.7545 | 0.7511 | 224 | 0.5079 | 0.5960 | 0.5485 | 859 | 0.6457 | 0.6397 | 0.6427 | 433 | 0.6223 | 0.5821 | 0.6015 | 603 | 0.8704 | 0.7287 | 0.7932 | 129 | 0.7041 | 0.7737 | 0.7373 | 243 | 0.5073 | 0.5503 | 0.5279 | 189 | 0.7680 | 0.7980 | 0.7827 | 307 | 0.8658 | 0.8883 | 0.8769 | 385 | 0.7111 | 0.6598 | 0.6845 | 194 | 0.7681 | 0.8196 | 0.7930 | 194 | 0.7197 | 0.7364 | 0.7280 | 129 | 0.6192 | 0.7184 | 0.6652 | 206 | 0.7922 | 0.8196 | 0.8057 | 693 | 0.7206 | 0.7194 | 0.72 | 563 | 0.7282 | 0.7572 | 0.7424 | 0.9424 |
| 0.0568 | 11.0 | 234883 | 0.2951 | 0.8026 | 0.8841 | 0.8414 | 138 | 0.7458 | 0.7753 | 0.7603 | 227 | 0.6241 | 0.6718 | 0.6471 | 131 | 0.7737 | 0.8240 | 0.7981 | 1722 | 0.7646 | 0.7455 | 0.7549 | 719 | 0.8121 | 0.8428 | 0.8272 | 159 | 0.6685 | 0.5920 | 0.6280 | 201 | 0.6870 | 0.6172 | 0.6502 | 128 | 0.7150 | 0.6970 | 0.7059 | 198 | 0.7872 | 0.7762 | 0.7817 | 143 | 0.6631 | 0.7485 | 0.7032 | 497 | 0.6842 | 0.6682 | 0.6761 | 214 | 0.8594 | 0.8828 | 0.8709 | 1689 | 0.7863 | 0.7254 | 0.7546 | 142 | 0.7824 | 0.845 | 0.8125 | 200 | 0.7628 | 0.8038 | 0.7827 | 372 | 0.7664 | 0.7740 | 0.7702 | 407 | 0.7232 | 0.6777 | 0.6997 | 667 | 0.7820 | 0.7366 | 0.7586 | 224 | 0.5362 | 0.5949 | 0.5640 | 859 | 0.6306 | 0.6467 | 0.6385 | 433 | 0.6472 | 0.5871 | 0.6157 | 603 | 0.8857 | 0.7209 | 0.7949 | 129 | 0.7138 | 0.7901 | 0.7500 | 243 | 0.5075 | 0.5397 | 0.5231 | 189 | 0.7834 | 0.8013 | 0.7923 | 307 | 0.8561 | 0.8961 | 0.8756 | 385 | 0.6809 | 0.6598 | 0.6702 | 194 | 0.7656 | 0.8247 | 0.7940 | 194 | 0.6736 | 0.7519 | 0.7106 | 129 | 0.6262 | 0.6505 | 0.6381 | 206 | 0.7892 | 0.8211 | 0.8048 | 693 | 0.7561 | 0.7105 | 0.7326 | 563 | 0.7390 | 0.7548 | 0.7468 | 0.9431 |
| 0.0465 | 12.0 | 256236 | 0.3103 | 0.8194 | 0.9203 | 0.8669 | 138 | 0.7031 | 0.7930 | 0.7453 | 227 | 0.5867 | 0.6718 | 0.6263 | 131 | 0.7829 | 0.8211 | 0.8016 | 1722 | 0.7582 | 0.7413 | 0.7496 | 719 | 0.8059 | 0.8616 | 0.8328 | 159 | 0.6648 | 0.5920 | 0.6263 | 201 | 0.6385 | 0.6484 | 0.6434 | 128 | 0.6827 | 0.7172 | 0.6995 | 198 | 0.7778 | 0.8322 | 0.8041 | 143 | 0.6679 | 0.7324 | 0.6987 | 497 | 0.6864 | 0.7056 | 0.6959 | 214 | 0.8473 | 0.8905 | 0.8684 | 1689 | 0.7552 | 0.7606 | 0.7579 | 142 | 0.7362 | 0.865 | 0.7954 | 200 | 0.7487 | 0.8011 | 0.7740 | 372 | 0.7470 | 0.7764 | 0.7614 | 407 | 0.7042 | 0.7031 | 0.7037 | 667 | 0.7435 | 0.7634 | 0.7533 | 224 | 0.5438 | 0.5856 | 0.5639 | 859 | 0.6261 | 0.6536 | 0.6395 | 433 | 0.6442 | 0.6186 | 0.6311 | 603 | 0.8482 | 0.7364 | 0.7884 | 129 | 0.7283 | 0.7613 | 0.7445 | 243 | 0.5075 | 0.5397 | 0.5231 | 189 | 0.7915 | 0.7915 | 0.7915 | 307 | 0.8564 | 0.8987 | 0.8771 | 385 | 0.6211 | 0.7268 | 0.6698 | 194 | 0.7633 | 0.8144 | 0.7880 | 194 | 0.7313 | 0.7597 | 0.7452 | 129 | 0.6450 | 0.7233 | 0.6819 | 206 | 0.7758 | 0.8139 | 0.7944 | 693 | 0.7189 | 0.7176 | 0.7182 | 563 | 0.7312 | 0.7621 | 0.7464 | 0.9428 |
| 0.0459 | 13.0 | 277589 | 0.3141 | 0.8267 | 0.8986 | 0.8611 | 138 | 0.7254 | 0.7797 | 0.7516 | 227 | 0.6099 | 0.6565 | 0.6324 | 131 | 0.7929 | 0.8182 | 0.8054 | 1722 | 0.7562 | 0.7677 | 0.7619 | 719 | 0.8084 | 0.8491 | 0.8282 | 159 | 0.6302 | 0.6020 | 0.6158 | 201 | 0.6412 | 0.6562 | 0.6486 | 128 | 0.6931 | 0.7071 | 0.7000 | 198 | 0.7770 | 0.8042 | 0.7904 | 143 | 0.6834 | 0.7384 | 0.7099 | 497 | 0.6967 | 0.6869 | 0.6918 | 214 | 0.8631 | 0.8845 | 0.8737 | 1689 | 0.7939 | 0.7324 | 0.7619 | 142 | 0.7830 | 0.83 | 0.8058 | 200 | 0.7822 | 0.8011 | 0.7915 | 372 | 0.7482 | 0.7740 | 0.7609 | 407 | 0.6982 | 0.6972 | 0.6977 | 667 | 0.7867 | 0.7411 | 0.7632 | 224 | 0.5323 | 0.5856 | 0.5576 | 859 | 0.6469 | 0.6559 | 0.6514 | 433 | 0.6512 | 0.6036 | 0.6265 | 603 | 0.8611 | 0.7209 | 0.7848 | 129 | 0.7287 | 0.7737 | 0.7505 | 243 | 0.5185 | 0.5185 | 0.5185 | 189 | 0.7910 | 0.8013 | 0.7961 | 307 | 0.8715 | 0.8987 | 0.8849 | 385 | 0.7283 | 0.6907 | 0.7090 | 194 | 0.7512 | 0.7938 | 0.7719 | 194 | 0.7313 | 0.7597 | 0.7452 | 129 | 0.6147 | 0.6893 | 0.6499 | 206 | 0.7947 | 0.8268 | 0.8105 | 693 | 0.7170 | 0.7247 | 0.7208 | 563 | 0.7406 | 0.7588 | 0.7496 | 0.9436 |
| 0.0386 | 14.0 | 298942 | 0.3268 | 0.8333 | 0.9058 | 0.8681 | 138 | 0.7092 | 0.7841 | 0.7448 | 227 | 0.6028 | 0.6489 | 0.625 | 131 | 0.7848 | 0.8153 | 0.7998 | 1722 | 0.7701 | 0.7594 | 0.7647 | 719 | 0.8047 | 0.8553 | 0.8293 | 159 | 0.6373 | 0.6119 | 0.6244 | 201 | 0.6204 | 0.6641 | 0.6415 | 128 | 0.6794 | 0.7172 | 0.6978 | 198 | 0.7986 | 0.8042 | 0.8014 | 143 | 0.6691 | 0.7324 | 0.6993 | 497 | 0.7109 | 0.7009 | 0.7059 | 214 | 0.8624 | 0.8834 | 0.8728 | 1689 | 0.7754 | 0.7535 | 0.7643 | 142 | 0.7757 | 0.83 | 0.8019 | 200 | 0.7712 | 0.8065 | 0.7884 | 372 | 0.7621 | 0.7715 | 0.7668 | 407 | 0.6782 | 0.7076 | 0.6926 | 667 | 0.7661 | 0.7455 | 0.7557 | 224 | 0.5417 | 0.5669 | 0.5540 | 859 | 0.6388 | 0.6536 | 0.6461 | 433 | 0.6160 | 0.6119 | 0.6140 | 603 | 0.8889 | 0.7442 | 0.8101 | 129 | 0.7431 | 0.7737 | 0.7581 | 243 | 0.5025 | 0.5397 | 0.5204 | 189 | 0.7915 | 0.7915 | 0.7915 | 307 | 0.8618 | 0.8909 | 0.8761 | 385 | 0.6699 | 0.7113 | 0.6900 | 194 | 0.7621 | 0.8093 | 0.7850 | 194 | 0.7226 | 0.7674 | 0.7444 | 129 | 0.6384 | 0.6942 | 0.6651 | 206 | 0.7872 | 0.8167 | 0.8017 | 693 | 0.7140 | 0.7229 | 0.7184 | 563 | 0.7358 | 0.7585 | 0.7470 | 0.9435 |
| 0.037 | 15.0 | 320295 | 0.3308 | 0.8117 | 0.9058 | 0.8562 | 138 | 0.716 | 0.7885 | 0.7505 | 227 | 0.6028 | 0.6489 | 0.625 | 131 | 0.7838 | 0.8252 | 0.8040 | 1722 | 0.7835 | 0.7552 | 0.7691 | 719 | 0.7953 | 0.8553 | 0.8242 | 159 | 0.6630 | 0.5970 | 0.6283 | 201 | 0.6296 | 0.6641 | 0.6464 | 128 | 0.6961 | 0.7172 | 0.7065 | 198 | 0.8 | 0.8112 | 0.8056 | 143 | 0.6849 | 0.7304 | 0.7069 | 497 | 0.7156 | 0.7056 | 0.7106 | 214 | 0.8631 | 0.8845 | 0.8737 | 1689 | 0.7852 | 0.7465 | 0.7653 | 142 | 0.7602 | 0.84 | 0.7981 | 200 | 0.7601 | 0.8091 | 0.7839 | 372 | 0.7506 | 0.7617 | 0.7561 | 407 | 0.6943 | 0.7151 | 0.7046 | 667 | 0.7767 | 0.7455 | 0.7608 | 224 | 0.5351 | 0.5588 | 0.5467 | 859 | 0.6453 | 0.6513 | 0.6483 | 433 | 0.6277 | 0.6153 | 0.6214 | 603 | 0.8981 | 0.7519 | 0.8186 | 129 | 0.7362 | 0.7695 | 0.7525 | 243 | 0.5178 | 0.5397 | 0.5285 | 189 | 0.7806 | 0.7883 | 0.7844 | 307 | 0.8804 | 0.8987 | 0.8895 | 385 | 0.6863 | 0.7216 | 0.7035 | 194 | 0.7696 | 0.8093 | 0.7889 | 194 | 0.7333 | 0.7674 | 0.7500 | 129 | 0.6471 | 0.6942 | 0.6698 | 206 | 0.7917 | 0.8225 | 0.8068 | 693 | 0.7255 | 0.7229 | 0.7242 | 563 | 0.7404 | 0.7600 | 0.7501 | 0.9437 |
### Framework versions
- Transformers 4.26.0.dev0
- Pytorch 1.12.1+cu113
- Datasets 2.7.1
- Tokenizers 0.13.2
|