mdeberta_all_15 / README.md

Librarian Bot: Add base_model information to model

77d6170 11 months ago

50.7 kB

	---
	license: mit
	tags:
	- generated_from_trainer
	base_model: microsoft/mdeberta-v3-base
	model-index:
	- name: mdeberta_all
	results: []
	---

	<!-- This model card has been generated automatically according to the information the Trainer had access to. You
	should probably proofread and complete it, then remove this comment. -->

	# mdeberta_all

	This model is a fine-tuned version of [microsoft/mdeberta-v3-base](https://huggingface.co/microsoft/mdeberta-v3-base) on an unknown dataset.
	It achieves the following results on the evaluation set:
	- Loss: 0.2148
	- Aerospacemanufacturer Precision: 0.7073
	- Aerospacemanufacturer Recall: 0.8406
	- Aerospacemanufacturer F1: 0.7682
	- Aerospacemanufacturer Number: 138
	- Anatomicalstructure Precision: 0.6762
	- Anatomicalstructure Recall: 0.7269
	- Anatomicalstructure F1: 0.7006
	- Anatomicalstructure Number: 227
	- Artwork Precision: 0.5802
	- Artwork Recall: 0.5802
	- Artwork F1: 0.5802
	- Artwork Number: 131
	- Artist Precision: 0.7565
	- Artist Recall: 0.7938
	- Artist F1: 0.7747
	- Artist Number: 1722
	- Athlete Precision: 0.7195
	- Athlete Recall: 0.7636
	- Athlete F1: 0.7409
	- Athlete Number: 719
	- Carmanufacturer Precision: 0.6806
	- Carmanufacturer Recall: 0.8176
	- Carmanufacturer F1: 0.7429
	- Carmanufacturer Number: 159
	- Cleric Precision: 0.6867
	- Cleric Recall: 0.5124
	- Cleric F1: 0.5869
	- Cleric Number: 201
	- Clothing Precision: 0.5797
	- Clothing Recall: 0.625
	- Clothing F1: 0.6015
	- Clothing Number: 128
	- Disease Precision: 0.6262
	- Disease Recall: 0.6768
	- Disease F1: 0.6505
	- Disease Number: 198
	- Drink Precision: 0.7296
	- Drink Recall: 0.8112
	- Drink F1: 0.7682
	- Drink Number: 143
	- Facility Precision: 0.6439
	- Facility Recall: 0.7203
	- Facility F1: 0.6800
	- Facility Number: 497
	- Food Precision: 0.6786
	- Food Recall: 0.5327
	- Food F1: 0.5969
	- Food Number: 214
	- Humansettlement Precision: 0.8594
	- Humansettlement Recall: 0.8792
	- Humansettlement F1: 0.8692
	- Humansettlement Number: 1689
	- Medicalprocedure Precision: 0.6545
	- Medicalprocedure Recall: 0.7606
	- Medicalprocedure F1: 0.7036
	- Medicalprocedure Number: 142
	- Medication/vaccine Precision: 0.7183
	- Medication/vaccine Recall: 0.765
	- Medication/vaccine F1: 0.7409
	- Medication/vaccine Number: 200
	- Musicalgrp Precision: 0.7132
	- Musicalgrp Recall: 0.7688
	- Musicalgrp F1: 0.7400
	- Musicalgrp Number: 372
	- Musicalwork Precision: 0.7513
	- Musicalwork Recall: 0.7052
	- Musicalwork F1: 0.7275
	- Musicalwork Number: 407
	- Org Precision: 0.6335
	- Org Recall: 0.6117
	- Org F1: 0.6224
	- Org Number: 667
	- Otherloc Precision: 0.7514
	- Otherloc Recall: 0.6205
	- Otherloc F1: 0.6797
	- Otherloc Number: 224
	- Otherper Precision: 0.4558
	- Otherper Recall: 0.5821
	- Otherper F1: 0.5112
	- Otherper Number: 859
	- Otherprod Precision: 0.6076
	- Otherprod Recall: 0.5543
	- Otherprod F1: 0.5797
	- Otherprod Number: 433
	- Politician Precision: 0.6228
	- Politician Recall: 0.4793
	- Politician F1: 0.5417
	- Politician Number: 603
	- Privatecorp Precision: 0.7159
	- Privatecorp Recall: 0.4884
	- Privatecorp F1: 0.5806
	- Privatecorp Number: 129
	- Publiccorp Precision: 0.56
	- Publiccorp Recall: 0.6914
	- Publiccorp F1: 0.6188
	- Publiccorp Number: 243
	- Scientist Precision: 0.4545
	- Scientist Recall: 0.4497
	- Scientist F1: 0.4521
	- Scientist Number: 189
	- Software Precision: 0.7159
	- Software Recall: 0.8046
	- Software F1: 0.7577
	- Software Number: 307
	- Sportsgrp Precision: 0.7845
	- Sportsgrp Recall: 0.8701
	- Sportsgrp F1: 0.8251
	- Sportsgrp Number: 385
	- Sportsmanager Precision: 0.6667
	- Sportsmanager Recall: 0.5361
	- Sportsmanager F1: 0.5943
	- Sportsmanager Number: 194
	- Station Precision: 0.7406
	- Station Recall: 0.8093
	- Station F1: 0.7734
	- Station Number: 194
	- Symptom Precision: 0.6316
	- Symptom Recall: 0.5581
	- Symptom F1: 0.5926
	- Symptom Number: 129
	- Vehicle Precision: 0.5514
	- Vehicle Recall: 0.6505
	- Vehicle F1: 0.5969
	- Vehicle Number: 206
	- Visualwork Precision: 0.7538
	- Visualwork Recall: 0.7951
	- Visualwork F1: 0.7739
	- Visualwork Number: 693
	- Writtenwork Precision: 0.6913
	- Writtenwork Recall: 0.6803
	- Writtenwork F1: 0.6858
	- Writtenwork Number: 563
	- Overall Precision: 0.6928
	- Overall Recall: 0.7142
	- Overall F1: 0.7033
	- Overall Accuracy: 0.9355

	## Model description

	More information needed

	## Intended uses & limitations

	More information needed

	## Training and evaluation data

	More information needed

	## Training procedure

	### Training hyperparameters

	The following hyperparameters were used during training:
	- learning_rate: 1e-05
	- train_batch_size: 8
	- eval_batch_size: 8
	- seed: 42
	- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
	- lr_scheduler_type: linear
	- num_epochs: 15.0

	### Training results

	\| Training Loss \| Epoch \| Step \| Validation Loss \| Aerospacemanufacturer Precision \| Aerospacemanufacturer Recall \| Aerospacemanufacturer F1 \| Aerospacemanufacturer Number \| Anatomicalstructure Precision \| Anatomicalstructure Recall \| Anatomicalstructure F1 \| Anatomicalstructure Number \| Artwork Precision \| Artwork Recall \| Artwork F1 \| Artwork Number \| Artist Precision \| Artist Recall \| Artist F1 \| Artist Number \| Athlete Precision \| Athlete Recall \| Athlete F1 \| Athlete Number \| Carmanufacturer Precision \| Carmanufacturer Recall \| Carmanufacturer F1 \| Carmanufacturer Number \| Cleric Precision \| Cleric Recall \| Cleric F1 \| Cleric Number \| Clothing Precision \| Clothing Recall \| Clothing F1 \| Clothing Number \| Disease Precision \| Disease Recall \| Disease F1 \| Disease Number \| Drink Precision \| Drink Recall \| Drink F1 \| Drink Number \| Facility Precision \| Facility Recall \| Facility F1 \| Facility Number \| Food Precision \| Food Recall \| Food F1 \| Food Number \| Humansettlement Precision \| Humansettlement Recall \| Humansettlement F1 \| Humansettlement Number \| Medicalprocedure Precision \| Medicalprocedure Recall \| Medicalprocedure F1 \| Medicalprocedure Number \| Medication/vaccine Precision \| Medication/vaccine Recall \| Medication/vaccine F1 \| Medication/vaccine Number \| Musicalgrp Precision \| Musicalgrp Recall \| Musicalgrp F1 \| Musicalgrp Number \| Musicalwork Precision \| Musicalwork Recall \| Musicalwork F1 \| Musicalwork Number \| Org Precision \| Org Recall \| Org F1 \| Org Number \| Otherloc Precision \| Otherloc Recall \| Otherloc F1 \| Otherloc Number \| Otherper Precision \| Otherper Recall \| Otherper F1 \| Otherper Number \| Otherprod Precision \| Otherprod Recall \| Otherprod F1 \| Otherprod Number \| Politician Precision \| Politician Recall \| Politician F1 \| Politician Number \| Privatecorp Precision \| Privatecorp Recall \| Privatecorp F1 \| Privatecorp Number \| Publiccorp Precision \| Publiccorp Recall \| Publiccorp F1 \| Publiccorp Number \| Scientist Precision \| Scientist Recall \| Scientist F1 \| Scientist Number \| Software Precision \| Software Recall \| Software F1 \| Software Number \| Sportsgrp Precision \| Sportsgrp Recall \| Sportsgrp F1 \| Sportsgrp Number \| Sportsmanager Precision \| Sportsmanager Recall \| Sportsmanager F1 \| Sportsmanager Number \| Station Precision \| Station Recall \| Station F1 \| Station Number \| Symptom Precision \| Symptom Recall \| Symptom F1 \| Symptom Number \| Vehicle Precision \| Vehicle Recall \| Vehicle F1 \| Vehicle Number \| Visualwork Precision \| Visualwork Recall \| Visualwork F1 \| Visualwork Number \| Writtenwork Precision \| Writtenwork Recall \| Writtenwork F1 \| Writtenwork Number \| Overall Precision \| Overall Recall \| Overall F1 \| Overall Accuracy \|
	\|:-------------:\|:-----:\|:------:\|:---------------:\|:-------------------------------:\|:----------------------------:\|:------------------------:\|:----------------------------:\|:-----------------------------:\|:--------------------------:\|:----------------------:\|:--------------------------:\|:-----------------:\|:--------------:\|:----------:\|:--------------:\|:----------------:\|:-------------:\|:---------:\|:-------------:\|:-----------------:\|:--------------:\|:----------:\|:--------------:\|:-------------------------:\|:----------------------:\|:------------------:\|:----------------------:\|:----------------:\|:-------------:\|:---------:\|:-------------:\|:------------------:\|:---------------:\|:-----------:\|:---------------:\|:-----------------:\|:--------------:\|:----------:\|:--------------:\|:---------------:\|:------------:\|:--------:\|:------------:\|:------------------:\|:---------------:\|:-----------:\|:---------------:\|:--------------:\|:-----------:\|:-------:\|:-----------:\|:-------------------------:\|:----------------------:\|:------------------:\|:----------------------:\|:--------------------------:\|:-----------------------:\|:-------------------:\|:-----------------------:\|:----------------------------:\|:-------------------------:\|:---------------------:\|:-------------------------:\|:--------------------:\|:-----------------:\|:-------------:\|:-----------------:\|:---------------------:\|:------------------:\|:--------------:\|:------------------:\|:-------------:\|:----------:\|:------:\|:----------:\|:------------------:\|:---------------:\|:-----------:\|:---------------:\|:------------------:\|:---------------:\|:-----------:\|:---------------:\|:-------------------:\|:----------------:\|:------------:\|:----------------:\|:--------------------:\|:-----------------:\|:-------------:\|:-----------------:\|:---------------------:\|:------------------:\|:--------------:\|:------------------:\|:--------------------:\|:-----------------:\|:-------------:\|:-----------------:\|:-------------------:\|:----------------:\|:------------:\|:----------------:\|:------------------:\|:---------------:\|:-----------:\|:---------------:\|:-------------------:\|:----------------:\|:------------:\|:----------------:\|:-----------------------:\|:--------------------:\|:----------------:\|:--------------------:\|:-----------------:\|:--------------:\|:----------:\|:--------------:\|:-----------------:\|:--------------:\|:----------:\|:--------------:\|:-----------------:\|:--------------:\|:----------:\|:--------------:\|:--------------------:\|:-----------------:\|:-------------:\|:-----------------:\|:---------------------:\|:------------------:\|:--------------:\|:------------------:\|:-----------------:\|:--------------:\|:----------:\|:----------------:\|
	\| 0.2881 \| 1.0 \| 21353 \| 0.2534 \| 0.5191 \| 0.6884 \| 0.5919 \| 138 \| 0.5693 \| 0.6872 \| 0.6228 \| 227 \| 0.4366 \| 0.4733 \| 0.4542 \| 131 \| 0.7109 \| 0.8055 \| 0.7552 \| 1722 \| 0.6782 \| 0.6801 \| 0.6792 \| 719 \| 0.6552 \| 0.7170 \| 0.6847 \| 159 \| 0.4874 \| 0.4826 \| 0.485 \| 201 \| 0.4639 \| 0.6016 \| 0.5238 \| 128 \| 0.4799 \| 0.7222 \| 0.5766 \| 198 \| 0.55 \| 0.6923 \| 0.6130 \| 143 \| 0.5305 \| 0.6640 \| 0.5898 \| 497 \| 0.4042 \| 0.7196 \| 0.5176 \| 214 \| 0.8164 \| 0.8792 \| 0.8466 \| 1689 \| 0.5799 \| 0.6901 \| 0.6302 \| 142 \| 0.5945 \| 0.755 \| 0.6652 \| 200 \| 0.7445 \| 0.6425 \| 0.6898 \| 372 \| 0.6667 \| 0.6634 \| 0.6650 \| 407 \| 0.5585 \| 0.5652 \| 0.5618 \| 667 \| 0.6724 \| 0.5223 \| 0.5879 \| 224 \| 0.3835 \| 0.4773 \| 0.4253 \| 859 \| 0.5237 \| 0.4596 \| 0.4895 \| 433 \| 0.5176 \| 0.4643 \| 0.4895 \| 603 \| 0.4688 \| 0.1163 \| 0.1863 \| 129 \| 0.4207 \| 0.6008 \| 0.4949 \| 243 \| 0.4099 \| 0.3492 \| 0.3771 \| 189 \| 0.6686 \| 0.7362 \| 0.7008 \| 307 \| 0.7688 \| 0.7948 \| 0.7816 \| 385 \| 0.5136 \| 0.5825 \| 0.5459 \| 194 \| 0.6667 \| 0.8041 \| 0.7290 \| 194 \| 0.5588 \| 0.1473 \| 0.2331 \| 129 \| 0.4910 \| 0.5291 \| 0.5093 \| 206 \| 0.6662 \| 0.7489 \| 0.7052 \| 693 \| 0.6180 \| 0.5861 \| 0.6016 \| 563 \| 0.6136 \| 0.6640 \| 0.6378 \| 0.9220 \|
	\| 0.2195 \| 2.0 \| 42706 \| 0.2288 \| 0.6409 \| 0.8406 \| 0.7273 \| 138 \| 0.6908 \| 0.6300 \| 0.6590 \| 227 \| 0.5625 \| 0.5496 \| 0.5560 \| 131 \| 0.7336 \| 0.8124 \| 0.7710 \| 1722 \| 0.6466 \| 0.8067 \| 0.7178 \| 719 \| 0.6095 \| 0.8050 \| 0.6938 \| 159 \| 0.5848 \| 0.4975 \| 0.5376 \| 201 \| 0.5260 \| 0.6328 \| 0.5745 \| 128 \| 0.5427 \| 0.6414 \| 0.5880 \| 198 \| 0.7042 \| 0.6993 \| 0.7018 \| 143 \| 0.6157 \| 0.7123 \| 0.6604 \| 497 \| 0.6140 \| 0.4907 \| 0.5455 \| 214 \| 0.8454 \| 0.8745 \| 0.8597 \| 1689 \| 0.6125 \| 0.6901 \| 0.6490 \| 142 \| 0.6898 \| 0.745 \| 0.7163 \| 200 \| 0.7299 \| 0.7339 \| 0.7319 \| 372 \| 0.6901 \| 0.7224 \| 0.7059 \| 407 \| 0.6224 \| 0.5907 \| 0.6062 \| 667 \| 0.7312 \| 0.6071 \| 0.6634 \| 224 \| 0.4851 \| 0.4750 \| 0.4800 \| 859 \| 0.5994 \| 0.4804 \| 0.5333 \| 433 \| 0.5675 \| 0.5091 \| 0.5367 \| 603 \| 0.6905 \| 0.4496 \| 0.5446 \| 129 \| 0.5516 \| 0.6379 \| 0.5916 \| 243 \| 0.4570 \| 0.3651 \| 0.4059 \| 189 \| 0.7508 \| 0.7459 \| 0.7484 \| 307 \| 0.7833 \| 0.8260 \| 0.8040 \| 385 \| 0.7071 \| 0.5103 \| 0.5928 \| 194 \| 0.6920 \| 0.7990 \| 0.7416 \| 194 \| 0.4590 \| 0.4341 \| 0.4462 \| 129 \| 0.4717 \| 0.7282 \| 0.5725 \| 206 \| 0.7275 \| 0.7821 \| 0.7538 \| 693 \| 0.6618 \| 0.6430 \| 0.6523 \| 563 \| 0.6711 \| 0.6946 \| 0.6827 \| 0.9317 \|
	\| 0.1965 \| 3.0 \| 64059 \| 0.2148 \| 0.7073 \| 0.8406 \| 0.7682 \| 138 \| 0.6762 \| 0.7269 \| 0.7006 \| 227 \| 0.5802 \| 0.5802 \| 0.5802 \| 131 \| 0.7565 \| 0.7938 \| 0.7747 \| 1722 \| 0.7195 \| 0.7636 \| 0.7409 \| 719 \| 0.6806 \| 0.8176 \| 0.7429 \| 159 \| 0.6867 \| 0.5124 \| 0.5869 \| 201 \| 0.5797 \| 0.625 \| 0.6015 \| 128 \| 0.6262 \| 0.6768 \| 0.6505 \| 198 \| 0.7296 \| 0.8112 \| 0.7682 \| 143 \| 0.6439 \| 0.7203 \| 0.6800 \| 497 \| 0.6786 \| 0.5327 \| 0.5969 \| 214 \| 0.8594 \| 0.8792 \| 0.8692 \| 1689 \| 0.6545 \| 0.7606 \| 0.7036 \| 142 \| 0.7183 \| 0.765 \| 0.7409 \| 200 \| 0.7132 \| 0.7688 \| 0.7400 \| 372 \| 0.7513 \| 0.7052 \| 0.7275 \| 407 \| 0.6335 \| 0.6117 \| 0.6224 \| 667 \| 0.7514 \| 0.6205 \| 0.6797 \| 224 \| 0.4558 \| 0.5821 \| 0.5112 \| 859 \| 0.6076 \| 0.5543 \| 0.5797 \| 433 \| 0.6228 \| 0.4793 \| 0.5417 \| 603 \| 0.7159 \| 0.4884 \| 0.5806 \| 129 \| 0.56 \| 0.6914 \| 0.6188 \| 243 \| 0.4545 \| 0.4497 \| 0.4521 \| 189 \| 0.7159 \| 0.8046 \| 0.7577 \| 307 \| 0.7845 \| 0.8701 \| 0.8251 \| 385 \| 0.6667 \| 0.5361 \| 0.5943 \| 194 \| 0.7406 \| 0.8093 \| 0.7734 \| 194 \| 0.6316 \| 0.5581 \| 0.5926 \| 129 \| 0.5514 \| 0.6505 \| 0.5969 \| 206 \| 0.7538 \| 0.7951 \| 0.7739 \| 693 \| 0.6913 \| 0.6803 \| 0.6858 \| 563 \| 0.6928 \| 0.7142 \| 0.7033 \| 0.9355 \|
	\| 0.1665 \| 4.0 \| 85412 \| 0.2193 \| 0.7917 \| 0.8261 \| 0.8085 \| 138 \| 0.7069 \| 0.7225 \| 0.7146 \| 227 \| 0.5867 \| 0.6718 \| 0.6263 \| 131 \| 0.7710 \| 0.7938 \| 0.7823 \| 1722 \| 0.6962 \| 0.7650 \| 0.7290 \| 719 \| 0.7904 \| 0.8302 \| 0.8098 \| 159 \| 0.6221 \| 0.5323 \| 0.5737 \| 201 \| 0.5743 \| 0.6641 \| 0.6159 \| 128 \| 0.5966 \| 0.7172 \| 0.6514 \| 198 \| 0.7914 \| 0.7692 \| 0.7801 \| 143 \| 0.6395 \| 0.7103 \| 0.6730 \| 497 \| 0.6422 \| 0.6121 \| 0.6268 \| 214 \| 0.8338 \| 0.9059 \| 0.8683 \| 1689 \| 0.6711 \| 0.7183 \| 0.6939 \| 142 \| 0.7635 \| 0.775 \| 0.7692 \| 200 \| 0.7669 \| 0.7608 \| 0.7638 \| 372 \| 0.6872 \| 0.7936 \| 0.7366 \| 407 \| 0.7100 \| 0.5982 \| 0.6493 \| 667 \| 0.7181 \| 0.7277 \| 0.7228 \| 224 \| 0.4765 \| 0.5553 \| 0.5129 \| 859 \| 0.6225 \| 0.5866 \| 0.6040 \| 433 \| 0.6078 \| 0.5191 \| 0.5599 \| 603 \| 0.7222 \| 0.5039 \| 0.5936 \| 129 \| 0.6065 \| 0.7737 \| 0.6799 \| 243 \| 0.4783 \| 0.5238 \| 0.5 \| 189 \| 0.7313 \| 0.7980 \| 0.7632 \| 307 \| 0.8401 \| 0.8597 \| 0.8498 \| 385 \| 0.6058 \| 0.6495 \| 0.6269 \| 194 \| 0.7512 \| 0.7938 \| 0.7719 \| 194 \| 0.6983 \| 0.6279 \| 0.6612 \| 129 \| 0.5804 \| 0.7184 \| 0.6421 \| 206 \| 0.7571 \| 0.8052 \| 0.7804 \| 693 \| 0.6916 \| 0.6892 \| 0.6904 \| 563 \| 0.7012 \| 0.7309 \| 0.7158 \| 0.9375 \|
	\| 0.1314 \| 5.0 \| 106765 \| 0.2272 \| 0.7707 \| 0.8768 \| 0.8203 \| 138 \| 0.7137 \| 0.7577 \| 0.7350 \| 227 \| 0.6058 \| 0.6336 \| 0.6194 \| 131 \| 0.7229 \| 0.8513 \| 0.7819 \| 1722 \| 0.7361 \| 0.7761 \| 0.7556 \| 719 \| 0.6839 \| 0.8302 \| 0.7500 \| 159 \| 0.5845 \| 0.6020 \| 0.5931 \| 201 \| 0.6148 \| 0.6484 \| 0.6312 \| 128 \| 0.6121 \| 0.7172 \| 0.6605 \| 198 \| 0.6970 \| 0.8042 \| 0.7468 \| 143 \| 0.6438 \| 0.6982 \| 0.6699 \| 497 \| 0.6197 \| 0.6776 \| 0.6473 \| 214 \| 0.8390 \| 0.8887 \| 0.8631 \| 1689 \| 0.7333 \| 0.6972 \| 0.7148 \| 142 \| 0.7443 \| 0.815 \| 0.7780 \| 200 \| 0.7217 \| 0.7876 \| 0.7532 \| 372 \| 0.7113 \| 0.7568 \| 0.7333 \| 407 \| 0.6682 \| 0.6522 \| 0.6601 \| 667 \| 0.7136 \| 0.7009 \| 0.7072 \| 224 \| 0.5351 \| 0.4796 \| 0.5058 \| 859 \| 0.5930 \| 0.6259 \| 0.6090 \| 433 \| 0.6112 \| 0.5240 \| 0.5643 \| 603 \| 0.7767 \| 0.6202 \| 0.6897 \| 129 \| 0.6254 \| 0.7284 \| 0.6730 \| 243 \| 0.4815 \| 0.4815 \| 0.4815 \| 189 \| 0.7654 \| 0.8078 \| 0.7861 \| 307 \| 0.7611 \| 0.8935 \| 0.8220 \| 385 \| 0.6667 \| 0.6082 \| 0.6361 \| 194 \| 0.7828 \| 0.7990 \| 0.7908 \| 194 \| 0.6692 \| 0.6899 \| 0.6794 \| 129 \| 0.5983 \| 0.6942 \| 0.6427 \| 206 \| 0.7584 \| 0.8153 \| 0.7858 \| 693 \| 0.6740 \| 0.7052 \| 0.6892 \| 563 \| 0.7006 \| 0.7401 \| 0.7198 \| 0.9378 \|
	\| 0.1224 \| 6.0 \| 128118 \| 0.2275 \| 0.8286 \| 0.8406 \| 0.8345 \| 138 \| 0.6898 \| 0.7445 \| 0.7161 \| 227 \| 0.6013 \| 0.7252 \| 0.6574 \| 131 \| 0.7574 \| 0.8415 \| 0.7972 \| 1722 \| 0.7400 \| 0.7483 \| 0.7441 \| 719 \| 0.8084 \| 0.8491 \| 0.8282 \| 159 \| 0.7055 \| 0.5721 \| 0.6319 \| 201 \| 0.6061 \| 0.625 \| 0.6154 \| 128 \| 0.7090 \| 0.6768 \| 0.6925 \| 198 \| 0.7868 \| 0.7483 \| 0.7670 \| 143 \| 0.6454 \| 0.7545 \| 0.6957 \| 497 \| 0.6287 \| 0.6963 \| 0.6608 \| 214 \| 0.8548 \| 0.8851 \| 0.8697 \| 1689 \| 0.7669 \| 0.7183 \| 0.7418 \| 142 \| 0.75 \| 0.825 \| 0.7857 \| 200 \| 0.7130 \| 0.8280 \| 0.7662 \| 372 \| 0.6848 \| 0.8059 \| 0.7404 \| 407 \| 0.7112 \| 0.6462 \| 0.6771 \| 667 \| 0.7879 \| 0.6964 \| 0.7393 \| 224 \| 0.5378 \| 0.5378 \| 0.5378 \| 859 \| 0.6554 \| 0.5797 \| 0.6152 \| 433 \| 0.5946 \| 0.5887 \| 0.5917 \| 603 \| 0.8131 \| 0.6744 \| 0.7373 \| 129 \| 0.6483 \| 0.7737 \| 0.7054 \| 243 \| 0.5537 \| 0.5185 \| 0.5355 \| 189 \| 0.7704 \| 0.7980 \| 0.784 \| 307 \| 0.8415 \| 0.8961 \| 0.8679 \| 385 \| 0.6566 \| 0.6701 \| 0.6633 \| 194 \| 0.7879 \| 0.8041 \| 0.7959 \| 194 \| 0.6159 \| 0.7829 \| 0.6894 \| 129 \| 0.5887 \| 0.7087 \| 0.6432 \| 206 \| 0.7864 \| 0.8023 \| 0.7943 \| 693 \| 0.7388 \| 0.6732 \| 0.7045 \| 563 \| 0.7221 \| 0.7475 \| 0.7346 \| 0.9406 \|
	\| 0.0964 \| 7.0 \| 149471 \| 0.2456 \| 0.7947 \| 0.8696 \| 0.8304 \| 138 \| 0.7107 \| 0.7577 \| 0.7335 \| 227 \| 0.6522 \| 0.6870 \| 0.6691 \| 131 \| 0.7780 \| 0.8182 \| 0.7976 \| 1722 \| 0.7546 \| 0.7483 \| 0.7514 \| 719 \| 0.7870 \| 0.8365 \| 0.8110 \| 159 \| 0.6020 \| 0.6020 \| 0.6020 \| 201 \| 0.58 \| 0.6797 \| 0.6259 \| 128 \| 0.6129 \| 0.7677 \| 0.6816 \| 198 \| 0.7468 \| 0.8252 \| 0.7841 \| 143 \| 0.6642 \| 0.7284 \| 0.6948 \| 497 \| 0.6840 \| 0.6776 \| 0.6808 \| 214 \| 0.8586 \| 0.8810 \| 0.8697 \| 1689 \| 0.7836 \| 0.7394 \| 0.7609 \| 142 \| 0.7082 \| 0.825 \| 0.7621 \| 200 \| 0.7731 \| 0.7876 \| 0.7803 \| 372 \| 0.7606 \| 0.7494 \| 0.7550 \| 407 \| 0.6726 \| 0.6837 \| 0.6781 \| 667 \| 0.7581 \| 0.7277 \| 0.7426 \| 224 \| 0.5176 \| 0.5634 \| 0.5396 \| 859 \| 0.6599 \| 0.6005 \| 0.6288 \| 433 \| 0.5938 \| 0.5672 \| 0.5802 \| 603 \| 0.8776 \| 0.6667 \| 0.7577 \| 129 \| 0.7198 \| 0.7613 \| 0.74 \| 243 \| 0.5078 \| 0.5185 \| 0.5131 \| 189 \| 0.7933 \| 0.7752 \| 0.7842 \| 307 \| 0.8033 \| 0.8909 \| 0.8448 \| 385 \| 0.6071 \| 0.7010 \| 0.6507 \| 194 \| 0.7429 \| 0.8041 \| 0.7723 \| 194 \| 0.7321 \| 0.6357 \| 0.6805 \| 129 \| 0.5775 \| 0.7233 \| 0.6422 \| 206 \| 0.7858 \| 0.7994 \| 0.7926 \| 693 \| 0.6678 \| 0.7282 \| 0.6967 \| 563 \| 0.7199 \| 0.7475 \| 0.7334 \| 0.9403 \|
	\| 0.0838 \| 8.0 \| 170824 \| 0.2562 \| 0.7722 \| 0.8841 \| 0.8243 \| 138 \| 0.6929 \| 0.7753 \| 0.7318 \| 227 \| 0.6483 \| 0.7176 \| 0.6812 \| 131 \| 0.7859 \| 0.8101 \| 0.7978 \| 1722 \| 0.7419 \| 0.7316 \| 0.7367 \| 719 \| 0.7389 \| 0.8365 \| 0.7847 \| 159 \| 0.5797 \| 0.5970 \| 0.5882 \| 201 \| 0.5878 \| 0.6797 \| 0.6304 \| 128 \| 0.6574 \| 0.7172 \| 0.6860 \| 198 \| 0.7597 \| 0.8182 \| 0.7879 \| 143 \| 0.7108 \| 0.7123 \| 0.7116 \| 497 \| 0.6511 \| 0.7150 \| 0.6815 \| 214 \| 0.8791 \| 0.8822 \| 0.8806 \| 1689 \| 0.75 \| 0.7606 \| 0.7552 \| 142 \| 0.7594 \| 0.805 \| 0.7816 \| 200 \| 0.7842 \| 0.8011 \| 0.7926 \| 372 \| 0.7395 \| 0.7813 \| 0.7599 \| 407 \| 0.6965 \| 0.6777 \| 0.6869 \| 667 \| 0.7179 \| 0.75 \| 0.7336 \| 224 \| 0.5081 \| 0.5809 \| 0.5421 \| 859 \| 0.6327 \| 0.6166 \| 0.6246 \| 433 \| 0.6094 \| 0.5821 \| 0.5954 \| 603 \| 0.8776 \| 0.6667 \| 0.7577 \| 129 \| 0.7059 \| 0.7407 \| 0.7229 \| 243 \| 0.5444 \| 0.5185 \| 0.5312 \| 189 \| 0.7722 \| 0.7948 \| 0.7833 \| 307 \| 0.8067 \| 0.8779 \| 0.8408 \| 385 \| 0.6408 \| 0.6804 \| 0.6600 \| 194 \| 0.7546 \| 0.8402 \| 0.7951 \| 194 \| 0.6831 \| 0.7519 \| 0.7159 \| 129 \| 0.6255 \| 0.7136 \| 0.6667 \| 206 \| 0.7392 \| 0.8427 \| 0.7876 \| 693 \| 0.7289 \| 0.7069 \| 0.7178 \| 563 \| 0.7242 \| 0.7514 \| 0.7376 \| 0.9414 \|
	\| 0.0753 \| 9.0 \| 192177 \| 0.2708 \| 0.8026 \| 0.8841 \| 0.8414 \| 138 \| 0.7054 \| 0.8018 \| 0.7505 \| 227 \| 0.6277 \| 0.6565 \| 0.6418 \| 131 \| 0.7762 \| 0.8380 \| 0.8059 \| 1722 \| 0.7552 \| 0.7552 \| 0.7552 \| 719 \| 0.7701 \| 0.8428 \| 0.8048 \| 159 \| 0.6610 \| 0.5821 \| 0.6190 \| 201 \| 0.5915 \| 0.6562 \| 0.6222 \| 128 \| 0.6575 \| 0.7273 \| 0.6906 \| 198 \| 0.7887 \| 0.7832 \| 0.7860 \| 143 \| 0.7050 \| 0.7163 \| 0.7106 \| 497 \| 0.6270 \| 0.7383 \| 0.6781 \| 214 \| 0.8441 \| 0.8881 \| 0.8656 \| 1689 \| 0.7589 \| 0.7535 \| 0.7562 \| 142 \| 0.7125 \| 0.855 \| 0.7773 \| 200 \| 0.755 \| 0.8118 \| 0.7824 \| 372 \| 0.7512 \| 0.8010 \| 0.7753 \| 407 \| 0.6788 \| 0.6972 \| 0.6879 \| 667 \| 0.7830 \| 0.7411 \| 0.7615 \| 224 \| 0.5155 \| 0.5821 \| 0.5467 \| 859 \| 0.6386 \| 0.6490 \| 0.6438 \| 433 \| 0.6629 \| 0.5804 \| 0.6189 \| 603 \| 0.8598 \| 0.7132 \| 0.7797 \| 129 \| 0.6667 \| 0.7490 \| 0.7054 \| 243 \| 0.4787 \| 0.5344 \| 0.505 \| 189 \| 0.7610 \| 0.7883 \| 0.7744 \| 307 \| 0.8285 \| 0.8909 \| 0.8586 \| 385 \| 0.7027 \| 0.6701 \| 0.6860 \| 194 \| 0.7778 \| 0.8299 \| 0.8030 \| 194 \| 0.6923 \| 0.7674 \| 0.7279 \| 129 \| 0.6396 \| 0.6893 \| 0.6636 \| 206 \| 0.7879 \| 0.8095 \| 0.7986 \| 693 \| 0.7110 \| 0.7123 \| 0.7116 \| 563 \| 0.7258 \| 0.7593 \| 0.7422 \| 0.9424 \|
	\| 0.0574 \| 10.0 \| 213530 \| 0.2862 \| 0.8 \| 0.8986 \| 0.8464 \| 138 \| 0.7375 \| 0.7797 \| 0.7580 \| 227 \| 0.6471 \| 0.6718 \| 0.6592 \| 131 \| 0.7831 \| 0.8008 \| 0.7918 \| 1722 \| 0.6997 \| 0.7747 \| 0.7353 \| 719 \| 0.7714 \| 0.8491 \| 0.8084 \| 159 \| 0.6091 \| 0.5970 \| 0.6030 \| 201 \| 0.6357 \| 0.6406 \| 0.6381 \| 128 \| 0.7 \| 0.7071 \| 0.7035 \| 198 \| 0.7436 \| 0.8112 \| 0.7759 \| 143 \| 0.6729 \| 0.7243 \| 0.6977 \| 497 \| 0.6830 \| 0.7150 \| 0.6986 \| 214 \| 0.8627 \| 0.8857 \| 0.8741 \| 1689 \| 0.7483 \| 0.7535 \| 0.7509 \| 142 \| 0.7611 \| 0.86 \| 0.8075 \| 200 \| 0.7846 \| 0.8226 \| 0.8031 \| 372 \| 0.7640 \| 0.7715 \| 0.7677 \| 407 \| 0.6921 \| 0.6942 \| 0.6931 \| 667 \| 0.7478 \| 0.7545 \| 0.7511 \| 224 \| 0.5079 \| 0.5960 \| 0.5485 \| 859 \| 0.6457 \| 0.6397 \| 0.6427 \| 433 \| 0.6223 \| 0.5821 \| 0.6015 \| 603 \| 0.8704 \| 0.7287 \| 0.7932 \| 129 \| 0.7041 \| 0.7737 \| 0.7373 \| 243 \| 0.5073 \| 0.5503 \| 0.5279 \| 189 \| 0.7680 \| 0.7980 \| 0.7827 \| 307 \| 0.8658 \| 0.8883 \| 0.8769 \| 385 \| 0.7111 \| 0.6598 \| 0.6845 \| 194 \| 0.7681 \| 0.8196 \| 0.7930 \| 194 \| 0.7197 \| 0.7364 \| 0.7280 \| 129 \| 0.6192 \| 0.7184 \| 0.6652 \| 206 \| 0.7922 \| 0.8196 \| 0.8057 \| 693 \| 0.7206 \| 0.7194 \| 0.72 \| 563 \| 0.7282 \| 0.7572 \| 0.7424 \| 0.9424 \|
	\| 0.0568 \| 11.0 \| 234883 \| 0.2951 \| 0.8026 \| 0.8841 \| 0.8414 \| 138 \| 0.7458 \| 0.7753 \| 0.7603 \| 227 \| 0.6241 \| 0.6718 \| 0.6471 \| 131 \| 0.7737 \| 0.8240 \| 0.7981 \| 1722 \| 0.7646 \| 0.7455 \| 0.7549 \| 719 \| 0.8121 \| 0.8428 \| 0.8272 \| 159 \| 0.6685 \| 0.5920 \| 0.6280 \| 201 \| 0.6870 \| 0.6172 \| 0.6502 \| 128 \| 0.7150 \| 0.6970 \| 0.7059 \| 198 \| 0.7872 \| 0.7762 \| 0.7817 \| 143 \| 0.6631 \| 0.7485 \| 0.7032 \| 497 \| 0.6842 \| 0.6682 \| 0.6761 \| 214 \| 0.8594 \| 0.8828 \| 0.8709 \| 1689 \| 0.7863 \| 0.7254 \| 0.7546 \| 142 \| 0.7824 \| 0.845 \| 0.8125 \| 200 \| 0.7628 \| 0.8038 \| 0.7827 \| 372 \| 0.7664 \| 0.7740 \| 0.7702 \| 407 \| 0.7232 \| 0.6777 \| 0.6997 \| 667 \| 0.7820 \| 0.7366 \| 0.7586 \| 224 \| 0.5362 \| 0.5949 \| 0.5640 \| 859 \| 0.6306 \| 0.6467 \| 0.6385 \| 433 \| 0.6472 \| 0.5871 \| 0.6157 \| 603 \| 0.8857 \| 0.7209 \| 0.7949 \| 129 \| 0.7138 \| 0.7901 \| 0.7500 \| 243 \| 0.5075 \| 0.5397 \| 0.5231 \| 189 \| 0.7834 \| 0.8013 \| 0.7923 \| 307 \| 0.8561 \| 0.8961 \| 0.8756 \| 385 \| 0.6809 \| 0.6598 \| 0.6702 \| 194 \| 0.7656 \| 0.8247 \| 0.7940 \| 194 \| 0.6736 \| 0.7519 \| 0.7106 \| 129 \| 0.6262 \| 0.6505 \| 0.6381 \| 206 \| 0.7892 \| 0.8211 \| 0.8048 \| 693 \| 0.7561 \| 0.7105 \| 0.7326 \| 563 \| 0.7390 \| 0.7548 \| 0.7468 \| 0.9431 \|
	\| 0.0465 \| 12.0 \| 256236 \| 0.3103 \| 0.8194 \| 0.9203 \| 0.8669 \| 138 \| 0.7031 \| 0.7930 \| 0.7453 \| 227 \| 0.5867 \| 0.6718 \| 0.6263 \| 131 \| 0.7829 \| 0.8211 \| 0.8016 \| 1722 \| 0.7582 \| 0.7413 \| 0.7496 \| 719 \| 0.8059 \| 0.8616 \| 0.8328 \| 159 \| 0.6648 \| 0.5920 \| 0.6263 \| 201 \| 0.6385 \| 0.6484 \| 0.6434 \| 128 \| 0.6827 \| 0.7172 \| 0.6995 \| 198 \| 0.7778 \| 0.8322 \| 0.8041 \| 143 \| 0.6679 \| 0.7324 \| 0.6987 \| 497 \| 0.6864 \| 0.7056 \| 0.6959 \| 214 \| 0.8473 \| 0.8905 \| 0.8684 \| 1689 \| 0.7552 \| 0.7606 \| 0.7579 \| 142 \| 0.7362 \| 0.865 \| 0.7954 \| 200 \| 0.7487 \| 0.8011 \| 0.7740 \| 372 \| 0.7470 \| 0.7764 \| 0.7614 \| 407 \| 0.7042 \| 0.7031 \| 0.7037 \| 667 \| 0.7435 \| 0.7634 \| 0.7533 \| 224 \| 0.5438 \| 0.5856 \| 0.5639 \| 859 \| 0.6261 \| 0.6536 \| 0.6395 \| 433 \| 0.6442 \| 0.6186 \| 0.6311 \| 603 \| 0.8482 \| 0.7364 \| 0.7884 \| 129 \| 0.7283 \| 0.7613 \| 0.7445 \| 243 \| 0.5075 \| 0.5397 \| 0.5231 \| 189 \| 0.7915 \| 0.7915 \| 0.7915 \| 307 \| 0.8564 \| 0.8987 \| 0.8771 \| 385 \| 0.6211 \| 0.7268 \| 0.6698 \| 194 \| 0.7633 \| 0.8144 \| 0.7880 \| 194 \| 0.7313 \| 0.7597 \| 0.7452 \| 129 \| 0.6450 \| 0.7233 \| 0.6819 \| 206 \| 0.7758 \| 0.8139 \| 0.7944 \| 693 \| 0.7189 \| 0.7176 \| 0.7182 \| 563 \| 0.7312 \| 0.7621 \| 0.7464 \| 0.9428 \|
	\| 0.0459 \| 13.0 \| 277589 \| 0.3141 \| 0.8267 \| 0.8986 \| 0.8611 \| 138 \| 0.7254 \| 0.7797 \| 0.7516 \| 227 \| 0.6099 \| 0.6565 \| 0.6324 \| 131 \| 0.7929 \| 0.8182 \| 0.8054 \| 1722 \| 0.7562 \| 0.7677 \| 0.7619 \| 719 \| 0.8084 \| 0.8491 \| 0.8282 \| 159 \| 0.6302 \| 0.6020 \| 0.6158 \| 201 \| 0.6412 \| 0.6562 \| 0.6486 \| 128 \| 0.6931 \| 0.7071 \| 0.7000 \| 198 \| 0.7770 \| 0.8042 \| 0.7904 \| 143 \| 0.6834 \| 0.7384 \| 0.7099 \| 497 \| 0.6967 \| 0.6869 \| 0.6918 \| 214 \| 0.8631 \| 0.8845 \| 0.8737 \| 1689 \| 0.7939 \| 0.7324 \| 0.7619 \| 142 \| 0.7830 \| 0.83 \| 0.8058 \| 200 \| 0.7822 \| 0.8011 \| 0.7915 \| 372 \| 0.7482 \| 0.7740 \| 0.7609 \| 407 \| 0.6982 \| 0.6972 \| 0.6977 \| 667 \| 0.7867 \| 0.7411 \| 0.7632 \| 224 \| 0.5323 \| 0.5856 \| 0.5576 \| 859 \| 0.6469 \| 0.6559 \| 0.6514 \| 433 \| 0.6512 \| 0.6036 \| 0.6265 \| 603 \| 0.8611 \| 0.7209 \| 0.7848 \| 129 \| 0.7287 \| 0.7737 \| 0.7505 \| 243 \| 0.5185 \| 0.5185 \| 0.5185 \| 189 \| 0.7910 \| 0.8013 \| 0.7961 \| 307 \| 0.8715 \| 0.8987 \| 0.8849 \| 385 \| 0.7283 \| 0.6907 \| 0.7090 \| 194 \| 0.7512 \| 0.7938 \| 0.7719 \| 194 \| 0.7313 \| 0.7597 \| 0.7452 \| 129 \| 0.6147 \| 0.6893 \| 0.6499 \| 206 \| 0.7947 \| 0.8268 \| 0.8105 \| 693 \| 0.7170 \| 0.7247 \| 0.7208 \| 563 \| 0.7406 \| 0.7588 \| 0.7496 \| 0.9436 \|
	\| 0.0386 \| 14.0 \| 298942 \| 0.3268 \| 0.8333 \| 0.9058 \| 0.8681 \| 138 \| 0.7092 \| 0.7841 \| 0.7448 \| 227 \| 0.6028 \| 0.6489 \| 0.625 \| 131 \| 0.7848 \| 0.8153 \| 0.7998 \| 1722 \| 0.7701 \| 0.7594 \| 0.7647 \| 719 \| 0.8047 \| 0.8553 \| 0.8293 \| 159 \| 0.6373 \| 0.6119 \| 0.6244 \| 201 \| 0.6204 \| 0.6641 \| 0.6415 \| 128 \| 0.6794 \| 0.7172 \| 0.6978 \| 198 \| 0.7986 \| 0.8042 \| 0.8014 \| 143 \| 0.6691 \| 0.7324 \| 0.6993 \| 497 \| 0.7109 \| 0.7009 \| 0.7059 \| 214 \| 0.8624 \| 0.8834 \| 0.8728 \| 1689 \| 0.7754 \| 0.7535 \| 0.7643 \| 142 \| 0.7757 \| 0.83 \| 0.8019 \| 200 \| 0.7712 \| 0.8065 \| 0.7884 \| 372 \| 0.7621 \| 0.7715 \| 0.7668 \| 407 \| 0.6782 \| 0.7076 \| 0.6926 \| 667 \| 0.7661 \| 0.7455 \| 0.7557 \| 224 \| 0.5417 \| 0.5669 \| 0.5540 \| 859 \| 0.6388 \| 0.6536 \| 0.6461 \| 433 \| 0.6160 \| 0.6119 \| 0.6140 \| 603 \| 0.8889 \| 0.7442 \| 0.8101 \| 129 \| 0.7431 \| 0.7737 \| 0.7581 \| 243 \| 0.5025 \| 0.5397 \| 0.5204 \| 189 \| 0.7915 \| 0.7915 \| 0.7915 \| 307 \| 0.8618 \| 0.8909 \| 0.8761 \| 385 \| 0.6699 \| 0.7113 \| 0.6900 \| 194 \| 0.7621 \| 0.8093 \| 0.7850 \| 194 \| 0.7226 \| 0.7674 \| 0.7444 \| 129 \| 0.6384 \| 0.6942 \| 0.6651 \| 206 \| 0.7872 \| 0.8167 \| 0.8017 \| 693 \| 0.7140 \| 0.7229 \| 0.7184 \| 563 \| 0.7358 \| 0.7585 \| 0.7470 \| 0.9435 \|
	\| 0.037 \| 15.0 \| 320295 \| 0.3308 \| 0.8117 \| 0.9058 \| 0.8562 \| 138 \| 0.716 \| 0.7885 \| 0.7505 \| 227 \| 0.6028 \| 0.6489 \| 0.625 \| 131 \| 0.7838 \| 0.8252 \| 0.8040 \| 1722 \| 0.7835 \| 0.7552 \| 0.7691 \| 719 \| 0.7953 \| 0.8553 \| 0.8242 \| 159 \| 0.6630 \| 0.5970 \| 0.6283 \| 201 \| 0.6296 \| 0.6641 \| 0.6464 \| 128 \| 0.6961 \| 0.7172 \| 0.7065 \| 198 \| 0.8 \| 0.8112 \| 0.8056 \| 143 \| 0.6849 \| 0.7304 \| 0.7069 \| 497 \| 0.7156 \| 0.7056 \| 0.7106 \| 214 \| 0.8631 \| 0.8845 \| 0.8737 \| 1689 \| 0.7852 \| 0.7465 \| 0.7653 \| 142 \| 0.7602 \| 0.84 \| 0.7981 \| 200 \| 0.7601 \| 0.8091 \| 0.7839 \| 372 \| 0.7506 \| 0.7617 \| 0.7561 \| 407 \| 0.6943 \| 0.7151 \| 0.7046 \| 667 \| 0.7767 \| 0.7455 \| 0.7608 \| 224 \| 0.5351 \| 0.5588 \| 0.5467 \| 859 \| 0.6453 \| 0.6513 \| 0.6483 \| 433 \| 0.6277 \| 0.6153 \| 0.6214 \| 603 \| 0.8981 \| 0.7519 \| 0.8186 \| 129 \| 0.7362 \| 0.7695 \| 0.7525 \| 243 \| 0.5178 \| 0.5397 \| 0.5285 \| 189 \| 0.7806 \| 0.7883 \| 0.7844 \| 307 \| 0.8804 \| 0.8987 \| 0.8895 \| 385 \| 0.6863 \| 0.7216 \| 0.7035 \| 194 \| 0.7696 \| 0.8093 \| 0.7889 \| 194 \| 0.7333 \| 0.7674 \| 0.7500 \| 129 \| 0.6471 \| 0.6942 \| 0.6698 \| 206 \| 0.7917 \| 0.8225 \| 0.8068 \| 693 \| 0.7255 \| 0.7229 \| 0.7242 \| 563 \| 0.7404 \| 0.7600 \| 0.7501 \| 0.9437 \|


	### Framework versions

	- Transformers 4.26.0.dev0
	- Pytorch 1.12.1+cu113
	- Datasets 2.7.1
	- Tokenizers 0.13.2