File size: 23,135 Bytes
0efea1b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
---
license: mit
base_model: dslim/bert-base-NER
tags:
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: bert-base-NER-finetuned-ner
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-base-NER-finetuned-ner

This model is a fine-tuned version of [dslim/bert-base-NER](https://huggingface.co/dslim/bert-base-NER) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.9704
- 0 Precision: 0.9706
- 0 Recall: 0.9413
- 0 F1-score: 0.9558
- 1 Precision: 0.8027
- 1 Recall: 0.9205
- 1 F1-score: 0.8575
- 2 Precision: 0.7853
- 2 Recall: 0.8165
- 2 F1-score: 0.8006
- 3 Precision: 0.7817
- 3 Recall: 0.8603
- 3 F1-score: 0.8191
- Accuracy: 0.9272
- Macro avg Precision: 0.8351
- Macro avg Recall: 0.8847
- Macro avg F1-score: 0.8583
- Weighted avg Precision: 0.9313
- Weighted avg Recall: 0.9272
- Weighted avg F1-score: 0.9285

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 60

### Training results

| Training Loss | Epoch | Step | Validation Loss | 0 Precision | 0 Recall | 0 F1-score | 1 Precision | 1 Recall | 1 F1-score | 2 Precision | 2 Recall | 2 F1-score | 3 Precision | 3 Recall | 3 F1-score | Accuracy | Macro avg Precision | Macro avg Recall | Macro avg F1-score | Weighted avg Precision | Weighted avg Recall | Weighted avg F1-score |
|:-------------:|:-----:|:----:|:---------------:|:-----------:|:--------:|:----------:|:-----------:|:--------:|:----------:|:-----------:|:--------:|:----------:|:-----------:|:--------:|:----------:|:--------:|:-------------------:|:----------------:|:------------------:|:----------------------:|:-------------------:|:---------------------:|
| No log        | 1.0   | 67   | 0.3241          | 0.9901      | 0.8116   | 0.8920     | 0.5586      | 0.9694   | 0.7088     | 0.4424      | 0.8807   | 0.5890     | 0.6615      | 0.8696   | 0.7514     | 0.8343   | 0.6631              | 0.8829           | 0.7353             | 0.8979                 | 0.8343              | 0.8495                |
| No log        | 2.0   | 134  | 0.3219          | 0.9882      | 0.8544   | 0.9164     | 0.6282      | 0.9480   | 0.7556     | 0.5375      | 0.8318   | 0.6531     | 0.6460      | 0.9106   | 0.7558     | 0.8665   | 0.7000              | 0.8862           | 0.7702             | 0.9064                 | 0.8665              | 0.8763                |
| No log        | 3.0   | 201  | 0.3126          | 0.9927      | 0.8353   | 0.9072     | 0.5873      | 0.9725   | 0.7323     | 0.5213      | 0.8624   | 0.6498     | 0.6578      | 0.9199   | 0.7671     | 0.8561   | 0.6898              | 0.8975           | 0.7641             | 0.9062                 | 0.8561              | 0.8677                |
| No log        | 4.0   | 268  | 0.3805          | 0.9851      | 0.8936   | 0.9371     | 0.7105      | 0.9419   | 0.8100     | 0.6166      | 0.8410   | 0.7115     | 0.7001      | 0.9218   | 0.7958     | 0.8979   | 0.7531              | 0.8996           | 0.8136             | 0.9196                 | 0.8979              | 0.9035                |
| No log        | 5.0   | 335  | 0.4058          | 0.9839      | 0.9028   | 0.9416     | 0.6786      | 0.9587   | 0.7947     | 0.6887      | 0.8593   | 0.7646     | 0.7718      | 0.9069   | 0.8339     | 0.9064   | 0.7807              | 0.9069           | 0.8337             | 0.9246                 | 0.9064              | 0.9110                |
| No log        | 6.0   | 402  | 0.4349          | 0.9833      | 0.9130   | 0.9468     | 0.7246      | 0.9373   | 0.8173     | 0.6786      | 0.8716   | 0.7631     | 0.7649      | 0.9088   | 0.8306     | 0.9130   | 0.7878              | 0.9077           | 0.8395             | 0.9275                 | 0.9130              | 0.9169                |
| No log        | 7.0   | 469  | 0.4379          | 0.9839      | 0.9184   | 0.9500     | 0.7308      | 0.9465   | 0.8248     | 0.7072      | 0.8716   | 0.7808     | 0.7755      | 0.9069   | 0.8361     | 0.9179   | 0.7994              | 0.9108           | 0.8479             | 0.9308                 | 0.9179              | 0.9214                |
| 0.2085        | 8.0   | 536  | 0.4750          | 0.9862      | 0.8964   | 0.9391     | 0.6702      | 0.9694   | 0.7925     | 0.7038      | 0.8502   | 0.7701     | 0.7369      | 0.9181   | 0.8176     | 0.9028   | 0.7743              | 0.9085           | 0.8298             | 0.9236                 | 0.9028              | 0.9079                |
| 0.2085        | 9.0   | 603  | 0.5353          | 0.9817      | 0.9225   | 0.9512     | 0.7443      | 0.9526   | 0.8357     | 0.7342      | 0.8532   | 0.7893     | 0.7751      | 0.9050   | 0.8351     | 0.9207   | 0.8088              | 0.9083           | 0.8528             | 0.9315                 | 0.9207              | 0.9236                |
| 0.2085        | 10.0  | 670  | 0.5730          | 0.9786      | 0.9325   | 0.9550     | 0.7920      | 0.9434   | 0.8611     | 0.7413      | 0.8502   | 0.7920     | 0.7722      | 0.8901   | 0.8270     | 0.9263   | 0.8211              | 0.9040           | 0.8588             | 0.9338                 | 0.9263              | 0.9285                |
| 0.2085        | 11.0  | 737  | 0.5801          | 0.9787      | 0.9199   | 0.9484     | 0.7404      | 0.9419   | 0.8291     | 0.7199      | 0.8410   | 0.7757     | 0.7679      | 0.8994   | 0.8285     | 0.9166   | 0.8017              | 0.9005           | 0.8454             | 0.9276                 | 0.9166              | 0.9197                |
| 0.2085        | 12.0  | 804  | 0.7227          | 0.9675      | 0.9526   | 0.96       | 0.8496      | 0.8807   | 0.8649     | 0.8170      | 0.7920   | 0.8043     | 0.7921      | 0.8939   | 0.8399     | 0.9337   | 0.8565              | 0.8798           | 0.8673             | 0.9356                 | 0.9337              | 0.9343                |
| 0.2085        | 13.0  | 871  | 0.6296          | 0.9744      | 0.9421   | 0.9579     | 0.8331      | 0.9159   | 0.8725     | 0.7568      | 0.8471   | 0.7994     | 0.7794      | 0.8883   | 0.8303     | 0.9309   | 0.8359              | 0.8983           | 0.8650             | 0.9356                 | 0.9309              | 0.9325                |
| 0.2085        | 14.0  | 938  | 0.7074          | 0.9728      | 0.9397   | 0.9559     | 0.8070      | 0.9205   | 0.8600     | 0.7690      | 0.8349   | 0.8006     | 0.7804      | 0.8734   | 0.8243     | 0.9278   | 0.8323              | 0.8921           | 0.8602             | 0.9326                 | 0.9278              | 0.9293                |
| 0.0385        | 15.0  | 1005 | 0.7392          | 0.9714      | 0.9441   | 0.9576     | 0.8425      | 0.8914   | 0.8663     | 0.7634      | 0.8287   | 0.7947     | 0.7721      | 0.8957   | 0.8293     | 0.9299   | 0.8373              | 0.8900           | 0.8620             | 0.9340                 | 0.9299              | 0.9313                |
| 0.0385        | 16.0  | 1072 | 0.7589          | 0.9741      | 0.9399   | 0.9567     | 0.8003      | 0.9190   | 0.8555     | 0.7604      | 0.8349   | 0.7959     | 0.7876      | 0.8771   | 0.8300     | 0.9281   | 0.8306              | 0.8927           | 0.8595             | 0.9331                 | 0.9281              | 0.9297                |
| 0.0385        | 17.0  | 1139 | 0.7045          | 0.9724      | 0.9380   | 0.9549     | 0.7847      | 0.9251   | 0.8491     | 0.7624      | 0.8440   | 0.8012     | 0.8056      | 0.8641   | 0.8338     | 0.9266   | 0.8313              | 0.8928           | 0.8597             | 0.9318                 | 0.9266              | 0.9282                |
| 0.0385        | 18.0  | 1206 | 0.7735          | 0.9698      | 0.9437   | 0.9566     | 0.8043      | 0.9174   | 0.8571     | 0.7721      | 0.8287   | 0.7994     | 0.8074      | 0.8510   | 0.8286     | 0.9286   | 0.8384              | 0.8852           | 0.8604             | 0.9322                 | 0.9286              | 0.9298                |
| 0.0385        | 19.0  | 1273 | 0.7184          | 0.9735      | 0.9399   | 0.9564     | 0.8150      | 0.9159   | 0.8625     | 0.7439      | 0.8440   | 0.7908     | 0.7863      | 0.8771   | 0.8292     | 0.9282   | 0.8297              | 0.8942           | 0.8597             | 0.9332                 | 0.9282              | 0.9298                |
| 0.0385        | 20.0  | 1340 | 0.7814          | 0.9741      | 0.9341   | 0.9537     | 0.7875      | 0.9235   | 0.8501     | 0.7535      | 0.8226   | 0.7865     | 0.7581      | 0.8696   | 0.8101     | 0.9229   | 0.8183              | 0.8875           | 0.8501             | 0.9293                 | 0.9229              | 0.9249                |
| 0.0385        | 21.0  | 1407 | 0.8279          | 0.9696      | 0.9445   | 0.9569     | 0.8201      | 0.9128   | 0.8640     | 0.7768      | 0.8196   | 0.7976     | 0.7880      | 0.8585   | 0.8217     | 0.9289   | 0.8386              | 0.8838           | 0.8601             | 0.9323                 | 0.9289              | 0.9301                |
| 0.0385        | 22.0  | 1474 | 0.7268          | 0.9724      | 0.9332   | 0.9524     | 0.7704      | 0.9388   | 0.8463     | 0.7647      | 0.8349   | 0.7982     | 0.7818      | 0.8473   | 0.8132     | 0.9224   | 0.8223              | 0.8885           | 0.8525             | 0.9287                 | 0.9224              | 0.9243                |
| 0.0127        | 23.0  | 1541 | 0.8197          | 0.9698      | 0.9445   | 0.9570     | 0.8078      | 0.9190   | 0.8598     | 0.7928      | 0.8073   | 0.8        | 0.7973      | 0.8641   | 0.8293     | 0.9294   | 0.8419              | 0.8837           | 0.8615             | 0.9327                 | 0.9294              | 0.9305                |
| 0.0127        | 24.0  | 1608 | 0.8221          | 0.9722      | 0.9447   | 0.9582     | 0.8197      | 0.9037   | 0.8596     | 0.7718      | 0.8379   | 0.8035     | 0.7933      | 0.8790   | 0.8339     | 0.9307   | 0.8392              | 0.8913           | 0.8638             | 0.9344                 | 0.9307              | 0.9320                |
| 0.0127        | 25.0  | 1675 | 0.8098          | 0.9735      | 0.9373   | 0.9550     | 0.7766      | 0.9358   | 0.8488     | 0.7928      | 0.8073   | 0.8        | 0.7809      | 0.8696   | 0.8229     | 0.9257   | 0.8310              | 0.8875           | 0.8567             | 0.9314                 | 0.9257              | 0.9274                |
| 0.0127        | 26.0  | 1742 | 0.8023          | 0.9710      | 0.9404   | 0.9554     | 0.7897      | 0.9358   | 0.8565     | 0.7813      | 0.8196   | 0.8        | 0.8035      | 0.8529   | 0.8275     | 0.9275   | 0.8364              | 0.8872           | 0.8599             | 0.9319                 | 0.9275              | 0.9288                |
| 0.0127        | 27.0  | 1809 | 0.7750          | 0.9748      | 0.9373   | 0.9557     | 0.7897      | 0.9358   | 0.8565     | 0.7591      | 0.8287   | 0.7924     | 0.7963      | 0.8808   | 0.8364     | 0.9276   | 0.8300              | 0.8957           | 0.8603             | 0.9333                 | 0.9276              | 0.9293                |
| 0.0127        | 28.0  | 1876 | 0.9205          | 0.9673      | 0.9465   | 0.9568     | 0.8220      | 0.9037   | 0.8609     | 0.7861      | 0.7982   | 0.7921     | 0.7925      | 0.8603   | 0.8250     | 0.9288   | 0.8420              | 0.8772           | 0.8587             | 0.9314                 | 0.9288              | 0.9297                |
| 0.0127        | 29.0  | 1943 | 0.7887          | 0.9726      | 0.9376   | 0.9548     | 0.7695      | 0.9343   | 0.8439     | 0.7756      | 0.8349   | 0.8041     | 0.8057      | 0.8492   | 0.8268     | 0.9256   | 0.8308              | 0.8890           | 0.8574             | 0.9311                 | 0.9256              | 0.9273                |
| 0.0052        | 30.0  | 2010 | 0.8106          | 0.9778      | 0.9371   | 0.9570     | 0.7861      | 0.9327   | 0.8531     | 0.7658      | 0.8502   | 0.8058     | 0.7897      | 0.8883   | 0.8361     | 0.9288   | 0.8299              | 0.9021           | 0.8630             | 0.9351                 | 0.9288              | 0.9307                |
| 0.0052        | 31.0  | 2077 | 0.8659          | 0.9699      | 0.9421   | 0.9558     | 0.8022      | 0.9113   | 0.8533     | 0.7929      | 0.8196   | 0.8060     | 0.7922      | 0.8734   | 0.8308     | 0.9281   | 0.8393              | 0.8866           | 0.8615             | 0.9319                 | 0.9281              | 0.9293                |
| 0.0052        | 32.0  | 2144 | 0.8154          | 0.9722      | 0.9389   | 0.9553     | 0.7878      | 0.9251   | 0.8509     | 0.7768      | 0.8410   | 0.8076     | 0.7986      | 0.8641   | 0.8301     | 0.9272   | 0.8339              | 0.8923           | 0.8610             | 0.9321                 | 0.9272              | 0.9287                |
| 0.0052        | 33.0  | 2211 | 0.8569          | 0.9727      | 0.9432   | 0.9577     | 0.8086      | 0.9174   | 0.8596     | 0.7878      | 0.8287   | 0.8077     | 0.7953      | 0.8827   | 0.8367     | 0.9307   | 0.8411              | 0.8930           | 0.8654             | 0.9347                 | 0.9307              | 0.9320                |
| 0.0052        | 34.0  | 2278 | 0.8868          | 0.9705      | 0.9432   | 0.9566     | 0.8011      | 0.9113   | 0.8526     | 0.7843      | 0.8226   | 0.8030     | 0.7976      | 0.8659   | 0.8304     | 0.9285   | 0.8384              | 0.8858           | 0.8607             | 0.9323                 | 0.9285              | 0.9298                |
| 0.0052        | 35.0  | 2345 | 0.8586          | 0.9745      | 0.9412   | 0.9575     | 0.8021      | 0.9235   | 0.8586     | 0.7771      | 0.8318   | 0.8035     | 0.79        | 0.8827   | 0.8338     | 0.9298   | 0.8359              | 0.8948           | 0.8634             | 0.9346                 | 0.9298              | 0.9313                |
| 0.0052        | 36.0  | 2412 | 0.9288          | 0.9698      | 0.9449   | 0.9572     | 0.8157      | 0.9067   | 0.8588     | 0.7864      | 0.8104   | 0.7982     | 0.7825      | 0.8641   | 0.8212     | 0.9286   | 0.8386              | 0.8815           | 0.8588             | 0.9320                 | 0.9286              | 0.9298                |
| 0.0052        | 37.0  | 2479 | 0.9396          | 0.9684      | 0.9460   | 0.9570     | 0.8186      | 0.9037   | 0.8590     | 0.7824      | 0.8135   | 0.7976     | 0.7917      | 0.8566   | 0.8229     | 0.9288   | 0.8403              | 0.8799           | 0.8591             | 0.9317                 | 0.9288              | 0.9298                |
| 0.0032        | 38.0  | 2546 | 0.9108          | 0.9706      | 0.9408   | 0.9555     | 0.8014      | 0.9067   | 0.8508     | 0.7743      | 0.8287   | 0.8006     | 0.7862      | 0.8696   | 0.8258     | 0.9268   | 0.8331              | 0.8865           | 0.8582             | 0.9310                 | 0.9268              | 0.9282                |
| 0.0032        | 39.0  | 2613 | 0.8132          | 0.9757      | 0.9306   | 0.9526     | 0.7853      | 0.9174   | 0.8463     | 0.7249      | 0.8379   | 0.7773     | 0.7700      | 0.8976   | 0.8289     | 0.9224   | 0.8140              | 0.8959           | 0.8513             | 0.9299                 | 0.9224              | 0.9247                |
| 0.0032        | 40.0  | 2680 | 0.9634          | 0.9692      | 0.9421   | 0.9554     | 0.8033      | 0.9052   | 0.8512     | 0.7876      | 0.8165   | 0.8018     | 0.7825      | 0.8641   | 0.8212     | 0.9266   | 0.8356              | 0.8820           | 0.8574             | 0.9304                 | 0.9266              | 0.9279                |
| 0.0032        | 41.0  | 2747 | 0.9024          | 0.9711      | 0.9387   | 0.9546     | 0.7937      | 0.9174   | 0.8511     | 0.7655      | 0.8287   | 0.7959     | 0.7840      | 0.8585   | 0.8196     | 0.9253   | 0.8286              | 0.8858           | 0.8553             | 0.9301                 | 0.9253              | 0.9269                |
| 0.0032        | 42.0  | 2814 | 0.9623          | 0.9682      | 0.9456   | 0.9567     | 0.8217      | 0.9021   | 0.8601     | 0.7922      | 0.8043   | 0.7982     | 0.7795      | 0.8622   | 0.8187     | 0.9283   | 0.8404              | 0.8786           | 0.8584             | 0.9314                 | 0.9283              | 0.9294                |
| 0.0032        | 43.0  | 2881 | 0.9335          | 0.9692      | 0.9441   | 0.9565     | 0.8148      | 0.9083   | 0.8590     | 0.7811      | 0.8073   | 0.7940     | 0.7817      | 0.8603   | 0.8191     | 0.9278   | 0.8367              | 0.8800           | 0.8572             | 0.9312                 | 0.9278              | 0.9290                |
| 0.0032        | 44.0  | 2948 | 0.8909          | 0.9714      | 0.9380   | 0.9544     | 0.7924      | 0.9220   | 0.8523     | 0.7642      | 0.8226   | 0.7923     | 0.7817      | 0.8603   | 0.8191     | 0.9250   | 0.8274              | 0.8857           | 0.8546             | 0.9300                 | 0.9250              | 0.9266                |
| 0.0026        | 45.0  | 3015 | 0.9011          | 0.9711      | 0.9393   | 0.9549     | 0.7900      | 0.9205   | 0.8503     | 0.7876      | 0.8165   | 0.8018     | 0.7811      | 0.8641   | 0.8205     | 0.9259   | 0.8325              | 0.8851           | 0.8569             | 0.9306                 | 0.9259              | 0.9274                |
| 0.0026        | 46.0  | 3082 | 0.9105          | 0.9709      | 0.9387   | 0.9546     | 0.7921      | 0.9205   | 0.8515     | 0.7801      | 0.8135   | 0.7964     | 0.7785      | 0.8641   | 0.8191     | 0.9253   | 0.8304              | 0.8842           | 0.8554             | 0.9301                 | 0.9253              | 0.9268                |
| 0.0026        | 47.0  | 3149 | 0.9380          | 0.9698      | 0.9404   | 0.9549     | 0.7936      | 0.9113   | 0.8484     | 0.7811      | 0.8073   | 0.7940     | 0.7808      | 0.8622   | 0.8195     | 0.9253   | 0.8313              | 0.8803           | 0.8542             | 0.9296                 | 0.9253              | 0.9267                |
| 0.0026        | 48.0  | 3216 | 0.9258          | 0.9702      | 0.9393   | 0.9545     | 0.7846      | 0.9190   | 0.8465     | 0.7843      | 0.8226   | 0.8030     | 0.7849      | 0.8492   | 0.8157     | 0.9249   | 0.8310              | 0.8825           | 0.8549             | 0.9295                 | 0.9249              | 0.9264                |
| 0.0026        | 49.0  | 3283 | 0.9463          | 0.9697      | 0.9404   | 0.9548     | 0.7918      | 0.9128   | 0.8480     | 0.7836      | 0.8196   | 0.8012     | 0.7880      | 0.8585   | 0.8217     | 0.9257   | 0.8333              | 0.8828           | 0.8564             | 0.9300                 | 0.9257              | 0.9271                |
| 0.0026        | 50.0  | 3350 | 0.9205          | 0.9708      | 0.9406   | 0.9555     | 0.7939      | 0.9190   | 0.8519     | 0.7895      | 0.8257   | 0.8072     | 0.7836      | 0.8566   | 0.8185     | 0.9266   | 0.8345              | 0.8855           | 0.8583             | 0.9310                 | 0.9266              | 0.9280                |
| 0.0026        | 51.0  | 3417 | 0.9339          | 0.9702      | 0.9412   | 0.9555     | 0.8024      | 0.9128   | 0.8541     | 0.7872      | 0.8257   | 0.8060     | 0.7808      | 0.8622   | 0.8195     | 0.9269   | 0.8352              | 0.8855           | 0.8587             | 0.9310                 | 0.9269              | 0.9283                |
| 0.0026        | 52.0  | 3484 | 0.9439          | 0.9712      | 0.9413   | 0.9560     | 0.7995      | 0.9205   | 0.8557     | 0.7959      | 0.8226   | 0.8090     | 0.7808      | 0.8622   | 0.8195     | 0.9276   | 0.8368              | 0.8867           | 0.8601             | 0.9319                 | 0.9276              | 0.9290                |
| 0.0013        | 53.0  | 3551 | 0.9354          | 0.9715      | 0.9406   | 0.9558     | 0.7974      | 0.9266   | 0.8571     | 0.7855      | 0.8287   | 0.8065     | 0.7863      | 0.8566   | 0.8200     | 0.9275   | 0.8352              | 0.8881           | 0.8599             | 0.9319                 | 0.9275              | 0.9289                |
| 0.0013        | 54.0  | 3618 | 0.9541          | 0.9715      | 0.9404   | 0.9557     | 0.7992      | 0.9251   | 0.8575     | 0.7832      | 0.8287   | 0.8053     | 0.7840      | 0.8585   | 0.8196     | 0.9273   | 0.8345              | 0.8882           | 0.8595             | 0.9318                 | 0.9273              | 0.9288                |
| 0.0013        | 55.0  | 3685 | 0.9586          | 0.9715      | 0.9402   | 0.9556     | 0.7984      | 0.9266   | 0.8577     | 0.7820      | 0.8226   | 0.8018     | 0.7810      | 0.8566   | 0.8171     | 0.9269   | 0.8332              | 0.8865           | 0.8581             | 0.9314                 | 0.9269              | 0.9284                |
| 0.0013        | 56.0  | 3752 | 0.9737          | 0.9690      | 0.9413   | 0.9549     | 0.8005      | 0.9083   | 0.8510     | 0.7853      | 0.8165   | 0.8006     | 0.7814      | 0.8585   | 0.8181     | 0.9259   | 0.8340              | 0.8811           | 0.8562             | 0.9298                 | 0.9259              | 0.9272                |
| 0.0013        | 57.0  | 3819 | 0.9620          | 0.9695      | 0.9404   | 0.9547     | 0.7997      | 0.9098   | 0.8512     | 0.7807      | 0.8165   | 0.7982     | 0.7795      | 0.8622   | 0.8187     | 0.9256   | 0.8323              | 0.8822           | 0.8557             | 0.9298                 | 0.9256              | 0.9270                |
| 0.0013        | 58.0  | 3886 | 0.9616          | 0.9697      | 0.9404   | 0.9548     | 0.7997      | 0.9159   | 0.8539     | 0.7853      | 0.8165   | 0.8006     | 0.7787      | 0.8585   | 0.8167     | 0.9259   | 0.8334              | 0.8828           | 0.8565             | 0.9301                 | 0.9259              | 0.9273                |
| 0.0013        | 59.0  | 3953 | 0.9692          | 0.9701      | 0.9412   | 0.9554     | 0.8021      | 0.9174   | 0.8559     | 0.7830      | 0.8165   | 0.7994     | 0.7814      | 0.8585   | 0.8181     | 0.9266   | 0.8341              | 0.8834           | 0.8572             | 0.9307                 | 0.9266              | 0.9280                |
| 0.001         | 60.0  | 4020 | 0.9704          | 0.9706      | 0.9413   | 0.9558     | 0.8027      | 0.9205   | 0.8575     | 0.7853      | 0.8165   | 0.8006     | 0.7817      | 0.8603   | 0.8191     | 0.9272   | 0.8351              | 0.8847           | 0.8583             | 0.9313                 | 0.9272              | 0.9285                |


### Framework versions

- Transformers 4.38.2
- Pytorch 2.2.1+cu121
- Datasets 2.18.0
- Tokenizers 0.15.2