---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-pt-pl10-4
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-pt-pl10-4

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1823
- Location Precision: 0.8442
- Location Recall: 0.8904
- Location F1: 0.8667
- Location Number: 73
- Organization Precision: 0.6786
- Organization Recall: 0.8769
- Organization F1: 0.7651
- Organization Number: 65
- Person Precision: 0.8742
- Person Recall: 0.9267
- Person F1: 0.8997
- Person Number: 150
- Quantity Precision: 0.6316
- Quantity Recall: 0.8276
- Quantity F1: 0.7164
- Quantity Number: 29
- Time Precision: 0.7838
- Time Recall: 0.8529
- Time F1: 0.8169
- Time Number: 34
- Overall Precision: 0.7949
- Overall Recall: 0.8946
- Overall F1: 0.8418
- Overall Accuracy: 0.9626

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.9704        | 1.0   | 106   | 0.5637          | 0.0                | 0.0             | 0.0         | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.25             | 0.0733        | 0.1134    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.0            | 0.0         | 0.0     | 34          | 0.1746            | 0.0313         | 0.0531     | 0.8440           |
| 0.4856        | 2.0   | 212   | 0.3351          | 0.4211             | 0.1096          | 0.1739      | 73              | 0.1071                 | 0.0923              | 0.0992          | 65                  | 0.6203           | 0.7733        | 0.6884    | 150           | 0.0870             | 0.0690          | 0.0769      | 29              | 0.525          | 0.6176      | 0.5676  | 34          | 0.4708            | 0.4359         | 0.4527     | 0.8976           |
| 0.2946        | 3.0   | 318   | 0.2044          | 0.5050             | 0.6986          | 0.5862      | 73              | 0.3731                 | 0.3846              | 0.3788          | 65                  | 0.7791           | 0.8933        | 0.8323    | 150           | 0.4103             | 0.5517          | 0.4706      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.6130            | 0.7265         | 0.6649     | 0.9301           |
| 0.2098        | 4.0   | 424   | 0.1748          | 0.6237             | 0.7945          | 0.6988      | 73              | 0.5149                 | 0.8                 | 0.6265          | 65                  | 0.8070           | 0.92          | 0.8598    | 150           | 0.4286             | 0.6207          | 0.5070      | 29              | 0.8824         | 0.8824      | 0.8824  | 34          | 0.6712            | 0.8433         | 0.7475     | 0.9404           |
| 0.177         | 5.0   | 530   | 0.1551          | 0.7093             | 0.8356          | 0.7673      | 73              | 0.5051                 | 0.7692              | 0.6098          | 65                  | 0.8221           | 0.8933        | 0.8562    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.6744         | 0.8529      | 0.7532  | 34          | 0.6939            | 0.8462         | 0.7625     | 0.9493           |
| 0.1591        | 6.0   | 636   | 0.1818          | 0.6354             | 0.8356          | 0.7219      | 73              | 0.5392                 | 0.8462              | 0.6587          | 65                  | 0.8528           | 0.9267        | 0.8882    | 150           | 0.4706             | 0.8276          | 0.6         | 29              | 0.5918         | 0.8529      | 0.6988  | 34          | 0.6681            | 0.8775         | 0.7586     | 0.9385           |
| 0.147         | 7.0   | 742   | 0.1428          | 0.6383             | 0.8219          | 0.7186      | 73              | 0.5802                 | 0.7231              | 0.6438          | 65                  | 0.8553           | 0.9067        | 0.8803    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7255            | 0.8433         | 0.7800     | 0.9532           |
| 0.138         | 8.0   | 848   | 0.1377          | 0.6897             | 0.8219          | 0.75        | 73              | 0.5854                 | 0.7385              | 0.6531          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7389            | 0.8547         | 0.7926     | 0.9540           |
| 0.1304        | 9.0   | 954   | 0.1351          | 0.7317             | 0.8219          | 0.7742      | 73              | 0.5568                 | 0.7538              | 0.6405          | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7407            | 0.8547         | 0.7937     | 0.9550           |
| 0.1262        | 10.0  | 1060  | 0.1349          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.5735                 | 0.6                 | 0.5865          | 65                  | 0.85             | 0.9067        | 0.8774    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.8611         | 0.9118      | 0.8857  | 34          | 0.7572            | 0.8262         | 0.7902     | 0.9555           |
| 0.1167        | 11.0  | 1166  | 0.1450          | 0.7059             | 0.8219          | 0.7595      | 73              | 0.6024                 | 0.7692              | 0.6757          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6                | 0.8276          | 0.6957      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.7366            | 0.8604         | 0.7937     | 0.9550           |
| 0.1104        | 12.0  | 1272  | 0.1446          | 0.6556             | 0.8082          | 0.7239      | 73              | 0.6098                 | 0.7692              | 0.6803          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.75           | 0.8824      | 0.8108  | 34          | 0.7359            | 0.8575         | 0.7921     | 0.9537           |
| 0.1086        | 13.0  | 1378  | 0.1427          | 0.7024             | 0.8082          | 0.7516      | 73              | 0.5814                 | 0.7692              | 0.6623          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7463            | 0.8632         | 0.8005     | 0.9555           |
| 0.1058        | 14.0  | 1484  | 0.1378          | 0.6932             | 0.8356          | 0.7578      | 73              | 0.6173                 | 0.7692              | 0.6849          | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.75           | 0.8824      | 0.8108  | 34          | 0.7481            | 0.8632         | 0.8016     | 0.9567           |
| 0.1016        | 15.0  | 1590  | 0.1370          | 0.6860             | 0.8082          | 0.7421      | 73              | 0.5833                 | 0.7538              | 0.6577          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.8108         | 0.8824      | 0.8451  | 34          | 0.7432            | 0.8575         | 0.7963     | 0.9555           |
| 0.0986        | 16.0  | 1696  | 0.1539          | 0.6854             | 0.8356          | 0.7531      | 73              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.5208             | 0.8621          | 0.6494      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7279            | 0.8689         | 0.7922     | 0.9527           |
| 0.0939        | 17.0  | 1802  | 0.1347          | 0.7176             | 0.8356          | 0.7722      | 73              | 0.625                  | 0.7692              | 0.6897          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7222             | 0.8966          | 0.8000      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7625            | 0.8689         | 0.8123     | 0.9584           |
| 0.0915        | 18.0  | 1908  | 0.1373          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6024                 | 0.7692              | 0.6757          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6579             | 0.8621          | 0.7463      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7562            | 0.8661         | 0.8074     | 0.9577           |
| 0.0893        | 19.0  | 2014  | 0.1354          | 0.7654             | 0.8493          | 0.8052      | 73              | 0.625                  | 0.7692              | 0.6897          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6579             | 0.8621          | 0.7463      | 29              | 0.6364         | 0.8235      | 0.7179  | 34          | 0.7562            | 0.8661         | 0.8074     | 0.9582           |
| 0.0836        | 20.0  | 2120  | 0.1413          | 0.7229             | 0.8219          | 0.7692      | 73              | 0.6341                 | 0.8                 | 0.7075          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.76              | 0.8661         | 0.8096     | 0.9582           |
| 0.08          | 21.0  | 2226  | 0.1397          | 0.7143             | 0.8219          | 0.7643      | 73              | 0.6173                 | 0.7692              | 0.6849          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.8286         | 0.8529      | 0.8406  | 34          | 0.7665            | 0.8604         | 0.8107     | 0.9584           |
| 0.0805        | 22.0  | 2332  | 0.1374          | 0.7625             | 0.8356          | 0.7974      | 73              | 0.6203                 | 0.7538              | 0.6806          | 65                  | 0.8910           | 0.9267        | 0.9085    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7795            | 0.8661         | 0.8205     | 0.9606           |
| 0.0802        | 23.0  | 2438  | 0.1326          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6136                 | 0.8308              | 0.7059          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.8857         | 0.9118      | 0.8986  | 34          | 0.7744            | 0.8803         | 0.824      | 0.9609           |
| 0.0758        | 24.0  | 2544  | 0.1456          | 0.7059             | 0.8219          | 0.7595      | 73              | 0.6136                 | 0.8308              | 0.7059          | 65                  | 0.9026           | 0.9267        | 0.9145    | 150           | 0.6579             | 0.8621          | 0.7463      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7568            | 0.8775         | 0.8127     | 0.9572           |
| 0.0702        | 25.0  | 2650  | 0.1506          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.5870                 | 0.8308              | 0.6879          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.5854             | 0.8276          | 0.6857      | 29              | 0.8333         | 0.8824      | 0.8571  | 34          | 0.7506            | 0.8746         | 0.8079     | 0.9564           |
| 0.0718        | 26.0  | 2756  | 0.1452          | 0.775              | 0.8493          | 0.8105      | 73              | 0.6375                 | 0.7846              | 0.7034          | 65                  | 0.8903           | 0.92          | 0.9049    | 150           | 0.5714             | 0.8276          | 0.6761      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7702            | 0.8689         | 0.8166     | 0.9591           |
| 0.0724        | 27.0  | 2862  | 0.1523          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6429                 | 0.8308              | 0.7248          | 65                  | 0.8903           | 0.92          | 0.9049    | 150           | 0.5952             | 0.8621          | 0.7042      | 29              | 0.6905         | 0.8529      | 0.7632  | 34          | 0.7562            | 0.8746         | 0.8111     | 0.9557           |
| 0.0662        | 28.0  | 2968  | 0.1494          | 0.8077             | 0.8630          | 0.8344      | 73              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.6905         | 0.8529      | 0.7632  | 34          | 0.7764            | 0.8803         | 0.8251     | 0.9604           |
| 0.0661        | 29.0  | 3074  | 0.1376          | 0.7949             | 0.8493          | 0.8212      | 73              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7893            | 0.8860         | 0.8349     | 0.9633           |
| 0.0671        | 30.0  | 3180  | 0.1365          | 0.8205             | 0.8767          | 0.8477      | 73              | 0.6857                 | 0.7385              | 0.7111          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8053            | 0.8718         | 0.8372     | 0.9616           |
| 0.0627        | 31.0  | 3286  | 0.1381          | 0.8354             | 0.9041          | 0.8684      | 73              | 0.7037                 | 0.8769              | 0.7808          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.8061            | 0.9003         | 0.8506     | 0.9655           |
| 0.0599        | 32.0  | 3392  | 0.1559          | 0.7654             | 0.8493          | 0.8052      | 73              | 0.5816                 | 0.8769              | 0.6994          | 65                  | 0.8491           | 0.9           | 0.8738    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7464            | 0.8803         | 0.8078     | 0.9559           |
| 0.0639        | 33.0  | 3498  | 0.1532          | 0.8182             | 0.8630          | 0.8400      | 73              | 0.5889                 | 0.8154              | 0.6839          | 65                  | 0.8354           | 0.9133        | 0.8726    | 150           | 0.6944             | 0.8621          | 0.7692      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7543            | 0.8746         | 0.8100     | 0.9577           |
| 0.0611        | 34.0  | 3604  | 0.1448          | 0.8205             | 0.8767          | 0.8477      | 73              | 0.6471                 | 0.8462              | 0.7333          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.78              | 0.8889         | 0.8309     | 0.9616           |
| 0.0601        | 35.0  | 3710  | 0.1562          | 0.7975             | 0.8630          | 0.8289      | 73              | 0.6222                 | 0.8615              | 0.7226          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.625              | 0.8621          | 0.7246      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7623            | 0.8860         | 0.8195     | 0.9559           |
| 0.061         | 36.0  | 3816  | 0.1532          | 0.8571             | 0.9041          | 0.88        | 73              | 0.6706                 | 0.8769              | 0.76            | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.6579             | 0.8621          | 0.7463      | 29              | 0.6829         | 0.8235      | 0.7467  | 34          | 0.7825            | 0.8917         | 0.8336     | 0.9589           |
| 0.0575        | 37.0  | 3922  | 0.1557          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.5938                 | 0.8769              | 0.7081          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6579             | 0.8621          | 0.7463      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7476            | 0.8860         | 0.8110     | 0.9562           |
| 0.0548        | 38.0  | 4028  | 0.1572          | 0.8228             | 0.8904          | 0.8553      | 73              | 0.6579                 | 0.7692              | 0.7092          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.5854             | 0.8276          | 0.6857      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7772            | 0.8746         | 0.8231     | 0.9577           |
| 0.0563        | 39.0  | 4134  | 0.1510          | 0.8205             | 0.8767          | 0.8477      | 73              | 0.6404                 | 0.8769              | 0.7403          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7884            | 0.8917         | 0.8369     | 0.9609           |
| 0.0552        | 40.0  | 4240  | 0.1458          | 0.8                | 0.8767          | 0.8366      | 73              | 0.6222                 | 0.8615              | 0.7226          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7761            | 0.8889         | 0.8287     | 0.9606           |
| 0.0551        | 41.0  | 4346  | 0.1444          | 0.8025             | 0.8904          | 0.8442      | 73              | 0.625                  | 0.8462              | 0.7190          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6944             | 0.8621          | 0.7692      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7742            | 0.8889         | 0.8276     | 0.9616           |
| 0.0518        | 42.0  | 4452  | 0.1678          | 0.7975             | 0.8630          | 0.8289      | 73              | 0.6591                 | 0.8923              | 0.7582          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.5854             | 0.8276          | 0.6857      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7709            | 0.8917         | 0.8269     | 0.9584           |
| 0.0493        | 43.0  | 4558  | 0.1582          | 0.8077             | 0.8630          | 0.8344      | 73              | 0.6747                 | 0.8615              | 0.7568          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.575              | 0.7931          | 0.6667      | 29              | 0.7949         | 0.9118      | 0.8493  | 34          | 0.7834            | 0.8860         | 0.8316     | 0.9619           |
| 0.0499        | 44.0  | 4664  | 0.1485          | 0.8493             | 0.8493          | 0.8493      | 73              | 0.6867                 | 0.8769              | 0.7703          | 65                  | 0.8968           | 0.9267        | 0.9115    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.8286         | 0.8529      | 0.8406  | 34          | 0.8184            | 0.8860         | 0.8509     | 0.9641           |
| 0.0486        | 45.0  | 4770  | 0.1577          | 0.8289             | 0.8630          | 0.8456      | 73              | 0.6552                 | 0.8769              | 0.75            | 65                  | 0.8910           | 0.9267        | 0.9085    | 150           | 0.6                | 0.8276          | 0.6957      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7839            | 0.8889         | 0.8331     | 0.9609           |
| 0.0449        | 46.0  | 4876  | 0.1510          | 0.8228             | 0.8904          | 0.8553      | 73              | 0.6627                 | 0.8462              | 0.7432          | 65                  | 0.8896           | 0.9133        | 0.9013    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.8108         | 0.8824      | 0.8451  | 34          | 0.7959            | 0.8889         | 0.8398     | 0.9633           |
| 0.0473        | 47.0  | 4982  | 0.1571          | 0.8125             | 0.8904          | 0.8497      | 73              | 0.6333                 | 0.8769              | 0.7355          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.6944             | 0.8621          | 0.7692      | 29              | 0.6905         | 0.8529      | 0.7632  | 34          | 0.7759            | 0.8974         | 0.8322     | 0.9619           |
| 0.0491        | 48.0  | 5088  | 0.1722          | 0.8125             | 0.8904          | 0.8497      | 73              | 0.6404                 | 0.8769              | 0.7403          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.5682             | 0.8621          | 0.6849      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7590            | 0.8974         | 0.8225     | 0.9572           |
| 0.0471        | 49.0  | 5194  | 0.1649          | 0.8333             | 0.8904          | 0.8609      | 73              | 0.6744                 | 0.8923              | 0.7682          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.75           | 0.8824      | 0.8108  | 34          | 0.7925            | 0.9031         | 0.8442     | 0.9623           |
| 0.0454        | 50.0  | 5300  | 0.1550          | 0.8101             | 0.8767          | 0.8421      | 73              | 0.6951                 | 0.8769              | 0.7755          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7970            | 0.8946         | 0.8430     | 0.9646           |
| 0.0453        | 51.0  | 5406  | 0.1557          | 0.8101             | 0.8767          | 0.8421      | 73              | 0.7105                 | 0.8308              | 0.7660          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7949            | 0.8832         | 0.8367     | 0.9638           |
| 0.0467        | 52.0  | 5512  | 0.1668          | 0.8421             | 0.8767          | 0.8591      | 73              | 0.6591                 | 0.8923              | 0.7582          | 65                  | 0.8968           | 0.9267        | 0.9115    | 150           | 0.5714             | 0.8276          | 0.6761      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.785             | 0.8946         | 0.8362     | 0.9606           |
| 0.0415        | 53.0  | 5618  | 0.1649          | 0.8205             | 0.8767          | 0.8477      | 73              | 0.6477                 | 0.8769              | 0.7451          | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.5714             | 0.8276          | 0.6761      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7715            | 0.8946         | 0.8285     | 0.9599           |
| 0.0428        | 54.0  | 5724  | 0.1656          | 0.8553             | 0.8904          | 0.8725      | 73              | 0.6517                 | 0.8923              | 0.7532          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.6154             | 0.8276          | 0.7059      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7945            | 0.9031         | 0.8453     | 0.9619           |
| 0.042         | 55.0  | 5830  | 0.1677          | 0.825              | 0.9041          | 0.8627      | 73              | 0.6591                 | 0.8923              | 0.7582          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.625              | 0.8621          | 0.7246      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.7905            | 0.9031         | 0.8431     | 0.9604           |
| 0.0412        | 56.0  | 5936  | 0.1510          | 0.8553             | 0.8904          | 0.8725      | 73              | 0.7125                 | 0.8769              | 0.7862          | 65                  | 0.8726           | 0.9133        | 0.8925    | 150           | 0.6667             | 0.8276          | 0.7385      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.8104            | 0.8889         | 0.8478     | 0.9655           |
| 0.0409        | 57.0  | 6042  | 0.1590          | 0.8421             | 0.8767          | 0.8591      | 73              | 0.6923                 | 0.8308              | 0.7552          | 65                  | 0.8846           | 0.92          | 0.9020    | 150           | 0.7027             | 0.8966          | 0.7879      | 29              | 0.8333         | 0.8824      | 0.8571  | 34          | 0.8146            | 0.8889         | 0.8501     | 0.9653           |
| 0.0396        | 58.0  | 6148  | 0.1671          | 0.8077             | 0.8630          | 0.8344      | 73              | 0.7215                 | 0.8769              | 0.7917          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6098             | 0.8621          | 0.7143      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7924            | 0.8917         | 0.8391     | 0.9621           |
| 0.0392        | 59.0  | 6254  | 0.1591          | 0.8333             | 0.8904          | 0.8609      | 73              | 0.7089                 | 0.8615              | 0.7778          | 65                  | 0.8718           | 0.9067        | 0.8889    | 150           | 0.6842             | 0.8966          | 0.7761      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.8062            | 0.8889         | 0.8455     | 0.9646           |
| 0.0392        | 60.0  | 6360  | 0.1601          | 0.8333             | 0.8904          | 0.8609      | 73              | 0.6962                 | 0.8462              | 0.7639          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.6579             | 0.8621          | 0.7463      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.8067            | 0.8917         | 0.8471     | 0.9641           |
| 0.0396        | 61.0  | 6466  | 0.1681          | 0.8312             | 0.8767          | 0.8533      | 73              | 0.6591                 | 0.8923              | 0.7582          | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.625              | 0.8621          | 0.7246      | 29              | 0.7778         | 0.8235      | 0.8000  | 34          | 0.7895            | 0.8974         | 0.84       | 0.9621           |
| 0.0402        | 62.0  | 6572  | 0.1676          | 0.8077             | 0.8630          | 0.8344      | 73              | 0.6790                 | 0.8462              | 0.7534          | 65                  | 0.8917           | 0.9333        | 0.9121    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.7778         | 0.8235      | 0.8000  | 34          | 0.7954            | 0.8860         | 0.8383     | 0.9621           |
| 0.0391        | 63.0  | 6678  | 0.1607          | 0.8025             | 0.8904          | 0.8442      | 73              | 0.6707                 | 0.8462              | 0.7483          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6944             | 0.8621          | 0.7692      | 29              | 0.8333         | 0.8824      | 0.8571  | 34          | 0.7924            | 0.8917         | 0.8391     | 0.9641           |
| 0.0378        | 64.0  | 6784  | 0.1592          | 0.8571             | 0.9041          | 0.88        | 73              | 0.6835                 | 0.8308              | 0.75            | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6579             | 0.8621          | 0.7463      | 29              | 0.8286         | 0.8529      | 0.8406  | 34          | 0.8021            | 0.8889         | 0.8432     | 0.9631           |
| 0.0376        | 65.0  | 6890  | 0.1678          | 0.8125             | 0.8904          | 0.8497      | 73              | 0.6875                 | 0.8462              | 0.7586          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.625              | 0.8621          | 0.7246      | 29              | 0.7368         | 0.8235      | 0.7778  | 34          | 0.7879            | 0.8889         | 0.8353     | 0.9619           |
| 0.0369        | 66.0  | 6996  | 0.1692          | 0.8354             | 0.9041          | 0.8684      | 73              | 0.6477                 | 0.8769              | 0.7451          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7836            | 0.8974         | 0.8367     | 0.9606           |
| 0.0366        | 67.0  | 7102  | 0.1676          | 0.8125             | 0.8904          | 0.8497      | 73              | 0.7                    | 0.8615              | 0.7724          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.625              | 0.8621          | 0.7246      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.7944            | 0.8917         | 0.8403     | 0.9628           |
| 0.0353        | 68.0  | 7208  | 0.1710          | 0.8333             | 0.8904          | 0.8609      | 73              | 0.6129                 | 0.8769              | 0.7215          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.625              | 0.8621          | 0.7246      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7696            | 0.8946         | 0.8274     | 0.9596           |
| 0.0342        | 69.0  | 7314  | 0.1653          | 0.8333             | 0.8904          | 0.8609      | 73              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.7929            | 0.8946         | 0.8407     | 0.9646           |
| 0.0339        | 70.0  | 7420  | 0.1682          | 0.825              | 0.9041          | 0.8627      | 73              | 0.6875                 | 0.8462              | 0.7586          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6842             | 0.8966          | 0.7761      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.8015            | 0.8974         | 0.8468     | 0.9641           |
| 0.0358        | 71.0  | 7526  | 0.1757          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6552                 | 0.8769              | 0.75            | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6                | 0.8276          | 0.6957      | 29              | 0.7778         | 0.8235      | 0.8000  | 34          | 0.7805            | 0.8917         | 0.8324     | 0.9616           |
| 0.0333        | 72.0  | 7632  | 0.1739          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6790                 | 0.8462              | 0.7534          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.7995            | 0.8860         | 0.8405     | 0.9638           |
| 0.0346        | 73.0  | 7738  | 0.1735          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.7089                 | 0.8615              | 0.7778          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.8            | 0.8235      | 0.8116  | 34          | 0.8130            | 0.8917         | 0.8505     | 0.9655           |
| 0.033         | 74.0  | 7844  | 0.1750          | 0.8333             | 0.8904          | 0.8609      | 73              | 0.6974                 | 0.8154              | 0.7518          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6154             | 0.8276          | 0.7059      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.7949            | 0.8832         | 0.8367     | 0.9633           |
| 0.0331        | 75.0  | 7950  | 0.1731          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.6867                 | 0.8769              | 0.7703          | 65                  | 0.8846           | 0.92          | 0.9020    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.8036            | 0.8974         | 0.8479     | 0.9628           |
| 0.0342        | 76.0  | 8056  | 0.1732          | 0.825              | 0.9041          | 0.8627      | 73              | 0.6747                 | 0.8615              | 0.7568          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.6667             | 0.8276          | 0.7385      | 29              | 0.8286         | 0.8529      | 0.8406  | 34          | 0.8010            | 0.8946         | 0.8452     | 0.9631           |
| 0.0327        | 77.0  | 8162  | 0.1716          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.7037                 | 0.8769              | 0.7808          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.8571         | 0.8824      | 0.8696  | 34          | 0.8144            | 0.9003         | 0.8552     | 0.9660           |
| 0.0327        | 78.0  | 8268  | 0.1736          | 0.825              | 0.9041          | 0.8627      | 73              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.8529         | 0.8529      | 0.8529  | 34          | 0.7939            | 0.8889         | 0.8387     | 0.9631           |
| 0.0302        | 79.0  | 8374  | 0.1748          | 0.8354             | 0.9041          | 0.8684      | 73              | 0.6747                 | 0.8615              | 0.7568          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6944             | 0.8621          | 0.7692      | 29              | 0.7568         | 0.8235      | 0.7887  | 34          | 0.7944            | 0.8917         | 0.8403     | 0.9633           |
| 0.0299        | 80.0  | 8480  | 0.1755          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.7108                 | 0.9077              | 0.7973          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.6944             | 0.8621          | 0.7692      | 29              | 0.8333         | 0.8824      | 0.8571  | 34          | 0.8154            | 0.9060         | 0.8583     | 0.9646           |
| 0.0316        | 81.0  | 8586  | 0.1735          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6707                 | 0.8462              | 0.7483          | 65                  | 0.8662           | 0.9067        | 0.8860    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.8286         | 0.8529      | 0.8406  | 34          | 0.7964            | 0.8803         | 0.8363     | 0.9633           |
| 0.0294        | 82.0  | 8692  | 0.1731          | 0.8354             | 0.9041          | 0.8684      | 73              | 0.6707                 | 0.8462              | 0.7483          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.8788         | 0.8529      | 0.8657  | 34          | 0.8031            | 0.8946         | 0.8464     | 0.9633           |
| 0.0303        | 83.0  | 8798  | 0.1789          | 0.8312             | 0.8767          | 0.8533      | 73              | 0.6707                 | 0.8462              | 0.7483          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6                | 0.8276          | 0.6957      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7828            | 0.8832         | 0.8300     | 0.9619           |
| 0.0299        | 84.0  | 8904  | 0.1769          | 0.8333             | 0.8904          | 0.8609      | 73              | 0.6790                 | 0.8462              | 0.7534          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.8108         | 0.8824      | 0.8451  | 34          | 0.7970            | 0.8946         | 0.8430     | 0.9638           |
| 0.031         | 85.0  | 9010  | 0.1866          | 0.8333             | 0.8904          | 0.8609      | 73              | 0.6782                 | 0.9077              | 0.7763          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7985            | 0.9031         | 0.8476     | 0.9621           |
| 0.0303        | 86.0  | 9116  | 0.1748          | 0.8289             | 0.8630          | 0.8456      | 73              | 0.6923                 | 0.8308              | 0.7552          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6579             | 0.8621          | 0.7463      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.7969            | 0.8832         | 0.8378     | 0.9628           |
| 0.0302        | 87.0  | 9222  | 0.1736          | 0.8462             | 0.9041          | 0.8742      | 73              | 0.6867                 | 0.8769              | 0.7703          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.8485         | 0.8235      | 0.8358  | 34          | 0.8093            | 0.8946         | 0.8498     | 0.9643           |
| 0.0294        | 88.0  | 9328  | 0.1745          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6951                 | 0.8769              | 0.7755          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.8286         | 0.8529      | 0.8406  | 34          | 0.8135            | 0.8946         | 0.8521     | 0.9653           |
| 0.028         | 89.0  | 9434  | 0.1782          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6914                 | 0.8615              | 0.7671          | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.8051            | 0.8946         | 0.8475     | 0.9636           |
| 0.031         | 90.0  | 9540  | 0.1781          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6829                 | 0.8615              | 0.7619          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.8286         | 0.8529      | 0.8406  | 34          | 0.8026            | 0.8917         | 0.8448     | 0.9636           |
| 0.0296        | 91.0  | 9646  | 0.1821          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6706                 | 0.8769              | 0.76            | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.6154             | 0.8276          | 0.7059      | 29              | 0.8056         | 0.8529      | 0.8286  | 34          | 0.7949            | 0.8946         | 0.8418     | 0.9633           |
| 0.0293        | 92.0  | 9752  | 0.1803          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6786                 | 0.8769              | 0.7651          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7990            | 0.8946         | 0.8441     | 0.9633           |
| 0.0263        | 93.0  | 9858  | 0.1816          | 0.8333             | 0.8904          | 0.8609      | 73              | 0.6786                 | 0.8769              | 0.7651          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6757             | 0.8621          | 0.7576      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7970            | 0.8946         | 0.8430     | 0.9628           |
| 0.0266        | 94.0  | 9964  | 0.1820          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.7024                 | 0.9077              | 0.7919          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.8020            | 0.9003         | 0.8483     | 0.9631           |
| 0.0277        | 95.0  | 10070 | 0.1841          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6941                 | 0.9077              | 0.7867          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7980            | 0.9003         | 0.8461     | 0.9631           |
| 0.0273        | 96.0  | 10176 | 0.1806          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6867                 | 0.8769              | 0.7703          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7970            | 0.8946         | 0.8430     | 0.9633           |
| 0.027         | 97.0  | 10282 | 0.1831          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6706                 | 0.8769              | 0.76            | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6154             | 0.8276          | 0.7059      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7909            | 0.8946         | 0.8396     | 0.9621           |
| 0.0266        | 98.0  | 10388 | 0.1830          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6988                 | 0.8923              | 0.7838          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7995            | 0.8974         | 0.8456     | 0.9628           |
| 0.0273        | 99.0  | 10494 | 0.1830          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6988                 | 0.8923              | 0.7838          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7995            | 0.8974         | 0.8456     | 0.9628           |
| 0.0281        | 100.0 | 10600 | 0.1823          | 0.8442             | 0.8904          | 0.8667      | 73              | 0.6786                 | 0.8769              | 0.7651          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.7949            | 0.8946         | 0.8418     | 0.9626           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2