|
--- |
|
license: mit |
|
base_model: indolem/indobert-base-uncased |
|
tags: |
|
- generated_from_trainer |
|
model-index: |
|
- name: nerugm-lora-r8-2 |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# nerugm-lora-r8-2 |
|
|
|
This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on an unknown dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.1373 |
|
- Location Precision: 0.7229 |
|
- Location Recall: 0.8333 |
|
- Location F1: 0.7742 |
|
- Location Number: 72 |
|
- Organization Precision: 0.7111 |
|
- Organization Recall: 0.8533 |
|
- Organization F1: 0.7758 |
|
- Organization Number: 75 |
|
- Person Precision: 0.8323 |
|
- Person Recall: 0.9371 |
|
- Person F1: 0.8816 |
|
- Person Number: 143 |
|
- Quantity Precision: 0.5 |
|
- Quantity Recall: 0.6957 |
|
- Quantity F1: 0.5818 |
|
- Quantity Number: 23 |
|
- Time Precision: 0.7333 |
|
- Time Recall: 0.8462 |
|
- Time F1: 0.7857 |
|
- Time Number: 26 |
|
- Overall Precision: 0.7475 |
|
- Overall Recall: 0.8732 |
|
- Overall F1: 0.8054 |
|
- Overall Accuracy: 0.9567 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 5e-05 |
|
- train_batch_size: 16 |
|
- eval_batch_size: 64 |
|
- seed: 42 |
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- num_epochs: 100.0 |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy | |
|
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:| |
|
| 1.2425 | 1.0 | 106 | 0.7045 | 0.0 | 0.0 | 0.0 | 72 | 0.0 | 0.0 | 0.0 | 75 | 0.0 | 0.0 | 0.0 | 143 | 0.0 | 0.0 | 0.0 | 23 | 0.0 | 0.0 | 0.0 | 26 | 0.0 | 0.0 | 0.0 | 0.8449 | |
|
| 0.7049 | 2.0 | 212 | 0.5984 | 0.0 | 0.0 | 0.0 | 72 | 0.0 | 0.0 | 0.0 | 75 | 0.0 | 0.0 | 0.0 | 143 | 0.0 | 0.0 | 0.0 | 23 | 0.0 | 0.0 | 0.0 | 26 | 0.0 | 0.0 | 0.0 | 0.8456 | |
|
| 0.6175 | 3.0 | 318 | 0.5003 | 0.0 | 0.0 | 0.0 | 72 | 0.0 | 0.0 | 0.0 | 75 | 0.25 | 0.0280 | 0.0503 | 143 | 0.0 | 0.0 | 0.0 | 23 | 0.0 | 0.0 | 0.0 | 26 | 0.1481 | 0.0118 | 0.0219 | 0.8511 | |
|
| 0.5236 | 4.0 | 424 | 0.4111 | 0.6667 | 0.0833 | 0.1481 | 72 | 0.0556 | 0.0133 | 0.0215 | 75 | 0.4043 | 0.2657 | 0.3207 | 143 | 0.0 | 0.0 | 0.0 | 23 | 0.4706 | 0.3077 | 0.3721 | 26 | 0.3841 | 0.1563 | 0.2222 | 0.8799 | |
|
| 0.4275 | 5.0 | 530 | 0.3293 | 0.5652 | 0.3611 | 0.4407 | 72 | 0.3864 | 0.2267 | 0.2857 | 75 | 0.6323 | 0.6853 | 0.6577 | 143 | 0.0 | 0.0 | 0.0 | 23 | 0.7273 | 0.6154 | 0.6667 | 26 | 0.5607 | 0.4631 | 0.5073 | 0.9134 | |
|
| 0.3439 | 6.0 | 636 | 0.2720 | 0.5833 | 0.5833 | 0.5833 | 72 | 0.4429 | 0.4133 | 0.4276 | 75 | 0.7029 | 0.8601 | 0.7736 | 143 | 0.1923 | 0.2174 | 0.2041 | 23 | 0.6552 | 0.7308 | 0.6909 | 26 | 0.5914 | 0.6490 | 0.6188 | 0.9282 | |
|
| 0.2863 | 7.0 | 742 | 0.2361 | 0.6386 | 0.7361 | 0.6839 | 72 | 0.5065 | 0.52 | 0.5132 | 75 | 0.7399 | 0.8951 | 0.8101 | 143 | 0.2667 | 0.3478 | 0.3019 | 23 | 0.6897 | 0.7692 | 0.7273 | 26 | 0.6327 | 0.7316 | 0.6785 | 0.9332 | |
|
| 0.2491 | 8.0 | 848 | 0.2097 | 0.6951 | 0.7917 | 0.7403 | 72 | 0.5269 | 0.6533 | 0.5833 | 75 | 0.7588 | 0.9021 | 0.8243 | 143 | 0.2667 | 0.3478 | 0.3019 | 23 | 0.6897 | 0.7692 | 0.7273 | 26 | 0.6510 | 0.7758 | 0.7079 | 0.9377 | |
|
| 0.2268 | 9.0 | 954 | 0.1984 | 0.7176 | 0.8472 | 0.7771 | 72 | 0.5052 | 0.6533 | 0.5698 | 75 | 0.7602 | 0.9091 | 0.8280 | 143 | 0.3704 | 0.4348 | 0.4000 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.6610 | 0.7994 | 0.7236 | 0.9390 | |
|
| 0.2079 | 10.0 | 1060 | 0.1859 | 0.7126 | 0.8611 | 0.7799 | 72 | 0.5104 | 0.6533 | 0.5731 | 75 | 0.7616 | 0.9161 | 0.8317 | 143 | 0.3939 | 0.5652 | 0.4643 | 23 | 0.6774 | 0.8077 | 0.7368 | 26 | 0.6587 | 0.8142 | 0.7282 | 0.9402 | |
|
| 0.196 | 11.0 | 1166 | 0.1741 | 0.7381 | 0.8611 | 0.7949 | 72 | 0.5294 | 0.72 | 0.6102 | 75 | 0.7588 | 0.9021 | 0.8243 | 143 | 0.3714 | 0.5652 | 0.4483 | 23 | 0.6562 | 0.8077 | 0.7241 | 26 | 0.6596 | 0.8230 | 0.7323 | 0.9425 | |
|
| 0.1883 | 12.0 | 1272 | 0.1675 | 0.7317 | 0.8333 | 0.7792 | 72 | 0.5591 | 0.6933 | 0.6190 | 75 | 0.7692 | 0.9091 | 0.8333 | 143 | 0.4828 | 0.6087 | 0.5385 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.6873 | 0.8171 | 0.7466 | 0.9445 | |
|
| 0.1791 | 13.0 | 1378 | 0.1607 | 0.7692 | 0.8333 | 0.8 | 72 | 0.5545 | 0.7467 | 0.6364 | 75 | 0.7811 | 0.9231 | 0.8462 | 143 | 0.4333 | 0.5652 | 0.4906 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.6912 | 0.8319 | 0.7550 | 0.9475 | |
|
| 0.1739 | 14.0 | 1484 | 0.1563 | 0.7733 | 0.8056 | 0.7891 | 72 | 0.5481 | 0.76 | 0.6369 | 75 | 0.8137 | 0.9161 | 0.8618 | 143 | 0.4286 | 0.5217 | 0.4706 | 23 | 0.7241 | 0.8077 | 0.7636 | 26 | 0.7028 | 0.8230 | 0.7582 | 0.9482 | |
|
| 0.1715 | 15.0 | 1590 | 0.1506 | 0.7692 | 0.8333 | 0.8 | 72 | 0.5670 | 0.7333 | 0.6395 | 75 | 0.8199 | 0.9231 | 0.8684 | 143 | 0.5 | 0.6087 | 0.5490 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.7157 | 0.8319 | 0.7694 | 0.9510 | |
|
| 0.164 | 16.0 | 1696 | 0.1555 | 0.7375 | 0.8194 | 0.7763 | 72 | 0.5648 | 0.8133 | 0.6667 | 75 | 0.8049 | 0.9231 | 0.8599 | 143 | 0.6 | 0.7826 | 0.6792 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7087 | 0.8614 | 0.7776 | 0.9507 | |
|
| 0.1562 | 17.0 | 1802 | 0.1546 | 0.7381 | 0.8611 | 0.7949 | 72 | 0.5882 | 0.8 | 0.6780 | 75 | 0.8049 | 0.9231 | 0.8599 | 143 | 0.5758 | 0.8261 | 0.6786 | 23 | 0.6774 | 0.8077 | 0.7368 | 26 | 0.7101 | 0.8673 | 0.7809 | 0.9517 | |
|
| 0.1566 | 18.0 | 1908 | 0.1545 | 0.7349 | 0.8472 | 0.7871 | 72 | 0.5556 | 0.8 | 0.6557 | 75 | 0.7927 | 0.9091 | 0.8469 | 143 | 0.6129 | 0.8261 | 0.7037 | 23 | 0.7097 | 0.8462 | 0.7719 | 26 | 0.7002 | 0.8614 | 0.7725 | 0.9507 | |
|
| 0.1515 | 19.0 | 2014 | 0.1474 | 0.7195 | 0.8194 | 0.7662 | 72 | 0.6129 | 0.76 | 0.6786 | 75 | 0.7904 | 0.9231 | 0.8516 | 143 | 0.5758 | 0.8261 | 0.6786 | 23 | 0.7419 | 0.8846 | 0.8070 | 26 | 0.7143 | 0.8555 | 0.7785 | 0.9527 | |
|
| 0.1462 | 20.0 | 2120 | 0.1590 | 0.7093 | 0.8472 | 0.7722 | 72 | 0.5439 | 0.8267 | 0.6561 | 75 | 0.7844 | 0.9161 | 0.8452 | 143 | 0.5758 | 0.8261 | 0.6786 | 23 | 0.6875 | 0.8462 | 0.7586 | 26 | 0.6829 | 0.8702 | 0.7652 | 0.9477 | |
|
| 0.147 | 21.0 | 2226 | 0.1474 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6289 | 0.8133 | 0.7093 | 75 | 0.8061 | 0.9301 | 0.8636 | 143 | 0.6 | 0.7826 | 0.6792 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7284 | 0.8702 | 0.7930 | 0.9552 | |
|
| 0.1439 | 22.0 | 2332 | 0.1480 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.5962 | 0.8267 | 0.6927 | 75 | 0.8110 | 0.9301 | 0.8664 | 143 | 0.5938 | 0.8261 | 0.6909 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7251 | 0.8791 | 0.7947 | 0.9537 | |
|
| 0.1409 | 23.0 | 2438 | 0.1461 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.5905 | 0.8267 | 0.6889 | 75 | 0.8110 | 0.9301 | 0.8664 | 143 | 0.6129 | 0.8261 | 0.7037 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7251 | 0.8791 | 0.7947 | 0.9545 | |
|
| 0.1404 | 24.0 | 2544 | 0.1476 | 0.7262 | 0.8472 | 0.7821 | 72 | 0.6019 | 0.8267 | 0.6966 | 75 | 0.8272 | 0.9371 | 0.8787 | 143 | 0.5938 | 0.8261 | 0.6909 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7275 | 0.8820 | 0.7973 | 0.9545 | |
|
| 0.1389 | 25.0 | 2650 | 0.1446 | 0.7407 | 0.8333 | 0.7843 | 72 | 0.6196 | 0.76 | 0.6826 | 75 | 0.8272 | 0.9371 | 0.8787 | 143 | 0.5938 | 0.8261 | 0.6909 | 23 | 0.7419 | 0.8846 | 0.8070 | 26 | 0.7362 | 0.8643 | 0.7951 | 0.9552 | |
|
| 0.1364 | 26.0 | 2756 | 0.1441 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6263 | 0.8267 | 0.7126 | 75 | 0.8221 | 0.9371 | 0.8758 | 143 | 0.5758 | 0.8261 | 0.6786 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7279 | 0.8761 | 0.7952 | 0.9547 | |
|
| 0.1312 | 27.0 | 2862 | 0.1471 | 0.7262 | 0.8472 | 0.7821 | 72 | 0.6705 | 0.7867 | 0.7239 | 75 | 0.8385 | 0.9441 | 0.8882 | 143 | 0.5758 | 0.8261 | 0.6786 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.75 | 0.8761 | 0.8082 | 0.9562 | |
|
| 0.1322 | 28.0 | 2968 | 0.1390 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.6593 | 0.8 | 0.7229 | 75 | 0.8199 | 0.9231 | 0.8684 | 143 | 0.5806 | 0.7826 | 0.6667 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7462 | 0.8673 | 0.8022 | 0.9565 | |
|
| 0.132 | 29.0 | 3074 | 0.1382 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.6105 | 0.7733 | 0.6824 | 75 | 0.8438 | 0.9441 | 0.8911 | 143 | 0.5806 | 0.7826 | 0.6667 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7431 | 0.8702 | 0.8016 | 0.9562 | |
|
| 0.1343 | 30.0 | 3180 | 0.1431 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.6224 | 0.8133 | 0.7052 | 75 | 0.8385 | 0.9441 | 0.8882 | 143 | 0.5806 | 0.7826 | 0.6667 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7431 | 0.8791 | 0.8054 | 0.9560 | |
|
| 0.1269 | 31.0 | 3286 | 0.1384 | 0.7439 | 0.8472 | 0.7922 | 72 | 0.6452 | 0.8 | 0.7143 | 75 | 0.8385 | 0.9441 | 0.8882 | 143 | 0.5806 | 0.7826 | 0.6667 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7481 | 0.8761 | 0.8071 | 0.9565 | |
|
| 0.1254 | 32.0 | 3392 | 0.1354 | 0.7439 | 0.8472 | 0.7922 | 72 | 0.6186 | 0.8 | 0.6977 | 75 | 0.8438 | 0.9441 | 0.8911 | 143 | 0.5806 | 0.7826 | 0.6667 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7425 | 0.8761 | 0.8038 | 0.9565 | |
|
| 0.1235 | 33.0 | 3498 | 0.1374 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6452 | 0.8 | 0.7143 | 75 | 0.8438 | 0.9441 | 0.8911 | 143 | 0.5625 | 0.7826 | 0.6545 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7437 | 0.8732 | 0.8033 | 0.9562 | |
|
| 0.1209 | 34.0 | 3604 | 0.1420 | 0.7407 | 0.8333 | 0.7843 | 72 | 0.6186 | 0.8 | 0.6977 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7368 | 0.8673 | 0.7967 | 0.9552 | |
|
| 0.1259 | 35.0 | 3710 | 0.1349 | 0.7407 | 0.8333 | 0.7843 | 72 | 0.625 | 0.8 | 0.7018 | 75 | 0.8418 | 0.9301 | 0.8837 | 143 | 0.5806 | 0.7826 | 0.6667 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7424 | 0.8673 | 0.8000 | 0.9565 | |
|
| 0.1202 | 36.0 | 3816 | 0.1339 | 0.75 | 0.8333 | 0.7895 | 72 | 0.6782 | 0.7867 | 0.7284 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5484 | 0.7391 | 0.6296 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.7552 | 0.8643 | 0.8061 | 0.9580 | |
|
| 0.1196 | 37.0 | 3922 | 0.1388 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.6040 | 0.8133 | 0.6932 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7302 | 0.8702 | 0.7941 | 0.9547 | |
|
| 0.1162 | 38.0 | 4028 | 0.1404 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.5980 | 0.8133 | 0.6893 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7284 | 0.8702 | 0.7930 | 0.9540 | |
|
| 0.1151 | 39.0 | 4134 | 0.1357 | 0.7625 | 0.8472 | 0.8026 | 72 | 0.6522 | 0.8 | 0.7186 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7931 | 0.8846 | 0.8364 | 26 | 0.7487 | 0.8702 | 0.8049 | 0.9570 | |
|
| 0.1168 | 40.0 | 4240 | 0.1354 | 0.75 | 0.8333 | 0.7895 | 72 | 0.6667 | 0.8 | 0.7273 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7667 | 0.8846 | 0.8214 | 26 | 0.75 | 0.8673 | 0.8044 | 0.9570 | |
|
| 0.1155 | 41.0 | 4346 | 0.1387 | 0.75 | 0.8333 | 0.7895 | 72 | 0.6289 | 0.8133 | 0.7093 | 75 | 0.8261 | 0.9301 | 0.8750 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7325 | 0.8643 | 0.7930 | 0.9545 | |
|
| 0.1154 | 42.0 | 4452 | 0.1389 | 0.7407 | 0.8333 | 0.7843 | 72 | 0.6316 | 0.8 | 0.7059 | 75 | 0.8210 | 0.9301 | 0.8721 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7282 | 0.8614 | 0.7892 | 0.9542 | |
|
| 0.1122 | 43.0 | 4558 | 0.1368 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.6596 | 0.8267 | 0.7337 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7456 | 0.8732 | 0.8043 | 0.9567 | |
|
| 0.1136 | 44.0 | 4664 | 0.1360 | 0.7625 | 0.8472 | 0.8026 | 72 | 0.6522 | 0.8 | 0.7186 | 75 | 0.8438 | 0.9441 | 0.8911 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7462 | 0.8673 | 0.8022 | 0.9557 | |
|
| 0.1114 | 45.0 | 4770 | 0.1414 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.6289 | 0.8133 | 0.7093 | 75 | 0.8323 | 0.9371 | 0.8816 | 143 | 0.5455 | 0.7826 | 0.6429 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7363 | 0.8732 | 0.7989 | 0.9542 | |
|
| 0.1108 | 46.0 | 4876 | 0.1366 | 0.7439 | 0.8472 | 0.7922 | 72 | 0.6630 | 0.8133 | 0.7305 | 75 | 0.8323 | 0.9371 | 0.8816 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7412 | 0.8702 | 0.8005 | 0.9557 | |
|
| 0.1106 | 47.0 | 4982 | 0.1407 | 0.7625 | 0.8472 | 0.8026 | 72 | 0.6040 | 0.8133 | 0.6932 | 75 | 0.8323 | 0.9371 | 0.8816 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.7259 | 0.8673 | 0.7903 | 0.9532 | |
|
| 0.1101 | 48.0 | 5088 | 0.1329 | 0.75 | 0.8333 | 0.7895 | 72 | 0.6344 | 0.7867 | 0.7024 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5161 | 0.6957 | 0.5926 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7386 | 0.8584 | 0.7940 | 0.9565 | |
|
| 0.1085 | 49.0 | 5194 | 0.1372 | 0.7470 | 0.8611 | 0.8 | 72 | 0.6327 | 0.8267 | 0.7168 | 75 | 0.8365 | 0.9301 | 0.8808 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7363 | 0.8732 | 0.7989 | 0.9555 | |
|
| 0.1072 | 50.0 | 5300 | 0.1309 | 0.7407 | 0.8333 | 0.7843 | 72 | 0.6629 | 0.7867 | 0.7195 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.7417 | 0.8555 | 0.7945 | 0.9567 | |
|
| 0.1058 | 51.0 | 5406 | 0.1300 | 0.7407 | 0.8333 | 0.7843 | 72 | 0.6484 | 0.7867 | 0.7108 | 75 | 0.8481 | 0.9371 | 0.8904 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7423 | 0.8584 | 0.7962 | 0.9567 | |
|
| 0.1059 | 52.0 | 5512 | 0.1321 | 0.75 | 0.8333 | 0.7895 | 72 | 0.6593 | 0.8 | 0.7229 | 75 | 0.8354 | 0.9231 | 0.8771 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7417 | 0.8555 | 0.7945 | 0.9560 | |
|
| 0.1041 | 53.0 | 5618 | 0.1347 | 0.7439 | 0.8472 | 0.7922 | 72 | 0.6489 | 0.8133 | 0.7219 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.7406 | 0.8673 | 0.7989 | 0.9560 | |
|
| 0.105 | 54.0 | 5724 | 0.1324 | 0.75 | 0.8333 | 0.7895 | 72 | 0.6383 | 0.8 | 0.7101 | 75 | 0.8471 | 0.9301 | 0.8867 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.7379 | 0.8555 | 0.7923 | 0.9552 | |
|
| 0.1079 | 55.0 | 5830 | 0.1412 | 0.7407 | 0.8333 | 0.7843 | 72 | 0.6364 | 0.84 | 0.7241 | 75 | 0.8261 | 0.9301 | 0.8750 | 143 | 0.5 | 0.7391 | 0.5965 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.7259 | 0.8673 | 0.7903 | 0.9547 | |
|
| 0.106 | 56.0 | 5936 | 0.1348 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.6316 | 0.8 | 0.7059 | 75 | 0.8408 | 0.9231 | 0.8800 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.7348 | 0.8584 | 0.7918 | 0.9557 | |
|
| 0.1052 | 57.0 | 6042 | 0.1323 | 0.7439 | 0.8472 | 0.7922 | 72 | 0.6667 | 0.8 | 0.7273 | 75 | 0.8408 | 0.9231 | 0.8800 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7468 | 0.8614 | 0.8000 | 0.9562 | |
|
| 0.1027 | 58.0 | 6148 | 0.1358 | 0.7531 | 0.8472 | 0.7974 | 72 | 0.6526 | 0.8267 | 0.7294 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7456 | 0.8732 | 0.8043 | 0.9560 | |
|
| 0.1015 | 59.0 | 6254 | 0.1332 | 0.7407 | 0.8333 | 0.7843 | 72 | 0.6489 | 0.8133 | 0.7219 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7424 | 0.8673 | 0.8000 | 0.9562 | |
|
| 0.104 | 60.0 | 6360 | 0.1366 | 0.7317 | 0.8333 | 0.7792 | 72 | 0.6702 | 0.84 | 0.7456 | 75 | 0.8365 | 0.9301 | 0.8808 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7412 | 0.8702 | 0.8005 | 0.9557 | |
|
| 0.1032 | 61.0 | 6466 | 0.1355 | 0.7375 | 0.8194 | 0.7763 | 72 | 0.6882 | 0.8533 | 0.7619 | 75 | 0.8313 | 0.9301 | 0.8779 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7487 | 0.8702 | 0.8049 | 0.9565 | |
|
| 0.0997 | 62.0 | 6572 | 0.1353 | 0.7595 | 0.8333 | 0.7947 | 72 | 0.6848 | 0.84 | 0.7545 | 75 | 0.8313 | 0.9301 | 0.8779 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7526 | 0.8702 | 0.8071 | 0.9572 | |
|
| 0.1013 | 63.0 | 6678 | 0.1328 | 0.7595 | 0.8333 | 0.7947 | 72 | 0.6452 | 0.8 | 0.7143 | 75 | 0.8365 | 0.9301 | 0.8808 | 143 | 0.5484 | 0.7391 | 0.6296 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7468 | 0.8614 | 0.8000 | 0.9572 | |
|
| 0.099 | 64.0 | 6784 | 0.1428 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6566 | 0.8667 | 0.7471 | 75 | 0.8221 | 0.9371 | 0.8758 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7 | 0.8077 | 0.75 | 26 | 0.7279 | 0.8761 | 0.7952 | 0.9542 | |
|
| 0.0979 | 65.0 | 6890 | 0.1324 | 0.7595 | 0.8333 | 0.7947 | 72 | 0.6889 | 0.8267 | 0.7515 | 75 | 0.8481 | 0.9371 | 0.8904 | 143 | 0.5484 | 0.7391 | 0.6296 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7603 | 0.8702 | 0.8116 | 0.9577 | |
|
| 0.0956 | 66.0 | 6996 | 0.1387 | 0.7317 | 0.8333 | 0.7792 | 72 | 0.6957 | 0.8533 | 0.7665 | 75 | 0.8221 | 0.9371 | 0.8758 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7425 | 0.8761 | 0.8038 | 0.9560 | |
|
| 0.1005 | 67.0 | 7102 | 0.1353 | 0.7375 | 0.8194 | 0.7763 | 72 | 0.6848 | 0.84 | 0.7545 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7468 | 0.8702 | 0.8038 | 0.9567 | |
|
| 0.0985 | 68.0 | 7208 | 0.1388 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6526 | 0.8267 | 0.7294 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7357 | 0.8702 | 0.7973 | 0.9562 | |
|
| 0.0986 | 69.0 | 7314 | 0.1344 | 0.7407 | 0.8333 | 0.7843 | 72 | 0.6923 | 0.84 | 0.7590 | 75 | 0.8481 | 0.9371 | 0.8904 | 143 | 0.5333 | 0.6957 | 0.6038 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7584 | 0.8702 | 0.8104 | 0.9572 | |
|
| 0.1004 | 70.0 | 7420 | 0.1338 | 0.7468 | 0.8194 | 0.7815 | 72 | 0.6957 | 0.8533 | 0.7665 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5161 | 0.6957 | 0.5926 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7564 | 0.8702 | 0.8093 | 0.9577 | |
|
| 0.0977 | 71.0 | 7526 | 0.1355 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.7033 | 0.8533 | 0.7711 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7519 | 0.8761 | 0.8093 | 0.9567 | |
|
| 0.0979 | 72.0 | 7632 | 0.1375 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6957 | 0.8533 | 0.7665 | 75 | 0.8323 | 0.9371 | 0.8816 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7444 | 0.8761 | 0.8049 | 0.9560 | |
|
| 0.0975 | 73.0 | 7738 | 0.1335 | 0.7375 | 0.8194 | 0.7763 | 72 | 0.6882 | 0.8533 | 0.7619 | 75 | 0.8481 | 0.9371 | 0.8904 | 143 | 0.5333 | 0.6957 | 0.6038 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7564 | 0.8702 | 0.8093 | 0.9575 | |
|
| 0.0949 | 74.0 | 7844 | 0.1419 | 0.7143 | 0.8333 | 0.7692 | 72 | 0.6737 | 0.8533 | 0.7529 | 75 | 0.8323 | 0.9371 | 0.8816 | 143 | 0.5152 | 0.7391 | 0.6071 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7370 | 0.8761 | 0.8005 | 0.9560 | |
|
| 0.0963 | 75.0 | 7950 | 0.1384 | 0.7195 | 0.8194 | 0.7662 | 72 | 0.6737 | 0.8533 | 0.7529 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5484 | 0.7391 | 0.6296 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7437 | 0.8732 | 0.8033 | 0.9565 | |
|
| 0.0971 | 76.0 | 8056 | 0.1379 | 0.7317 | 0.8333 | 0.7792 | 72 | 0.6667 | 0.8533 | 0.7485 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5484 | 0.7391 | 0.6296 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7444 | 0.8761 | 0.8049 | 0.9567 | |
|
| 0.0947 | 77.0 | 8162 | 0.1363 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.7033 | 0.8533 | 0.7711 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5484 | 0.7391 | 0.6296 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7538 | 0.8761 | 0.8104 | 0.9575 | |
|
| 0.094 | 78.0 | 8268 | 0.1353 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6957 | 0.8533 | 0.7665 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5161 | 0.6957 | 0.5926 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7513 | 0.8732 | 0.8076 | 0.9575 | |
|
| 0.0952 | 79.0 | 8374 | 0.1336 | 0.7195 | 0.8194 | 0.7662 | 72 | 0.7033 | 0.8533 | 0.7711 | 75 | 0.8535 | 0.9371 | 0.8933 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7570 | 0.8732 | 0.8110 | 0.9575 | |
|
| 0.093 | 80.0 | 8480 | 0.1440 | 0.7143 | 0.8333 | 0.7692 | 72 | 0.6735 | 0.88 | 0.7630 | 75 | 0.8272 | 0.9371 | 0.8787 | 143 | 0.5 | 0.7391 | 0.5965 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7328 | 0.8820 | 0.8005 | 0.9557 | |
|
| 0.0945 | 81.0 | 8586 | 0.1354 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.7033 | 0.8533 | 0.7711 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5484 | 0.7391 | 0.6296 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7538 | 0.8761 | 0.8104 | 0.9575 | |
|
| 0.0932 | 82.0 | 8692 | 0.1381 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6809 | 0.8533 | 0.7574 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5484 | 0.7391 | 0.6296 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7462 | 0.8761 | 0.8060 | 0.9567 | |
|
| 0.0934 | 83.0 | 8798 | 0.1354 | 0.7317 | 0.8333 | 0.7792 | 72 | 0.6923 | 0.84 | 0.7590 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5161 | 0.6957 | 0.5926 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7506 | 0.8702 | 0.8060 | 0.9572 | |
|
| 0.0932 | 84.0 | 8904 | 0.1367 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.7079 | 0.84 | 0.7683 | 75 | 0.8313 | 0.9301 | 0.8779 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7462 | 0.8673 | 0.8022 | 0.9570 | |
|
| 0.0945 | 85.0 | 9010 | 0.1354 | 0.7195 | 0.8194 | 0.7662 | 72 | 0.7159 | 0.84 | 0.7730 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7519 | 0.8673 | 0.8055 | 0.9572 | |
|
| 0.0957 | 86.0 | 9116 | 0.1360 | 0.7195 | 0.8194 | 0.7662 | 72 | 0.7159 | 0.84 | 0.7730 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7545 | 0.8702 | 0.8082 | 0.9575 | |
|
| 0.0914 | 87.0 | 9222 | 0.1359 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6774 | 0.84 | 0.75 | 75 | 0.8428 | 0.9371 | 0.8874 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7449 | 0.8702 | 0.8027 | 0.9572 | |
|
| 0.0922 | 88.0 | 9328 | 0.1377 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6809 | 0.8533 | 0.7574 | 75 | 0.8313 | 0.9301 | 0.8779 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7419 | 0.8732 | 0.8022 | 0.9565 | |
|
| 0.0929 | 89.0 | 9434 | 0.1370 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6957 | 0.8533 | 0.7665 | 75 | 0.8313 | 0.9301 | 0.8779 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7449 | 0.8702 | 0.8027 | 0.9570 | |
|
| 0.0921 | 90.0 | 9540 | 0.1369 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6957 | 0.8533 | 0.7665 | 75 | 0.8313 | 0.9301 | 0.8779 | 143 | 0.5484 | 0.7391 | 0.6296 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7475 | 0.8732 | 0.8054 | 0.9570 | |
|
| 0.0932 | 91.0 | 9646 | 0.1368 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.7111 | 0.8533 | 0.7758 | 75 | 0.8313 | 0.9301 | 0.8779 | 143 | 0.5312 | 0.7391 | 0.6182 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7494 | 0.8732 | 0.8065 | 0.9570 | |
|
| 0.0949 | 92.0 | 9752 | 0.1357 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.7111 | 0.8533 | 0.7758 | 75 | 0.8375 | 0.9371 | 0.8845 | 143 | 0.5161 | 0.6957 | 0.5926 | 23 | 0.7586 | 0.8462 | 0.8 | 26 | 0.7532 | 0.8732 | 0.8087 | 0.9577 | |
|
| 0.0914 | 93.0 | 9858 | 0.1363 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6957 | 0.8533 | 0.7665 | 75 | 0.8313 | 0.9301 | 0.8779 | 143 | 0.4848 | 0.6957 | 0.5714 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7412 | 0.8702 | 0.8005 | 0.9562 | |
|
| 0.0897 | 94.0 | 9964 | 0.1370 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.7033 | 0.8533 | 0.7711 | 75 | 0.8261 | 0.9301 | 0.8750 | 143 | 0.4706 | 0.6957 | 0.5614 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7393 | 0.8702 | 0.7995 | 0.9562 | |
|
| 0.0915 | 95.0 | 10070 | 0.1380 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6915 | 0.8667 | 0.7692 | 75 | 0.8261 | 0.9301 | 0.8750 | 143 | 0.4706 | 0.6957 | 0.5614 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7363 | 0.8732 | 0.7989 | 0.9565 | |
|
| 0.0925 | 96.0 | 10176 | 0.1372 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6957 | 0.8533 | 0.7665 | 75 | 0.8261 | 0.9301 | 0.8750 | 143 | 0.4848 | 0.6957 | 0.5714 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7393 | 0.8702 | 0.7995 | 0.9562 | |
|
| 0.0921 | 97.0 | 10282 | 0.1372 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6957 | 0.8533 | 0.7665 | 75 | 0.8323 | 0.9371 | 0.8816 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7437 | 0.8732 | 0.8033 | 0.9567 | |
|
| 0.091 | 98.0 | 10388 | 0.1372 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.6957 | 0.8533 | 0.7665 | 75 | 0.8323 | 0.9371 | 0.8816 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7437 | 0.8732 | 0.8033 | 0.9567 | |
|
| 0.0927 | 99.0 | 10494 | 0.1372 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.7033 | 0.8533 | 0.7711 | 75 | 0.8323 | 0.9371 | 0.8816 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7456 | 0.8732 | 0.8043 | 0.9565 | |
|
| 0.0918 | 100.0 | 10600 | 0.1373 | 0.7229 | 0.8333 | 0.7742 | 72 | 0.7111 | 0.8533 | 0.7758 | 75 | 0.8323 | 0.9371 | 0.8816 | 143 | 0.5 | 0.6957 | 0.5818 | 23 | 0.7333 | 0.8462 | 0.7857 | 26 | 0.7475 | 0.8732 | 0.8054 | 0.9567 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.39.3 |
|
- Pytorch 2.3.0+cu121 |
|
- Datasets 2.19.1 |
|
- Tokenizers 0.15.2 |
|
|