File size: 43,668 Bytes
64f60c4 0de9c53 64f60c4 0de9c53 64f60c4 0de9c53 64f60c4 0de9c53 64f60c4 0de9c53 64f60c4 0de9c53 64f60c4 0de9c53 64f60c4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 |
---
base_model: Qwen/Qwen2-7B
library_name: peft
license: apache-2.0
tags:
- generated_from_trainer
model-index:
- name: legal_qwen
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# legal_qwen
This model is a fine-tuned version of [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 1.0383
- Law Precision: 0.62
- Law Recall: 0.8378
- Law F1: 0.7126
- Law Number: 74
- Violated by Precision: 0.5253
- Violated by Recall: 0.7222
- Violated by F1: 0.6082
- Violated by Number: 72
- Violated on Precision: 0.35
- Violated on Recall: 0.4286
- Violated on F1: 0.3853
- Violated on Number: 49
- Violation Precision: 0.3881
- Violation Recall: 0.5386
- Violation F1: 0.4512
- Violation Number: 596
- Overall Precision: 0.4199
- Overall Recall: 0.5765
- Overall F1: 0.4859
- Overall Accuracy: 0.9180
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100
### Training results
| Training Loss | Epoch | Step | Validation Loss | Law Precision | Law Recall | Law F1 | Law Number | Violated by Precision | Violated by Recall | Violated by F1 | Violated by Number | Violated on Precision | Violated on Recall | Violated on F1 | Violated on Number | Violation Precision | Violation Recall | Violation F1 | Violation Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:----:|:---------------:|:-------------:|:----------:|:------:|:----------:|:---------------------:|:------------------:|:--------------:|:------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------:|:--------------:|:----------:|:----------------:|
| No log | 1.0 | 45 | 0.6704 | 0.0323 | 0.0135 | 0.0190 | 74 | 0.0 | 0.0 | 0.0 | 72 | 0.0 | 0.0 | 0.0 | 49 | 0.0108 | 0.0319 | 0.0161 | 596 | 0.0110 | 0.0253 | 0.0153 | 0.7892 |
| No log | 2.0 | 90 | 0.4076 | 0.1795 | 0.1892 | 0.1842 | 74 | 0.2041 | 0.1389 | 0.1653 | 72 | 0.0 | 0.0 | 0.0 | 49 | 0.0865 | 0.1544 | 0.1109 | 596 | 0.0971 | 0.1466 | 0.1168 | 0.8655 |
| No log | 3.0 | 135 | 0.3604 | 0.2936 | 0.4324 | 0.3497 | 74 | 0.2887 | 0.3889 | 0.3314 | 72 | 0.1139 | 0.1837 | 0.1406 | 49 | 0.2060 | 0.3691 | 0.2644 | 596 | 0.2136 | 0.3654 | 0.2696 | 0.8854 |
| No log | 4.0 | 180 | 0.3332 | 0.3279 | 0.2703 | 0.2963 | 74 | 0.4648 | 0.4583 | 0.4615 | 72 | 0.1149 | 0.2041 | 0.1471 | 49 | 0.2134 | 0.3356 | 0.2609 | 596 | 0.2275 | 0.3325 | 0.2702 | 0.8958 |
| No log | 5.0 | 225 | 0.3371 | 0.4216 | 0.5811 | 0.4886 | 74 | 0.4190 | 0.6111 | 0.4972 | 72 | 0.1558 | 0.2449 | 0.1905 | 49 | 0.2816 | 0.4144 | 0.3354 | 596 | 0.2980 | 0.4374 | 0.3545 | 0.9058 |
| No log | 6.0 | 270 | 0.4870 | 0.4690 | 0.7162 | 0.5668 | 74 | 0.2806 | 0.5417 | 0.3697 | 72 | 0.1182 | 0.2653 | 0.1635 | 49 | 0.3350 | 0.5503 | 0.4165 | 596 | 0.3229 | 0.5474 | 0.4062 | 0.8931 |
| No log | 7.0 | 315 | 0.4646 | 0.4898 | 0.6486 | 0.5581 | 74 | 0.4190 | 0.6111 | 0.4972 | 72 | 0.1831 | 0.2653 | 0.2167 | 49 | 0.3071 | 0.4195 | 0.3546 | 596 | 0.3263 | 0.4488 | 0.3779 | 0.9071 |
| No log | 8.0 | 360 | 0.4911 | 0.5327 | 0.7703 | 0.6298 | 74 | 0.4231 | 0.6111 | 0.5 | 72 | 0.1616 | 0.3265 | 0.2162 | 49 | 0.3518 | 0.5218 | 0.4203 | 596 | 0.3585 | 0.5411 | 0.4312 | 0.9072 |
| No log | 9.0 | 405 | 0.5094 | 0.5179 | 0.7838 | 0.6237 | 74 | 0.3721 | 0.6667 | 0.4776 | 72 | 0.2632 | 0.4082 | 0.32 | 49 | 0.3204 | 0.4849 | 0.3858 | 596 | 0.3404 | 0.5247 | 0.4129 | 0.9064 |
| No log | 10.0 | 450 | 0.4695 | 0.6180 | 0.7432 | 0.6748 | 74 | 0.5172 | 0.625 | 0.5660 | 72 | 0.2090 | 0.2857 | 0.2414 | 49 | 0.2876 | 0.4295 | 0.3445 | 596 | 0.3266 | 0.4678 | 0.3846 | 0.9103 |
| No log | 11.0 | 495 | 0.5086 | 0.6042 | 0.7838 | 0.6824 | 74 | 0.5 | 0.6528 | 0.5663 | 72 | 0.2537 | 0.3469 | 0.2931 | 49 | 0.3303 | 0.4866 | 0.3935 | 596 | 0.3630 | 0.5209 | 0.4278 | 0.9135 |
| 0.3466 | 12.0 | 540 | 0.5226 | 0.6629 | 0.7973 | 0.7239 | 74 | 0.4667 | 0.6806 | 0.5537 | 72 | 0.1379 | 0.2449 | 0.1765 | 49 | 0.3281 | 0.4916 | 0.3936 | 596 | 0.3518 | 0.5221 | 0.4204 | 0.9140 |
| 0.3466 | 13.0 | 585 | 0.5519 | 0.5490 | 0.7568 | 0.6364 | 74 | 0.4122 | 0.75 | 0.5320 | 72 | 0.2424 | 0.3265 | 0.2783 | 49 | 0.3381 | 0.5168 | 0.4088 | 596 | 0.3587 | 0.5487 | 0.4338 | 0.9110 |
| 0.3466 | 14.0 | 630 | 0.6075 | 0.4957 | 0.7703 | 0.6032 | 74 | 0.4215 | 0.7083 | 0.5285 | 72 | 0.2346 | 0.3878 | 0.2923 | 49 | 0.3681 | 0.5453 | 0.4395 | 596 | 0.3767 | 0.5714 | 0.4540 | 0.9142 |
| 0.3466 | 15.0 | 675 | 0.6533 | 0.6905 | 0.7838 | 0.7342 | 74 | 0.4659 | 0.5694 | 0.5125 | 72 | 0.24 | 0.2449 | 0.2424 | 49 | 0.3459 | 0.4614 | 0.3954 | 596 | 0.3795 | 0.4880 | 0.4270 | 0.9123 |
| 0.3466 | 16.0 | 720 | 0.6310 | 0.5534 | 0.7703 | 0.6441 | 74 | 0.5096 | 0.7361 | 0.6023 | 72 | 0.2024 | 0.3469 | 0.2556 | 49 | 0.3502 | 0.5117 | 0.4158 | 596 | 0.3718 | 0.5461 | 0.4424 | 0.9171 |
| 0.3466 | 17.0 | 765 | 0.7060 | 0.5234 | 0.7568 | 0.6188 | 74 | 0.4561 | 0.7222 | 0.5591 | 72 | 0.2308 | 0.3673 | 0.2835 | 49 | 0.3566 | 0.5487 | 0.4323 | 596 | 0.3725 | 0.5727 | 0.4514 | 0.9102 |
| 0.3466 | 18.0 | 810 | 0.6275 | 0.5514 | 0.7973 | 0.6519 | 74 | 0.5306 | 0.7222 | 0.6118 | 72 | 0.2537 | 0.3469 | 0.2931 | 49 | 0.3589 | 0.5017 | 0.4185 | 596 | 0.3864 | 0.5398 | 0.4504 | 0.9158 |
| 0.3466 | 19.0 | 855 | 0.6179 | 0.5514 | 0.7973 | 0.6519 | 74 | 0.4757 | 0.6806 | 0.56 | 72 | 0.1967 | 0.2449 | 0.2182 | 49 | 0.3341 | 0.5201 | 0.4068 | 596 | 0.3586 | 0.5436 | 0.4322 | 0.9144 |
| 0.3466 | 20.0 | 900 | 0.7150 | 0.5514 | 0.7973 | 0.6519 | 74 | 0.4694 | 0.6389 | 0.5412 | 72 | 0.2727 | 0.3673 | 0.3130 | 49 | 0.3102 | 0.4581 | 0.3699 | 596 | 0.3440 | 0.5006 | 0.4078 | 0.9132 |
| 0.3466 | 21.0 | 945 | 0.7231 | 0.5673 | 0.7973 | 0.6629 | 74 | 0.4421 | 0.5833 | 0.5030 | 72 | 0.2759 | 0.3265 | 0.2991 | 49 | 0.3344 | 0.5352 | 0.4116 | 596 | 0.3600 | 0.5512 | 0.4356 | 0.9121 |
| 0.3466 | 22.0 | 990 | 0.7431 | 0.5126 | 0.8243 | 0.6321 | 74 | 0.4274 | 0.7361 | 0.5408 | 72 | 0.2073 | 0.3469 | 0.2595 | 49 | 0.3268 | 0.4782 | 0.3883 | 596 | 0.3475 | 0.5259 | 0.4185 | 0.9109 |
| 0.0235 | 23.0 | 1035 | 0.7899 | 0.6667 | 0.8378 | 0.7425 | 74 | 0.5169 | 0.6389 | 0.5714 | 72 | 0.2419 | 0.3061 | 0.2703 | 49 | 0.3252 | 0.4933 | 0.392 | 596 | 0.3632 | 0.5272 | 0.4301 | 0.9134 |
| 0.0235 | 24.0 | 1080 | 0.7823 | 0.5575 | 0.8514 | 0.6738 | 74 | 0.4609 | 0.7361 | 0.5668 | 72 | 0.2361 | 0.3469 | 0.2810 | 49 | 0.3421 | 0.5034 | 0.4073 | 596 | 0.3679 | 0.5474 | 0.4400 | 0.9152 |
| 0.0235 | 25.0 | 1125 | 0.8200 | 0.4593 | 0.8378 | 0.5933 | 74 | 0.4472 | 0.7639 | 0.5641 | 72 | 0.1980 | 0.4082 | 0.2667 | 49 | 0.3596 | 0.5503 | 0.4350 | 596 | 0.3659 | 0.5879 | 0.4510 | 0.9115 |
| 0.0235 | 26.0 | 1170 | 0.7593 | 0.5619 | 0.7973 | 0.6592 | 74 | 0.4522 | 0.7222 | 0.5561 | 72 | 0.2432 | 0.3673 | 0.2927 | 49 | 0.3409 | 0.5268 | 0.4140 | 596 | 0.3646 | 0.5601 | 0.4417 | 0.9134 |
| 0.0235 | 27.0 | 1215 | 0.7955 | 0.5755 | 0.8243 | 0.6778 | 74 | 0.4742 | 0.6389 | 0.5444 | 72 | 0.2308 | 0.3061 | 0.2632 | 49 | 0.3247 | 0.4849 | 0.3890 | 596 | 0.3549 | 0.5196 | 0.4218 | 0.9160 |
| 0.0235 | 28.0 | 1260 | 0.8286 | 0.6180 | 0.7432 | 0.6748 | 74 | 0.5060 | 0.5833 | 0.5419 | 72 | 0.28 | 0.2857 | 0.2828 | 49 | 0.2911 | 0.4128 | 0.3414 | 596 | 0.3346 | 0.4513 | 0.3843 | 0.9106 |
| 0.0235 | 29.0 | 1305 | 0.8632 | 0.5524 | 0.7838 | 0.6480 | 74 | 0.4237 | 0.6944 | 0.5263 | 72 | 0.2778 | 0.4082 | 0.3306 | 49 | 0.3497 | 0.5134 | 0.4160 | 596 | 0.3709 | 0.5487 | 0.4426 | 0.9109 |
| 0.0235 | 30.0 | 1350 | 0.7689 | 0.5673 | 0.7973 | 0.6629 | 74 | 0.4722 | 0.7083 | 0.5667 | 72 | 0.2647 | 0.3673 | 0.3077 | 49 | 0.3094 | 0.4480 | 0.3660 | 596 | 0.3456 | 0.4994 | 0.4085 | 0.9105 |
| 0.0235 | 31.0 | 1395 | 0.7931 | 0.5268 | 0.7973 | 0.6344 | 74 | 0.4811 | 0.7083 | 0.5730 | 72 | 0.2368 | 0.3673 | 0.288 | 49 | 0.3047 | 0.4530 | 0.3644 | 596 | 0.3373 | 0.5032 | 0.4039 | 0.9106 |
| 0.0235 | 32.0 | 1440 | 0.7861 | 0.5169 | 0.8243 | 0.6354 | 74 | 0.4796 | 0.6528 | 0.5529 | 72 | 0.2683 | 0.4490 | 0.3359 | 49 | 0.3359 | 0.5084 | 0.4045 | 596 | 0.3608 | 0.5474 | 0.4350 | 0.9135 |
| 0.0235 | 33.0 | 1485 | 0.8035 | 0.5221 | 0.7973 | 0.6310 | 74 | 0.3846 | 0.6944 | 0.4950 | 72 | 0.2714 | 0.3878 | 0.3193 | 49 | 0.3410 | 0.5252 | 0.4135 | 596 | 0.3582 | 0.5575 | 0.4362 | 0.9137 |
| 0.0103 | 34.0 | 1530 | 0.8581 | 0.5 | 0.8108 | 0.6186 | 74 | 0.4359 | 0.7083 | 0.5397 | 72 | 0.2703 | 0.4082 | 0.3252 | 49 | 0.3303 | 0.4799 | 0.3912 | 596 | 0.3543 | 0.5272 | 0.4238 | 0.9125 |
| 0.0103 | 35.0 | 1575 | 0.8677 | 0.5085 | 0.8108 | 0.6250 | 74 | 0.4138 | 0.6667 | 0.5106 | 72 | 0.2258 | 0.4286 | 0.2958 | 49 | 0.3240 | 0.4832 | 0.3879 | 596 | 0.3429 | 0.5272 | 0.4155 | 0.9122 |
| 0.0103 | 36.0 | 1620 | 0.9150 | 0.5514 | 0.7973 | 0.6519 | 74 | 0.4519 | 0.6528 | 0.5341 | 72 | 0.2647 | 0.3673 | 0.3077 | 49 | 0.3399 | 0.4933 | 0.4025 | 596 | 0.3654 | 0.5284 | 0.4320 | 0.9146 |
| 0.0103 | 37.0 | 1665 | 0.9198 | 0.5405 | 0.8108 | 0.6486 | 74 | 0.4528 | 0.6667 | 0.5393 | 72 | 0.3143 | 0.4490 | 0.3697 | 49 | 0.3287 | 0.4799 | 0.3902 | 596 | 0.3596 | 0.5259 | 0.4271 | 0.9144 |
| 0.0103 | 38.0 | 1710 | 0.9436 | 0.5210 | 0.8378 | 0.6425 | 74 | 0.4752 | 0.6667 | 0.5549 | 72 | 0.2857 | 0.4082 | 0.3361 | 49 | 0.3392 | 0.4832 | 0.3986 | 596 | 0.3670 | 0.5284 | 0.4332 | 0.9157 |
| 0.0103 | 39.0 | 1755 | 0.9250 | 0.6061 | 0.8108 | 0.6936 | 74 | 0.5341 | 0.6528 | 0.5875 | 72 | 0.3167 | 0.3878 | 0.3486 | 49 | 0.3562 | 0.4883 | 0.4119 | 596 | 0.3919 | 0.5272 | 0.4496 | 0.9159 |
| 0.0103 | 40.0 | 1800 | 0.8905 | 0.5905 | 0.8378 | 0.6927 | 74 | 0.4667 | 0.6806 | 0.5537 | 72 | 0.2857 | 0.4082 | 0.3361 | 49 | 0.3521 | 0.5134 | 0.4177 | 596 | 0.3803 | 0.5525 | 0.4505 | 0.9164 |
| 0.0103 | 41.0 | 1845 | 0.9588 | 0.6354 | 0.8243 | 0.7176 | 74 | 0.4842 | 0.6389 | 0.5509 | 72 | 0.2969 | 0.3878 | 0.3363 | 49 | 0.3418 | 0.4765 | 0.3980 | 596 | 0.3775 | 0.5183 | 0.4369 | 0.9153 |
| 0.0103 | 42.0 | 1890 | 0.9381 | 0.5636 | 0.8378 | 0.6739 | 74 | 0.4505 | 0.6944 | 0.5464 | 72 | 0.2958 | 0.4286 | 0.3500 | 49 | 0.3559 | 0.5117 | 0.4198 | 596 | 0.3812 | 0.5537 | 0.4515 | 0.9168 |
| 0.0103 | 43.0 | 1935 | 0.9576 | 0.5625 | 0.8514 | 0.6774 | 74 | 0.4762 | 0.6944 | 0.5650 | 72 | 0.3134 | 0.4286 | 0.3621 | 49 | 0.3433 | 0.5017 | 0.4076 | 596 | 0.3749 | 0.5474 | 0.4450 | 0.9156 |
| 0.0103 | 44.0 | 1980 | 0.9541 | 0.5556 | 0.8108 | 0.6593 | 74 | 0.4274 | 0.6944 | 0.5291 | 72 | 0.2899 | 0.4082 | 0.3390 | 49 | 0.3438 | 0.4765 | 0.3994 | 596 | 0.3696 | 0.5234 | 0.4333 | 0.9143 |
| 0.0031 | 45.0 | 2025 | 0.9564 | 0.6139 | 0.8378 | 0.7086 | 74 | 0.4615 | 0.6667 | 0.5455 | 72 | 0.2951 | 0.3673 | 0.3273 | 49 | 0.3491 | 0.5084 | 0.4139 | 596 | 0.3801 | 0.5449 | 0.4478 | 0.9158 |
| 0.0031 | 46.0 | 2070 | 0.9680 | 0.5755 | 0.8243 | 0.6778 | 74 | 0.4717 | 0.6944 | 0.5618 | 72 | 0.2923 | 0.3878 | 0.3333 | 49 | 0.36 | 0.5436 | 0.4332 | 596 | 0.3857 | 0.5740 | 0.4614 | 0.9144 |
| 0.0031 | 47.0 | 2115 | 0.8938 | 0.5636 | 0.8378 | 0.6739 | 74 | 0.4673 | 0.6944 | 0.5587 | 72 | 0.2703 | 0.4082 | 0.3252 | 49 | 0.3488 | 0.4916 | 0.4081 | 596 | 0.3758 | 0.5373 | 0.4422 | 0.9145 |
| 0.0031 | 48.0 | 2160 | 0.9492 | 0.5607 | 0.8108 | 0.6630 | 74 | 0.5 | 0.6667 | 0.5714 | 72 | 0.3448 | 0.4082 | 0.3738 | 49 | 0.3457 | 0.5 | 0.4088 | 596 | 0.3793 | 0.5386 | 0.4451 | 0.9161 |
| 0.0031 | 49.0 | 2205 | 0.9510 | 0.5607 | 0.8108 | 0.6630 | 74 | 0.5052 | 0.6806 | 0.5799 | 72 | 0.3231 | 0.4286 | 0.3684 | 49 | 0.3523 | 0.5101 | 0.4167 | 596 | 0.3834 | 0.5487 | 0.4514 | 0.9158 |
| 0.0031 | 50.0 | 2250 | 0.9416 | 0.5636 | 0.8378 | 0.6739 | 74 | 0.5 | 0.6528 | 0.5663 | 72 | 0.3088 | 0.4286 | 0.3590 | 49 | 0.3556 | 0.5084 | 0.4185 | 596 | 0.3852 | 0.5474 | 0.4522 | 0.9159 |
| 0.0031 | 51.0 | 2295 | 0.9471 | 0.5357 | 0.8108 | 0.6452 | 74 | 0.4948 | 0.6667 | 0.5680 | 72 | 0.2857 | 0.4082 | 0.3361 | 49 | 0.3732 | 0.5235 | 0.4358 | 596 | 0.3946 | 0.5563 | 0.4617 | 0.9168 |
| 0.0031 | 52.0 | 2340 | 0.9231 | 0.5876 | 0.7703 | 0.6667 | 74 | 0.5281 | 0.6528 | 0.5839 | 72 | 0.3443 | 0.4286 | 0.3818 | 49 | 0.3325 | 0.4564 | 0.3847 | 596 | 0.3728 | 0.5019 | 0.4278 | 0.9137 |
| 0.0031 | 53.0 | 2385 | 0.8841 | 0.5825 | 0.8108 | 0.6780 | 74 | 0.5312 | 0.7083 | 0.6071 | 72 | 0.3284 | 0.4490 | 0.3793 | 49 | 0.3687 | 0.5369 | 0.4372 | 596 | 0.3995 | 0.5727 | 0.4706 | 0.9172 |
| 0.0031 | 54.0 | 2430 | 0.9170 | 0.5934 | 0.7297 | 0.6545 | 74 | 0.5676 | 0.5833 | 0.5753 | 72 | 0.3125 | 0.4082 | 0.3540 | 49 | 0.3525 | 0.4832 | 0.4076 | 596 | 0.3862 | 0.5107 | 0.4398 | 0.9165 |
| 0.0031 | 55.0 | 2475 | 0.9097 | 0.6105 | 0.7838 | 0.6864 | 74 | 0.5422 | 0.625 | 0.5806 | 72 | 0.3016 | 0.3878 | 0.3393 | 49 | 0.3568 | 0.5185 | 0.4227 | 596 | 0.3893 | 0.5449 | 0.4542 | 0.9182 |
| 0.0085 | 56.0 | 2520 | 0.8692 | 0.5701 | 0.8243 | 0.6740 | 74 | 0.4464 | 0.6944 | 0.5435 | 72 | 0.2769 | 0.3673 | 0.3158 | 49 | 0.3475 | 0.4950 | 0.4083 | 596 | 0.3742 | 0.5360 | 0.4407 | 0.9161 |
| 0.0085 | 57.0 | 2565 | 0.8842 | 0.61 | 0.8243 | 0.7011 | 74 | 0.5281 | 0.6528 | 0.5839 | 72 | 0.3226 | 0.4082 | 0.3604 | 49 | 0.3726 | 0.5151 | 0.4324 | 596 | 0.4047 | 0.5499 | 0.4662 | 0.9183 |
| 0.0085 | 58.0 | 2610 | 0.9079 | 0.5304 | 0.8243 | 0.6455 | 74 | 0.4474 | 0.7083 | 0.5484 | 72 | 0.3065 | 0.3878 | 0.3423 | 49 | 0.3520 | 0.4966 | 0.4120 | 596 | 0.3772 | 0.5398 | 0.4441 | 0.9158 |
| 0.0085 | 59.0 | 2655 | 0.9612 | 0.5648 | 0.8243 | 0.6703 | 74 | 0.4623 | 0.6806 | 0.5506 | 72 | 0.3103 | 0.3673 | 0.3364 | 49 | 0.3733 | 0.5067 | 0.4299 | 596 | 0.3978 | 0.5436 | 0.4594 | 0.9152 |
| 0.0085 | 60.0 | 2700 | 0.9343 | 0.5905 | 0.8378 | 0.6927 | 74 | 0.4537 | 0.6806 | 0.5444 | 72 | 0.2386 | 0.4286 | 0.3066 | 49 | 0.3618 | 0.5050 | 0.4216 | 596 | 0.3822 | 0.5474 | 0.4501 | 0.9161 |
| 0.0085 | 61.0 | 2745 | 0.8683 | 0.5263 | 0.8108 | 0.6383 | 74 | 0.4766 | 0.7083 | 0.5698 | 72 | 0.2545 | 0.2857 | 0.2692 | 49 | 0.3411 | 0.5134 | 0.4099 | 596 | 0.3674 | 0.5449 | 0.4389 | 0.9134 |
| 0.0085 | 62.0 | 2790 | 0.9314 | 0.5439 | 0.8378 | 0.6596 | 74 | 0.4944 | 0.6111 | 0.5466 | 72 | 0.2985 | 0.4082 | 0.3448 | 49 | 0.3564 | 0.5185 | 0.4224 | 596 | 0.3826 | 0.5499 | 0.4512 | 0.9153 |
| 0.0085 | 63.0 | 2835 | 0.9549 | 0.5676 | 0.8514 | 0.6811 | 74 | 0.4842 | 0.6389 | 0.5509 | 72 | 0.2836 | 0.3878 | 0.3276 | 49 | 0.3543 | 0.5201 | 0.4215 | 596 | 0.3815 | 0.5537 | 0.4518 | 0.9148 |
| 0.0085 | 64.0 | 2880 | 0.9605 | 0.6458 | 0.8378 | 0.7294 | 74 | 0.5106 | 0.6667 | 0.5783 | 72 | 0.2951 | 0.3673 | 0.3273 | 49 | 0.3569 | 0.5084 | 0.4194 | 596 | 0.3918 | 0.5449 | 0.4558 | 0.9151 |
| 0.0085 | 65.0 | 2925 | 0.9836 | 0.6139 | 0.8378 | 0.7086 | 74 | 0.5 | 0.6528 | 0.5663 | 72 | 0.2951 | 0.3673 | 0.3273 | 49 | 0.3589 | 0.5101 | 0.4213 | 596 | 0.3908 | 0.5449 | 0.4551 | 0.9148 |
| 0.0085 | 66.0 | 2970 | 0.9778 | 0.6139 | 0.8378 | 0.7086 | 74 | 0.5051 | 0.6944 | 0.5848 | 72 | 0.3016 | 0.3878 | 0.3393 | 49 | 0.3544 | 0.5084 | 0.4176 | 596 | 0.3882 | 0.5487 | 0.4547 | 0.9151 |
| 0.0025 | 67.0 | 3015 | 0.9872 | 0.6078 | 0.8378 | 0.7045 | 74 | 0.5051 | 0.6944 | 0.5848 | 72 | 0.2969 | 0.3878 | 0.3363 | 49 | 0.3591 | 0.5151 | 0.4232 | 596 | 0.3911 | 0.5537 | 0.4584 | 0.9153 |
| 0.0025 | 68.0 | 3060 | 0.9874 | 0.6139 | 0.8378 | 0.7086 | 74 | 0.5051 | 0.6944 | 0.5848 | 72 | 0.2836 | 0.3878 | 0.3276 | 49 | 0.3611 | 0.5168 | 0.4251 | 596 | 0.3920 | 0.5550 | 0.4594 | 0.9152 |
| 0.0025 | 69.0 | 3105 | 1.0168 | 0.6458 | 0.8378 | 0.7294 | 74 | 0.5158 | 0.6806 | 0.5868 | 72 | 0.3 | 0.3673 | 0.3303 | 49 | 0.3762 | 0.5403 | 0.4435 | 596 | 0.4074 | 0.5702 | 0.4752 | 0.9169 |
| 0.0025 | 70.0 | 3150 | 0.9922 | 0.5727 | 0.8514 | 0.6848 | 74 | 0.4538 | 0.75 | 0.5654 | 72 | 0.2778 | 0.4082 | 0.3306 | 49 | 0.3577 | 0.5168 | 0.4228 | 596 | 0.3830 | 0.5626 | 0.4557 | 0.9155 |
| 0.0025 | 71.0 | 3195 | 0.9906 | 0.5755 | 0.8243 | 0.6778 | 74 | 0.5208 | 0.6944 | 0.5952 | 72 | 0.3065 | 0.3878 | 0.3423 | 49 | 0.3675 | 0.5050 | 0.4254 | 596 | 0.3980 | 0.5449 | 0.4600 | 0.9152 |
| 0.0025 | 72.0 | 3240 | 0.9563 | 0.5833 | 0.8514 | 0.6923 | 74 | 0.5435 | 0.6944 | 0.6098 | 72 | 0.3115 | 0.3878 | 0.3455 | 49 | 0.3718 | 0.5134 | 0.4313 | 596 | 0.4041 | 0.5537 | 0.4672 | 0.9162 |
| 0.0025 | 73.0 | 3285 | 0.9835 | 0.5794 | 0.8378 | 0.6851 | 74 | 0.5312 | 0.7083 | 0.6071 | 72 | 0.3226 | 0.4082 | 0.3604 | 49 | 0.3715 | 0.5168 | 0.4323 | 596 | 0.4031 | 0.5575 | 0.4679 | 0.9161 |
| 0.0025 | 74.0 | 3330 | 0.9978 | 0.5888 | 0.8514 | 0.6961 | 74 | 0.5 | 0.6806 | 0.5765 | 72 | 0.3125 | 0.4082 | 0.3540 | 49 | 0.3678 | 0.5134 | 0.4286 | 596 | 0.3978 | 0.5537 | 0.4630 | 0.9161 |
| 0.0025 | 75.0 | 3375 | 1.0115 | 0.5943 | 0.8514 | 0.7000 | 74 | 0.5312 | 0.7083 | 0.6071 | 72 | 0.3077 | 0.4082 | 0.3509 | 49 | 0.3648 | 0.5117 | 0.4260 | 596 | 0.3980 | 0.5550 | 0.4636 | 0.9159 |
| 0.0025 | 76.0 | 3420 | 1.0282 | 0.5849 | 0.8378 | 0.6889 | 74 | 0.5204 | 0.7083 | 0.6000 | 72 | 0.3077 | 0.4082 | 0.3509 | 49 | 0.3645 | 0.5101 | 0.4252 | 596 | 0.3962 | 0.5525 | 0.4615 | 0.9154 |
| 0.0025 | 77.0 | 3465 | 1.0204 | 0.5905 | 0.8378 | 0.6927 | 74 | 0.5368 | 0.7083 | 0.6108 | 72 | 0.3125 | 0.4082 | 0.3540 | 49 | 0.3705 | 0.5134 | 0.4304 | 596 | 0.4028 | 0.5550 | 0.4668 | 0.9158 |
| 0.0038 | 78.0 | 3510 | 1.0008 | 0.5922 | 0.8243 | 0.6893 | 74 | 0.56 | 0.5833 | 0.5714 | 72 | 0.3051 | 0.3673 | 0.3333 | 49 | 0.3538 | 0.5034 | 0.4155 | 596 | 0.3880 | 0.5322 | 0.4488 | 0.9168 |
| 0.0038 | 79.0 | 3555 | 0.9657 | 0.5701 | 0.8243 | 0.6740 | 74 | 0.5532 | 0.7222 | 0.6265 | 72 | 0.2969 | 0.3878 | 0.3363 | 49 | 0.3582 | 0.5067 | 0.4197 | 596 | 0.3917 | 0.5487 | 0.4571 | 0.9160 |
| 0.0038 | 80.0 | 3600 | 0.9676 | 0.5701 | 0.8243 | 0.6740 | 74 | 0.5426 | 0.7083 | 0.6145 | 72 | 0.3333 | 0.4082 | 0.3670 | 49 | 0.3593 | 0.5101 | 0.4216 | 596 | 0.3939 | 0.5512 | 0.4594 | 0.9163 |
| 0.0038 | 81.0 | 3645 | 0.9830 | 0.5882 | 0.8108 | 0.6818 | 74 | 0.5426 | 0.7083 | 0.6145 | 72 | 0.3226 | 0.4082 | 0.3604 | 49 | 0.3769 | 0.5369 | 0.4429 | 596 | 0.4074 | 0.5702 | 0.4752 | 0.9172 |
| 0.0038 | 82.0 | 3690 | 0.9940 | 0.5810 | 0.8243 | 0.6816 | 74 | 0.5667 | 0.7083 | 0.6296 | 72 | 0.3279 | 0.4082 | 0.3636 | 49 | 0.3692 | 0.5302 | 0.4353 | 596 | 0.4029 | 0.5664 | 0.4708 | 0.9174 |
| 0.0038 | 83.0 | 3735 | 0.9963 | 0.5741 | 0.8378 | 0.6813 | 74 | 0.4825 | 0.7639 | 0.5914 | 72 | 0.2838 | 0.4286 | 0.3415 | 49 | 0.3579 | 0.5134 | 0.4218 | 596 | 0.3858 | 0.5613 | 0.4573 | 0.9161 |
| 0.0038 | 84.0 | 3780 | 1.0159 | 0.5849 | 0.8378 | 0.6889 | 74 | 0.4911 | 0.7639 | 0.5978 | 72 | 0.2941 | 0.4082 | 0.3419 | 49 | 0.3657 | 0.5117 | 0.4266 | 596 | 0.3946 | 0.5588 | 0.4626 | 0.9162 |
| 0.0038 | 85.0 | 3825 | 1.0231 | 0.5810 | 0.8243 | 0.6816 | 74 | 0.4952 | 0.7222 | 0.5876 | 72 | 0.3077 | 0.4082 | 0.3509 | 49 | 0.3670 | 0.5117 | 0.4275 | 596 | 0.3960 | 0.5537 | 0.4618 | 0.9164 |
| 0.0038 | 86.0 | 3870 | 1.0280 | 0.6078 | 0.8378 | 0.7045 | 74 | 0.52 | 0.7222 | 0.6047 | 72 | 0.3016 | 0.3878 | 0.3393 | 49 | 0.3668 | 0.5084 | 0.4262 | 596 | 0.3996 | 0.5512 | 0.4633 | 0.9167 |
| 0.0038 | 87.0 | 3915 | 1.0225 | 0.5922 | 0.8243 | 0.6893 | 74 | 0.5258 | 0.7083 | 0.6036 | 72 | 0.3065 | 0.3878 | 0.3423 | 49 | 0.3614 | 0.4966 | 0.4184 | 596 | 0.3950 | 0.5398 | 0.4562 | 0.9165 |
| 0.0038 | 88.0 | 3960 | 1.0069 | 0.5905 | 0.8378 | 0.6927 | 74 | 0.5361 | 0.7222 | 0.6154 | 72 | 0.3279 | 0.4082 | 0.3636 | 49 | 0.3763 | 0.5336 | 0.4414 | 596 | 0.4079 | 0.5714 | 0.4760 | 0.9180 |
| 0.0031 | 89.0 | 4005 | 1.0139 | 0.62 | 0.8378 | 0.7126 | 74 | 0.52 | 0.7222 | 0.6047 | 72 | 0.3226 | 0.4082 | 0.3604 | 49 | 0.3744 | 0.5252 | 0.4372 | 596 | 0.4071 | 0.5651 | 0.4733 | 0.9182 |
| 0.0031 | 90.0 | 4050 | 1.0159 | 0.6078 | 0.8378 | 0.7045 | 74 | 0.5253 | 0.7222 | 0.6082 | 72 | 0.3333 | 0.4082 | 0.3670 | 49 | 0.3705 | 0.5185 | 0.4322 | 596 | 0.4046 | 0.5601 | 0.4698 | 0.9176 |
| 0.0031 | 91.0 | 4095 | 1.0399 | 0.6526 | 0.8378 | 0.7337 | 74 | 0.5484 | 0.7083 | 0.6182 | 72 | 0.3016 | 0.3878 | 0.3393 | 49 | 0.3759 | 0.5185 | 0.4358 | 596 | 0.4110 | 0.5575 | 0.4732 | 0.9175 |
| 0.0031 | 92.0 | 4140 | 1.0673 | 0.62 | 0.8378 | 0.7126 | 74 | 0.5263 | 0.6944 | 0.5988 | 72 | 0.2951 | 0.3673 | 0.3273 | 49 | 0.375 | 0.4983 | 0.4280 | 596 | 0.4074 | 0.5398 | 0.4644 | 0.9167 |
| 0.0031 | 93.0 | 4185 | 1.0578 | 0.6078 | 0.8378 | 0.7045 | 74 | 0.5102 | 0.6944 | 0.5882 | 72 | 0.2951 | 0.3673 | 0.3273 | 49 | 0.3788 | 0.5034 | 0.4323 | 596 | 0.4084 | 0.5436 | 0.4664 | 0.9172 |
| 0.0031 | 94.0 | 4230 | 1.0467 | 0.6078 | 0.8378 | 0.7045 | 74 | 0.5155 | 0.6944 | 0.5917 | 72 | 0.3279 | 0.4082 | 0.3636 | 49 | 0.3787 | 0.5134 | 0.4359 | 596 | 0.4101 | 0.5537 | 0.4712 | 0.9175 |
| 0.0031 | 95.0 | 4275 | 1.0454 | 0.5905 | 0.8378 | 0.6927 | 74 | 0.5152 | 0.7083 | 0.5965 | 72 | 0.3175 | 0.4082 | 0.3571 | 49 | 0.3792 | 0.5084 | 0.4344 | 596 | 0.4090 | 0.5512 | 0.4696 | 0.9174 |
| 0.0031 | 96.0 | 4320 | 1.0367 | 0.5962 | 0.8378 | 0.6966 | 74 | 0.5049 | 0.7222 | 0.5943 | 72 | 0.3443 | 0.4286 | 0.3818 | 49 | 0.3812 | 0.5168 | 0.4387 | 596 | 0.4117 | 0.5601 | 0.4746 | 0.9176 |
| 0.0031 | 97.0 | 4365 | 1.0343 | 0.5962 | 0.8378 | 0.6966 | 74 | 0.5049 | 0.7222 | 0.5943 | 72 | 0.3443 | 0.4286 | 0.3818 | 49 | 0.3869 | 0.5336 | 0.4485 | 596 | 0.4156 | 0.5727 | 0.4817 | 0.9180 |
| 0.0031 | 98.0 | 4410 | 1.0340 | 0.6078 | 0.8378 | 0.7045 | 74 | 0.5098 | 0.7222 | 0.5977 | 72 | 0.3333 | 0.4286 | 0.375 | 49 | 0.3886 | 0.5352 | 0.4502 | 596 | 0.4173 | 0.5740 | 0.4832 | 0.9179 |
| 0.0031 | 99.0 | 4455 | 1.0366 | 0.6040 | 0.8243 | 0.6971 | 74 | 0.51 | 0.7083 | 0.5930 | 72 | 0.35 | 0.4286 | 0.3853 | 49 | 0.3878 | 0.5336 | 0.4492 | 596 | 0.4172 | 0.5702 | 0.4818 | 0.9181 |
| 0.0028 | 100.0 | 4500 | 1.0383 | 0.62 | 0.8378 | 0.7126 | 74 | 0.5253 | 0.7222 | 0.6082 | 72 | 0.35 | 0.4286 | 0.3853 | 49 | 0.3881 | 0.5386 | 0.4512 | 596 | 0.4199 | 0.5765 | 0.4859 | 0.9180 |
### Framework versions
- PEFT 0.12.0
- Transformers 4.44.0
- Pytorch 2.4.0+cu121
- Datasets 2.20.0
- Tokenizers 0.19.1 |