--- license: apache-2.0 base_model: distilbert-base-uncased-finetuned-sst-2-english tags: - generated_from_trainer datasets: - sembr2023 metrics: - precision - recall - f1 - accuracy model-index: - name: sembr2023-distilbert-base-uncased-finetuned-sst-2-english results: - task: name: Token Classification type: token-classification dataset: name: sembr2023 type: sembr2023 config: sembr2023 split: test args: sembr2023 metrics: - name: Precision type: precision value: 0.7495098039215686 - name: Recall type: recall value: 0.807819310527011 - name: F1 type: f1 value: 0.7775729451401691 - name: Accuracy type: accuracy value: 0.9591090231275345 --- # sembr2023-distilbert-base-uncased-finetuned-sst-2-english This model is a fine-tuned version of [distilbert-base-uncased-finetuned-sst-2-english](https://huggingface.co/distilbert-base-uncased-finetuned-sst-2-english) on the sembr2023 dataset. It achieves the following results on the evaluation set: - Loss: 0.1824 - Precision: 0.7495 - Recall: 0.8078 - F1: 0.7776 - Iou: 0.6361 - Accuracy: 0.9591 - Balanced Accuracy: 0.8908 - Overall Accuracy: 0.9449 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 1e-05 - train_batch_size: 64 - eval_batch_size: 128 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: cosine - training_steps: 3000 ### Training results | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Iou | Accuracy | Balanced Accuracy | Overall Accuracy | |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:------:|:--------:|:-----------------:|:----------------:| | 0.716 | 0.07 | 10 | 0.8034 | 0.2092 | 0.0042 | 0.0083 | 0.0042 | 0.9105 | 0.5013 | 0.9103 | | 0.426 | 0.14 | 20 | 0.4522 | 0 | 0.0 | 0.0 | 0.0 | 0.9115 | 0.5 | 0.9115 | | 0.412 | 0.21 | 30 | 0.4049 | 0 | 0.0 | 0.0 | 0.0 | 0.9115 | 0.5 | 0.9115 | | 0.3504 | 0.28 | 40 | 0.3926 | 0 | 0.0 | 0.0 | 0.0 | 0.9115 | 0.5 | 0.9115 | | 0.3821 | 0.35 | 50 | 0.3784 | 0 | 0.0 | 0.0 | 0.0 | 0.9115 | 0.5 | 0.9115 | | 0.3646 | 0.42 | 60 | 0.3605 | 0 | 0.0 | 0.0 | 0.0 | 0.9115 | 0.5 | 0.9115 | | 0.346 | 0.49 | 70 | 0.3349 | 0 | 0.0 | 0.0 | 0.0 | 0.9115 | 0.5 | 0.9115 | | 0.2888 | 0.56 | 80 | 0.3074 | 0.9110 | 0.0622 | 0.1165 | 0.0618 | 0.9165 | 0.5308 | 0.9136 | | 0.2687 | 0.62 | 90 | 0.2853 | 0.7761 | 0.2220 | 0.3453 | 0.2087 | 0.9255 | 0.6079 | 0.9167 | | 0.2456 | 0.69 | 100 | 0.2677 | 0.7641 | 0.3389 | 0.4696 | 0.3068 | 0.9323 | 0.6644 | 0.9210 | | 0.2356 | 0.76 | 110 | 0.2479 | 0.8081 | 0.3833 | 0.5200 | 0.3513 | 0.9374 | 0.6872 | 0.9264 | | 0.2416 | 0.83 | 120 | 0.2453 | 0.7251 | 0.5673 | 0.6366 | 0.4669 | 0.9427 | 0.7732 | 0.9266 | | 0.2018 | 0.9 | 130 | 0.2271 | 0.7764 | 0.5709 | 0.6579 | 0.4902 | 0.9475 | 0.7775 | 0.9323 | | 0.172 | 0.97 | 140 | 0.2295 | 0.7138 | 0.6687 | 0.6905 | 0.5273 | 0.9470 | 0.8214 | 0.9293 | | 0.1866 | 1.04 | 150 | 0.2167 | 0.7418 | 0.6642 | 0.7009 | 0.5395 | 0.9498 | 0.8209 | 0.9327 | | 0.1832 | 1.11 | 160 | 0.2117 | 0.7427 | 0.6794 | 0.7097 | 0.5500 | 0.9508 | 0.8283 | 0.9344 | | 0.1622 | 1.18 | 170 | 0.2061 | 0.7542 | 0.6686 | 0.7088 | 0.5490 | 0.9514 | 0.8237 | 0.9352 | | 0.1792 | 1.25 | 180 | 0.2078 | 0.7341 | 0.7080 | 0.7208 | 0.5635 | 0.9515 | 0.8415 | 0.9338 | | 0.1657 | 1.32 | 190 | 0.2041 | 0.7514 | 0.7110 | 0.7306 | 0.5756 | 0.9536 | 0.8441 | 0.9362 | | 0.1878 | 1.39 | 200 | 0.2032 | 0.7427 | 0.7245 | 0.7335 | 0.5791 | 0.9534 | 0.8501 | 0.9352 | | 0.1765 | 1.46 | 210 | 0.1963 | 0.7479 | 0.7259 | 0.7367 | 0.5832 | 0.9541 | 0.8511 | 0.9377 | | 0.1608 | 1.53 | 220 | 0.1998 | 0.7495 | 0.7304 | 0.7398 | 0.5871 | 0.9546 | 0.8534 | 0.9362 | | 0.1458 | 1.6 | 230 | 0.1925 | 0.7808 | 0.6998 | 0.7381 | 0.5849 | 0.9561 | 0.8404 | 0.9390 | | 0.1352 | 1.67 | 240 | 0.1893 | 0.7792 | 0.7136 | 0.7450 | 0.5936 | 0.9568 | 0.8470 | 0.9399 | | 0.1516 | 1.74 | 250 | 0.1968 | 0.7310 | 0.7623 | 0.7463 | 0.5953 | 0.9541 | 0.8675 | 0.9356 | | 0.159 | 1.81 | 260 | 0.1856 | 0.7705 | 0.7288 | 0.7491 | 0.5988 | 0.9568 | 0.8539 | 0.9395 | | 0.1548 | 1.88 | 270 | 0.1873 | 0.7779 | 0.7230 | 0.7495 | 0.5993 | 0.9572 | 0.8515 | 0.9397 | | 0.1659 | 1.94 | 280 | 0.1851 | 0.7558 | 0.7531 | 0.7545 | 0.6058 | 0.9566 | 0.8648 | 0.9389 | | 0.1483 | 2.01 | 290 | 0.1834 | 0.8095 | 0.6998 | 0.7506 | 0.6008 | 0.9589 | 0.8419 | 0.9425 | | 0.1576 | 2.08 | 300 | 0.1876 | 0.7703 | 0.7406 | 0.7552 | 0.6066 | 0.9575 | 0.8596 | 0.9395 | | 0.1576 | 2.15 | 310 | 0.1890 | 0.7330 | 0.7685 | 0.7503 | 0.6004 | 0.9547 | 0.8706 | 0.9365 | | 0.1413 | 2.22 | 320 | 0.1852 | 0.7503 | 0.7623 | 0.7562 | 0.6080 | 0.9565 | 0.8688 | 0.9389 | | 0.1342 | 2.29 | 330 | 0.1938 | 0.7187 | 0.7803 | 0.7483 | 0.5978 | 0.9535 | 0.8754 | 0.9347 | | 0.145 | 2.36 | 340 | 0.1806 | 0.7732 | 0.7498 | 0.7613 | 0.6147 | 0.9584 | 0.8642 | 0.9411 | | 0.1192 | 2.43 | 350 | 0.1884 | 0.7281 | 0.7825 | 0.7543 | 0.6055 | 0.9549 | 0.8770 | 0.9363 | | 0.1141 | 2.5 | 360 | 0.1865 | 0.7604 | 0.7490 | 0.7547 | 0.6060 | 0.9569 | 0.8631 | 0.9389 | | 0.1231 | 2.57 | 370 | 0.1864 | 0.7207 | 0.7901 | 0.7538 | 0.6049 | 0.9543 | 0.8802 | 0.9361 | | 0.1181 | 2.64 | 380 | 0.1786 | 0.7719 | 0.7485 | 0.7600 | 0.6129 | 0.9582 | 0.8635 | 0.9416 | | 0.1362 | 2.71 | 390 | 0.1832 | 0.7448 | 0.7790 | 0.7615 | 0.6149 | 0.9568 | 0.8766 | 0.9391 | | 0.1123 | 2.78 | 400 | 0.1725 | 0.7880 | 0.7453 | 0.7661 | 0.6209 | 0.9597 | 0.8629 | 0.9437 | | 0.1166 | 2.85 | 410 | 0.1781 | 0.7536 | 0.7748 | 0.7641 | 0.6182 | 0.9577 | 0.8751 | 0.9400 | | 0.116 | 2.92 | 420 | 0.1774 | 0.7663 | 0.7681 | 0.7672 | 0.6223 | 0.9588 | 0.8727 | 0.9412 | | 0.1045 | 2.99 | 430 | 0.1706 | 0.7671 | 0.7673 | 0.7672 | 0.6223 | 0.9588 | 0.8723 | 0.9427 | | 0.1352 | 3.06 | 440 | 0.1755 | 0.7515 | 0.7802 | 0.7656 | 0.6202 | 0.9577 | 0.8776 | 0.9404 | | 0.1074 | 3.12 | 450 | 0.1777 | 0.7645 | 0.7626 | 0.7636 | 0.6175 | 0.9582 | 0.8699 | 0.9406 | | 0.1308 | 3.19 | 460 | 0.1705 | 0.7781 | 0.7645 | 0.7712 | 0.6276 | 0.9599 | 0.8717 | 0.9431 | | 0.1195 | 3.26 | 470 | 0.1691 | 0.7614 | 0.7761 | 0.7687 | 0.6243 | 0.9587 | 0.8763 | 0.9429 | | 0.1115 | 3.33 | 480 | 0.1686 | 0.7888 | 0.7576 | 0.7729 | 0.6298 | 0.9606 | 0.8690 | 0.9446 | | 0.0924 | 3.4 | 490 | 0.1714 | 0.7611 | 0.7731 | 0.7671 | 0.6221 | 0.9585 | 0.8748 | 0.9425 | | 0.0999 | 3.47 | 500 | 0.1785 | 0.7555 | 0.7798 | 0.7675 | 0.6227 | 0.9582 | 0.8777 | 0.9401 | | 0.1028 | 3.54 | 510 | 0.1717 | 0.7476 | 0.7914 | 0.7689 | 0.6246 | 0.9579 | 0.8828 | 0.9409 | | 0.0985 | 3.61 | 520 | 0.1686 | 0.7825 | 0.7576 | 0.7699 | 0.6259 | 0.9599 | 0.8686 | 0.9443 | | 0.1005 | 3.68 | 530 | 0.1781 | 0.7511 | 0.7839 | 0.7671 | 0.6222 | 0.9579 | 0.8793 | 0.9406 | | 0.1084 | 3.75 | 540 | 0.1774 | 0.7560 | 0.7764 | 0.7661 | 0.6208 | 0.9580 | 0.8760 | 0.9406 | | 0.1057 | 3.82 | 550 | 0.1756 | 0.7338 | 0.8043 | 0.7674 | 0.6226 | 0.9569 | 0.8880 | 0.9399 | | 0.1121 | 3.89 | 560 | 0.1726 | 0.7550 | 0.7825 | 0.7685 | 0.6240 | 0.9583 | 0.8789 | 0.9417 | | 0.1081 | 3.96 | 570 | 0.1687 | 0.7637 | 0.7753 | 0.7695 | 0.6253 | 0.9589 | 0.8760 | 0.9431 | | 0.0897 | 4.03 | 580 | 0.1677 | 0.7545 | 0.7858 | 0.7698 | 0.6257 | 0.9584 | 0.8805 | 0.9427 | | 0.1072 | 4.1 | 590 | 0.1637 | 0.7880 | 0.7587 | 0.7731 | 0.6301 | 0.9606 | 0.8694 | 0.9471 | | 0.0876 | 4.17 | 600 | 0.1680 | 0.7648 | 0.7757 | 0.7702 | 0.6263 | 0.9591 | 0.8763 | 0.9435 | | 0.0927 | 4.24 | 610 | 0.1690 | 0.7577 | 0.7830 | 0.7701 | 0.6262 | 0.9586 | 0.8793 | 0.9423 | | 0.0941 | 4.31 | 620 | 0.1784 | 0.7538 | 0.7870 | 0.7700 | 0.6260 | 0.9584 | 0.8810 | 0.9409 | | 0.1003 | 4.38 | 630 | 0.1688 | 0.7572 | 0.7892 | 0.7729 | 0.6298 | 0.9590 | 0.8823 | 0.9441 | | 0.1043 | 4.44 | 640 | 0.1662 | 0.7593 | 0.7854 | 0.7721 | 0.6288 | 0.9590 | 0.8806 | 0.9441 | | 0.0844 | 4.51 | 650 | 0.1643 | 0.7722 | 0.7793 | 0.7757 | 0.6336 | 0.9601 | 0.8785 | 0.9453 | | 0.0913 | 4.58 | 660 | 0.1688 | 0.7529 | 0.7895 | 0.7707 | 0.6270 | 0.9584 | 0.8822 | 0.9426 | | 0.0945 | 4.65 | 670 | 0.1644 | 0.7694 | 0.7772 | 0.7732 | 0.6303 | 0.9597 | 0.8773 | 0.9456 | | 0.0844 | 4.72 | 680 | 0.1602 | 0.7812 | 0.7708 | 0.7760 | 0.6339 | 0.9606 | 0.8749 | 0.9478 | | 0.0898 | 4.79 | 690 | 0.1676 | 0.7535 | 0.7888 | 0.7707 | 0.6270 | 0.9585 | 0.8819 | 0.9431 | | 0.086 | 4.86 | 700 | 0.1676 | 0.7692 | 0.7785 | 0.7738 | 0.6310 | 0.9597 | 0.8779 | 0.9442 | | 0.106 | 4.93 | 710 | 0.1682 | 0.7539 | 0.7904 | 0.7717 | 0.6283 | 0.9586 | 0.8827 | 0.9432 | | 0.084 | 5.0 | 720 | 0.1714 | 0.7434 | 0.7933 | 0.7675 | 0.6228 | 0.9575 | 0.8834 | 0.9416 | | 0.0938 | 5.07 | 730 | 0.1649 | 0.7636 | 0.7772 | 0.7703 | 0.6264 | 0.9590 | 0.8769 | 0.9445 | | 0.0928 | 5.14 | 740 | 0.1653 | 0.7545 | 0.7909 | 0.7723 | 0.6291 | 0.9587 | 0.8830 | 0.9456 | | 0.072 | 5.21 | 750 | 0.1654 | 0.7686 | 0.7765 | 0.7725 | 0.6294 | 0.9595 | 0.8769 | 0.9460 | | 0.0824 | 5.28 | 760 | 0.1670 | 0.7426 | 0.8046 | 0.7724 | 0.6291 | 0.9580 | 0.8888 | 0.9438 | | 0.0892 | 5.35 | 770 | 0.1683 | 0.7623 | 0.7855 | 0.7737 | 0.6310 | 0.9594 | 0.8809 | 0.9446 | | 0.0789 | 5.42 | 780 | 0.1664 | 0.7718 | 0.7741 | 0.7730 | 0.6299 | 0.9598 | 0.8760 | 0.9452 | | 0.0785 | 5.49 | 790 | 0.1634 | 0.7643 | 0.7842 | 0.7741 | 0.6315 | 0.9595 | 0.8804 | 0.9455 | | 0.0753 | 5.56 | 800 | 0.1692 | 0.7455 | 0.7990 | 0.7713 | 0.6278 | 0.9581 | 0.8862 | 0.9430 | | 0.081 | 5.62 | 810 | 0.1650 | 0.7676 | 0.7786 | 0.7731 | 0.6301 | 0.9596 | 0.8779 | 0.9458 | | 0.0827 | 5.69 | 820 | 0.1623 | 0.7652 | 0.7873 | 0.7761 | 0.6341 | 0.9598 | 0.8819 | 0.9475 | | 0.0795 | 5.76 | 830 | 0.1669 | 0.7651 | 0.7846 | 0.7747 | 0.6323 | 0.9596 | 0.8806 | 0.9450 | | 0.0831 | 5.83 | 840 | 0.1677 | 0.7736 | 0.7786 | 0.7761 | 0.6341 | 0.9603 | 0.8783 | 0.9447 | | 0.0768 | 5.9 | 850 | 0.1660 | 0.7580 | 0.7949 | 0.7760 | 0.6340 | 0.9594 | 0.8851 | 0.9451 | | 0.082 | 5.97 | 860 | 0.1737 | 0.7429 | 0.7987 | 0.7698 | 0.6257 | 0.9577 | 0.8859 | 0.9419 | | 0.0835 | 6.04 | 870 | 0.1795 | 0.7354 | 0.8073 | 0.7697 | 0.6256 | 0.9573 | 0.8895 | 0.9407 | | 0.0751 | 6.11 | 880 | 0.1788 | 0.7487 | 0.7937 | 0.7705 | 0.6267 | 0.9582 | 0.8839 | 0.9419 | | 0.0786 | 6.18 | 890 | 0.1699 | 0.7564 | 0.7933 | 0.7744 | 0.6319 | 0.9591 | 0.8842 | 0.9436 | | 0.0737 | 6.25 | 900 | 0.1680 | 0.7466 | 0.8037 | 0.7741 | 0.6315 | 0.9585 | 0.8886 | 0.9444 | | 0.0792 | 6.32 | 910 | 0.1665 | 0.7643 | 0.7827 | 0.7734 | 0.6305 | 0.9594 | 0.8796 | 0.9468 | | 0.0823 | 6.39 | 920 | 0.1741 | 0.7551 | 0.7901 | 0.7722 | 0.6290 | 0.9588 | 0.8826 | 0.9429 | | 0.0811 | 6.46 | 930 | 0.1682 | 0.7549 | 0.7922 | 0.7731 | 0.6302 | 0.9589 | 0.8836 | 0.9448 | | 0.0682 | 6.53 | 940 | 0.1700 | 0.7478 | 0.7973 | 0.7717 | 0.6283 | 0.9583 | 0.8856 | 0.9432 | | 0.0729 | 6.6 | 950 | 0.1744 | 0.7518 | 0.7924 | 0.7715 | 0.6280 | 0.9585 | 0.8835 | 0.9436 | | 0.0829 | 6.67 | 960 | 0.1757 | 0.7530 | 0.7961 | 0.7739 | 0.6312 | 0.9589 | 0.8854 | 0.9425 | | 0.0725 | 6.74 | 970 | 0.1707 | 0.7480 | 0.8010 | 0.7736 | 0.6307 | 0.9585 | 0.8874 | 0.9439 | | 0.0818 | 6.81 | 980 | 0.1634 | 0.7571 | 0.7941 | 0.7751 | 0.6328 | 0.9592 | 0.8847 | 0.9459 | | 0.0772 | 6.88 | 990 | 0.1674 | 0.7506 | 0.7965 | 0.7728 | 0.6298 | 0.9586 | 0.8854 | 0.9447 | | 0.0721 | 6.94 | 1000 | 0.1682 | 0.7714 | 0.7798 | 0.7756 | 0.6334 | 0.9601 | 0.8787 | 0.9458 | | 0.0803 | 7.01 | 1010 | 0.1628 | 0.7812 | 0.7731 | 0.7771 | 0.6355 | 0.9608 | 0.8760 | 0.9473 | | 0.0602 | 7.08 | 1020 | 0.1764 | 0.7340 | 0.8039 | 0.7674 | 0.6225 | 0.9569 | 0.8878 | 0.9422 | | 0.065 | 7.15 | 1030 | 0.1725 | 0.7494 | 0.7995 | 0.7736 | 0.6308 | 0.9586 | 0.8868 | 0.9433 | | 0.0755 | 7.22 | 1040 | 0.1714 | 0.7502 | 0.7983 | 0.7735 | 0.6306 | 0.9586 | 0.8863 | 0.9441 | | 0.0768 | 7.29 | 1050 | 0.1723 | 0.7439 | 0.8050 | 0.7733 | 0.6304 | 0.9582 | 0.8891 | 0.9434 | | 0.0624 | 7.36 | 1060 | 0.1683 | 0.7532 | 0.7951 | 0.7736 | 0.6308 | 0.9588 | 0.8849 | 0.9457 | | 0.0719 | 7.43 | 1070 | 0.1658 | 0.7629 | 0.7872 | 0.7749 | 0.6325 | 0.9595 | 0.8817 | 0.9456 | | 0.0661 | 7.5 | 1080 | 0.1697 | 0.7632 | 0.7867 | 0.7748 | 0.6323 | 0.9595 | 0.8815 | 0.9448 | | 0.0638 | 7.57 | 1090 | 0.1702 | 0.7579 | 0.7946 | 0.7758 | 0.6337 | 0.9594 | 0.8850 | 0.9448 | | 0.0747 | 7.64 | 1100 | 0.1655 | 0.7656 | 0.7834 | 0.7744 | 0.6318 | 0.9596 | 0.8801 | 0.9466 | | 0.0699 | 7.71 | 1110 | 0.1659 | 0.7615 | 0.7889 | 0.7750 | 0.6326 | 0.9595 | 0.8825 | 0.9460 | | 0.0704 | 7.78 | 1120 | 0.1706 | 0.7544 | 0.7925 | 0.7730 | 0.6300 | 0.9588 | 0.8837 | 0.9443 | | 0.0648 | 7.85 | 1130 | 0.1677 | 0.7699 | 0.7835 | 0.7766 | 0.6348 | 0.9601 | 0.8804 | 0.9457 | | 0.0787 | 7.92 | 1140 | 0.1675 | 0.7501 | 0.7978 | 0.7732 | 0.6303 | 0.9586 | 0.8860 | 0.9448 | | 0.0737 | 7.99 | 1150 | 0.1696 | 0.7424 | 0.8097 | 0.7746 | 0.6321 | 0.9583 | 0.8912 | 0.9451 | | 0.0555 | 8.06 | 1160 | 0.1668 | 0.7568 | 0.8003 | 0.7779 | 0.6366 | 0.9596 | 0.8877 | 0.9459 | | 0.0738 | 8.12 | 1170 | 0.1697 | 0.7640 | 0.7905 | 0.7770 | 0.6354 | 0.9599 | 0.8834 | 0.9453 | | 0.0726 | 8.19 | 1180 | 0.1683 | 0.7580 | 0.7979 | 0.7774 | 0.6359 | 0.9596 | 0.8866 | 0.9458 | | 0.0644 | 8.26 | 1190 | 0.1713 | 0.7672 | 0.7860 | 0.7765 | 0.6346 | 0.9600 | 0.8814 | 0.9454 | | 0.0626 | 8.33 | 1200 | 0.1730 | 0.7508 | 0.7941 | 0.7719 | 0.6285 | 0.9585 | 0.8843 | 0.9447 | | 0.0693 | 8.4 | 1210 | 0.1703 | 0.7512 | 0.8002 | 0.7749 | 0.6326 | 0.9589 | 0.8872 | 0.9448 | | 0.0699 | 8.47 | 1220 | 0.1733 | 0.7427 | 0.8074 | 0.7737 | 0.6309 | 0.9582 | 0.8901 | 0.9442 | | 0.0771 | 8.54 | 1230 | 0.1677 | 0.7541 | 0.7999 | 0.7763 | 0.6344 | 0.9592 | 0.8873 | 0.9457 | | 0.077 | 8.61 | 1240 | 0.1718 | 0.7518 | 0.7987 | 0.7746 | 0.6321 | 0.9589 | 0.8866 | 0.9450 | | 0.072 | 8.68 | 1250 | 0.1680 | 0.7594 | 0.7936 | 0.7761 | 0.6341 | 0.9595 | 0.8846 | 0.9457 | | 0.0679 | 8.75 | 1260 | 0.1697 | 0.7644 | 0.7871 | 0.7756 | 0.6334 | 0.9597 | 0.8818 | 0.9458 | | 0.0553 | 8.82 | 1270 | 0.1703 | 0.7510 | 0.7987 | 0.7741 | 0.6315 | 0.9588 | 0.8865 | 0.9442 | | 0.0692 | 8.89 | 1280 | 0.1731 | 0.7530 | 0.7976 | 0.7747 | 0.6322 | 0.9589 | 0.8861 | 0.9437 | | 0.0804 | 8.96 | 1290 | 0.1700 | 0.7667 | 0.7875 | 0.7770 | 0.6353 | 0.9600 | 0.8821 | 0.9457 | | 0.0738 | 9.03 | 1300 | 0.1732 | 0.7543 | 0.7976 | 0.7754 | 0.6332 | 0.9591 | 0.8862 | 0.9440 | | 0.0551 | 9.1 | 1310 | 0.1755 | 0.7512 | 0.8006 | 0.7751 | 0.6328 | 0.9589 | 0.8874 | 0.9436 | | 0.0553 | 9.17 | 1320 | 0.1826 | 0.7382 | 0.8089 | 0.7719 | 0.6286 | 0.9577 | 0.8905 | 0.9416 | | 0.0609 | 9.24 | 1330 | 0.1768 | 0.7545 | 0.7959 | 0.7746 | 0.6322 | 0.9590 | 0.8854 | 0.9430 | | 0.0618 | 9.31 | 1340 | 0.1808 | 0.7437 | 0.8056 | 0.7734 | 0.6305 | 0.9582 | 0.8893 | 0.9424 | | 0.0675 | 9.38 | 1350 | 0.1782 | 0.7434 | 0.8053 | 0.7731 | 0.6301 | 0.9582 | 0.8892 | 0.9427 | | 0.0675 | 9.44 | 1360 | 0.1779 | 0.7424 | 0.8103 | 0.7749 | 0.6325 | 0.9583 | 0.8915 | 0.9424 | | 0.0647 | 9.51 | 1370 | 0.1738 | 0.7415 | 0.8076 | 0.7731 | 0.6302 | 0.9581 | 0.8901 | 0.9440 | | 0.0647 | 9.58 | 1380 | 0.1748 | 0.7416 | 0.8081 | 0.7734 | 0.6305 | 0.9581 | 0.8904 | 0.9431 | | 0.0506 | 9.65 | 1390 | 0.1797 | 0.7327 | 0.8135 | 0.7710 | 0.6273 | 0.9572 | 0.8923 | 0.9420 | | 0.0543 | 9.72 | 1400 | 0.1764 | 0.7476 | 0.8015 | 0.7736 | 0.6308 | 0.9585 | 0.8876 | 0.9433 | | 0.0595 | 9.79 | 1410 | 0.1744 | 0.7617 | 0.7925 | 0.7768 | 0.6351 | 0.9597 | 0.8842 | 0.9451 | | 0.0631 | 9.86 | 1420 | 0.1765 | 0.7647 | 0.7908 | 0.7775 | 0.6360 | 0.9600 | 0.8836 | 0.9450 | | 0.061 | 9.93 | 1430 | 0.1724 | 0.7580 | 0.7953 | 0.7762 | 0.6343 | 0.9594 | 0.8853 | 0.9454 | | 0.0744 | 10.0 | 1440 | 0.1718 | 0.7523 | 0.7975 | 0.7743 | 0.6317 | 0.9589 | 0.8860 | 0.9448 | | 0.0625 | 10.07 | 1450 | 0.1720 | 0.7601 | 0.7924 | 0.7759 | 0.6339 | 0.9595 | 0.8840 | 0.9454 | | 0.0567 | 10.14 | 1460 | 0.1772 | 0.7412 | 0.8066 | 0.7725 | 0.6294 | 0.9580 | 0.8896 | 0.9436 | | 0.0583 | 10.21 | 1470 | 0.1692 | 0.7696 | 0.7867 | 0.7781 | 0.6367 | 0.9603 | 0.8819 | 0.9473 | | 0.0541 | 10.28 | 1480 | 0.1742 | 0.7568 | 0.7965 | 0.7761 | 0.6341 | 0.9593 | 0.8858 | 0.9454 | | 0.0679 | 10.35 | 1490 | 0.1744 | 0.7560 | 0.7953 | 0.7752 | 0.6329 | 0.9592 | 0.8852 | 0.9451 | | 0.0577 | 10.42 | 1500 | 0.1791 | 0.7439 | 0.8064 | 0.7739 | 0.6311 | 0.9583 | 0.8897 | 0.9431 | | 0.0576 | 10.49 | 1510 | 0.1710 | 0.7502 | 0.8012 | 0.7749 | 0.6325 | 0.9588 | 0.8877 | 0.9450 | | 0.0573 | 10.56 | 1520 | 0.1739 | 0.7601 | 0.7946 | 0.7770 | 0.6353 | 0.9596 | 0.8851 | 0.9452 | | 0.0599 | 10.62 | 1530 | 0.1780 | 0.7430 | 0.8046 | 0.7726 | 0.6295 | 0.9581 | 0.8888 | 0.9436 | | 0.0622 | 10.69 | 1540 | 0.1776 | 0.7569 | 0.7947 | 0.7753 | 0.6331 | 0.9592 | 0.8850 | 0.9449 | | 0.0715 | 10.76 | 1550 | 0.1769 | 0.7596 | 0.7936 | 0.7762 | 0.6343 | 0.9595 | 0.8846 | 0.9450 | | 0.0561 | 10.83 | 1560 | 0.1684 | 0.7704 | 0.7864 | 0.7784 | 0.6371 | 0.9604 | 0.8818 | 0.9469 | | 0.0543 | 10.9 | 1570 | 0.1785 | 0.7500 | 0.8006 | 0.7745 | 0.6319 | 0.9587 | 0.8873 | 0.9443 | | 0.0567 | 10.97 | 1580 | 0.1714 | 0.7547 | 0.8006 | 0.7770 | 0.6353 | 0.9593 | 0.8876 | 0.9455 | | 0.0496 | 11.04 | 1590 | 0.1795 | 0.7394 | 0.8119 | 0.7739 | 0.6312 | 0.9580 | 0.8921 | 0.9434 | | 0.0526 | 11.11 | 1600 | 0.1759 | 0.7482 | 0.8062 | 0.7761 | 0.6342 | 0.9589 | 0.8900 | 0.9449 | | 0.0582 | 11.18 | 1610 | 0.1752 | 0.7506 | 0.8024 | 0.7757 | 0.6335 | 0.9589 | 0.8883 | 0.9448 | | 0.0456 | 11.25 | 1620 | 0.1765 | 0.7488 | 0.8049 | 0.7759 | 0.6338 | 0.9589 | 0.8894 | 0.9447 | | 0.0609 | 11.32 | 1630 | 0.1778 | 0.7464 | 0.8081 | 0.7760 | 0.6340 | 0.9587 | 0.8907 | 0.9445 | | 0.0566 | 11.39 | 1640 | 0.1783 | 0.7505 | 0.8058 | 0.7772 | 0.6356 | 0.9591 | 0.8899 | 0.9441 | | 0.0541 | 11.46 | 1650 | 0.1794 | 0.7526 | 0.8046 | 0.7777 | 0.6363 | 0.9593 | 0.8895 | 0.9445 | | 0.063 | 11.53 | 1660 | 0.1736 | 0.7649 | 0.7906 | 0.7776 | 0.6361 | 0.9600 | 0.8835 | 0.9458 | | 0.065 | 11.6 | 1670 | 0.1744 | 0.7378 | 0.8122 | 0.7732 | 0.6303 | 0.9578 | 0.8921 | 0.9441 | | 0.0597 | 11.67 | 1680 | 0.1735 | 0.7553 | 0.7970 | 0.7756 | 0.6334 | 0.9592 | 0.8860 | 0.9452 | | 0.0595 | 11.74 | 1690 | 0.1833 | 0.7318 | 0.8176 | 0.7723 | 0.6291 | 0.9573 | 0.8943 | 0.9422 | | 0.0638 | 11.81 | 1700 | 0.1821 | 0.7458 | 0.8050 | 0.7743 | 0.6317 | 0.9585 | 0.8892 | 0.9441 | | 0.0561 | 11.88 | 1710 | 0.1811 | 0.7389 | 0.8110 | 0.7733 | 0.6303 | 0.9579 | 0.8916 | 0.9438 | | 0.0512 | 11.94 | 1720 | 0.1734 | 0.7603 | 0.7950 | 0.7772 | 0.6357 | 0.9597 | 0.8853 | 0.9461 | | 0.0584 | 12.01 | 1730 | 0.1728 | 0.7582 | 0.7966 | 0.7769 | 0.6352 | 0.9595 | 0.8860 | 0.9460 | | 0.06 | 12.08 | 1740 | 0.1760 | 0.7516 | 0.8015 | 0.7758 | 0.6337 | 0.9590 | 0.8879 | 0.9445 | | 0.0632 | 12.15 | 1750 | 0.1829 | 0.7362 | 0.8164 | 0.7742 | 0.6316 | 0.9579 | 0.8940 | 0.9431 | | 0.0556 | 12.22 | 1760 | 0.1767 | 0.7420 | 0.8102 | 0.7746 | 0.6321 | 0.9583 | 0.8914 | 0.9447 | | 0.0437 | 12.29 | 1770 | 0.1731 | 0.7553 | 0.7988 | 0.7765 | 0.6346 | 0.9593 | 0.8869 | 0.9460 | | 0.0602 | 12.36 | 1780 | 0.1809 | 0.7490 | 0.8029 | 0.7750 | 0.6327 | 0.9588 | 0.8884 | 0.9442 | | 0.0563 | 12.43 | 1790 | 0.1759 | 0.7631 | 0.7946 | 0.7785 | 0.6374 | 0.9600 | 0.8853 | 0.9460 | | 0.0567 | 12.5 | 1800 | 0.1770 | 0.7546 | 0.7976 | 0.7755 | 0.6334 | 0.9591 | 0.8862 | 0.9451 | | 0.0567 | 12.57 | 1810 | 0.1797 | 0.7502 | 0.8039 | 0.7761 | 0.6342 | 0.9590 | 0.8889 | 0.9443 | | 0.0658 | 12.64 | 1820 | 0.1787 | 0.7557 | 0.7990 | 0.7768 | 0.6350 | 0.9594 | 0.8870 | 0.9450 | | 0.061 | 12.71 | 1830 | 0.1706 | 0.7603 | 0.7936 | 0.7766 | 0.6348 | 0.9596 | 0.8846 | 0.9467 | | 0.0507 | 12.78 | 1840 | 0.1771 | 0.7542 | 0.7984 | 0.7757 | 0.6336 | 0.9591 | 0.8866 | 0.9450 | | 0.0552 | 12.85 | 1850 | 0.1820 | 0.7465 | 0.8073 | 0.7757 | 0.6336 | 0.9587 | 0.8903 | 0.9436 | | 0.055 | 12.92 | 1860 | 0.1796 | 0.7496 | 0.8032 | 0.7755 | 0.6333 | 0.9589 | 0.8886 | 0.9450 | | 0.0644 | 12.99 | 1870 | 0.1829 | 0.7470 | 0.8072 | 0.7759 | 0.6339 | 0.9587 | 0.8903 | 0.9442 | | 0.0528 | 13.06 | 1880 | 0.1785 | 0.7517 | 0.8025 | 0.7763 | 0.6344 | 0.9591 | 0.8884 | 0.9452 | | 0.0581 | 13.12 | 1890 | 0.1770 | 0.7471 | 0.8040 | 0.7745 | 0.6320 | 0.9586 | 0.8888 | 0.9452 | | 0.055 | 13.19 | 1900 | 0.1815 | 0.7474 | 0.8050 | 0.7751 | 0.6329 | 0.9587 | 0.8893 | 0.9442 | | 0.0517 | 13.26 | 1910 | 0.1831 | 0.7435 | 0.8109 | 0.7757 | 0.6336 | 0.9585 | 0.8919 | 0.9435 | | 0.056 | 13.33 | 1920 | 0.1800 | 0.7448 | 0.8086 | 0.7754 | 0.6332 | 0.9585 | 0.8909 | 0.9442 | | 0.0472 | 13.4 | 1930 | 0.1806 | 0.7448 | 0.8062 | 0.7743 | 0.6317 | 0.9584 | 0.8897 | 0.9444 | | 0.0516 | 13.47 | 1940 | 0.1738 | 0.7599 | 0.7991 | 0.7790 | 0.6380 | 0.9599 | 0.8873 | 0.9460 | | 0.0514 | 13.54 | 1950 | 0.1798 | 0.7404 | 0.8119 | 0.7745 | 0.6320 | 0.9582 | 0.8921 | 0.9444 | | 0.0608 | 13.61 | 1960 | 0.1785 | 0.7519 | 0.8024 | 0.7764 | 0.6345 | 0.9591 | 0.8884 | 0.9452 | | 0.0526 | 13.68 | 1970 | 0.1826 | 0.7559 | 0.8017 | 0.7782 | 0.6369 | 0.9596 | 0.8883 | 0.9444 | | 0.0511 | 13.75 | 1980 | 0.1831 | 0.7445 | 0.8069 | 0.7745 | 0.6319 | 0.9584 | 0.8900 | 0.9441 | | 0.0565 | 13.82 | 1990 | 0.1768 | 0.7559 | 0.8007 | 0.7776 | 0.6362 | 0.9595 | 0.8878 | 0.9459 | | 0.0595 | 13.89 | 2000 | 0.1816 | 0.7503 | 0.8050 | 0.7767 | 0.6350 | 0.9591 | 0.8895 | 0.9447 | | 0.049 | 13.96 | 2010 | 0.1803 | 0.7538 | 0.8017 | 0.7771 | 0.6354 | 0.9593 | 0.8882 | 0.9450 | | 0.0472 | 14.03 | 2020 | 0.1772 | 0.7531 | 0.8037 | 0.7776 | 0.6361 | 0.9593 | 0.8891 | 0.9454 | | 0.0512 | 14.1 | 2030 | 0.1780 | 0.7530 | 0.8037 | 0.7775 | 0.6360 | 0.9593 | 0.8891 | 0.9454 | | 0.0472 | 14.17 | 2040 | 0.1793 | 0.7559 | 0.8016 | 0.7781 | 0.6368 | 0.9595 | 0.8882 | 0.9452 | | 0.0612 | 14.24 | 2050 | 0.1774 | 0.7549 | 0.8016 | 0.7775 | 0.6360 | 0.9594 | 0.8882 | 0.9456 | | 0.054 | 14.31 | 2060 | 0.1807 | 0.7454 | 0.8099 | 0.7763 | 0.6345 | 0.9587 | 0.8915 | 0.9442 | | 0.0524 | 14.38 | 2070 | 0.1787 | 0.7477 | 0.8053 | 0.7755 | 0.6333 | 0.9587 | 0.8895 | 0.9451 | | 0.0522 | 14.44 | 2080 | 0.1801 | 0.7481 | 0.8060 | 0.7759 | 0.6339 | 0.9588 | 0.8898 | 0.9445 | | 0.0556 | 14.51 | 2090 | 0.1788 | 0.7522 | 0.8032 | 0.7769 | 0.6352 | 0.9592 | 0.8888 | 0.9453 | | 0.0413 | 14.58 | 2100 | 0.1781 | 0.7456 | 0.8076 | 0.7753 | 0.6331 | 0.9586 | 0.8904 | 0.9452 | | 0.0528 | 14.65 | 2110 | 0.1815 | 0.7457 | 0.8094 | 0.7762 | 0.6343 | 0.9587 | 0.8913 | 0.9446 | | 0.0474 | 14.72 | 2120 | 0.1813 | 0.7507 | 0.8049 | 0.7769 | 0.6351 | 0.9591 | 0.8895 | 0.9448 | | 0.0516 | 14.79 | 2130 | 0.1802 | 0.7552 | 0.8025 | 0.7781 | 0.6368 | 0.9595 | 0.8886 | 0.9454 | | 0.0502 | 14.86 | 2140 | 0.1811 | 0.7475 | 0.8073 | 0.7762 | 0.6343 | 0.9588 | 0.8904 | 0.9447 | | 0.0541 | 14.93 | 2150 | 0.1804 | 0.7440 | 0.8093 | 0.7753 | 0.6330 | 0.9585 | 0.8911 | 0.9451 | | 0.0476 | 15.0 | 2160 | 0.1819 | 0.7533 | 0.8033 | 0.7775 | 0.6360 | 0.9593 | 0.8889 | 0.9449 | | 0.0473 | 15.07 | 2170 | 0.1813 | 0.7495 | 0.8065 | 0.7769 | 0.6352 | 0.9590 | 0.8902 | 0.9449 | | 0.0507 | 15.14 | 2180 | 0.1834 | 0.7427 | 0.8142 | 0.7768 | 0.6350 | 0.9586 | 0.8934 | 0.9438 | | 0.0636 | 15.21 | 2190 | 0.1762 | 0.7583 | 0.8003 | 0.7787 | 0.6377 | 0.9598 | 0.8878 | 0.9463 | | 0.0484 | 15.28 | 2200 | 0.1836 | 0.7527 | 0.8040 | 0.7775 | 0.6360 | 0.9593 | 0.8892 | 0.9448 | | 0.0502 | 15.35 | 2210 | 0.1805 | 0.7528 | 0.8035 | 0.7773 | 0.6357 | 0.9593 | 0.8889 | 0.9454 | | 0.0501 | 15.42 | 2220 | 0.1831 | 0.7445 | 0.8107 | 0.7762 | 0.6342 | 0.9586 | 0.8919 | 0.9440 | | 0.0468 | 15.49 | 2230 | 0.1800 | 0.7554 | 0.8020 | 0.7780 | 0.6367 | 0.9595 | 0.8884 | 0.9453 | | 0.0525 | 15.56 | 2240 | 0.1800 | 0.7479 | 0.8089 | 0.7772 | 0.6356 | 0.9590 | 0.8912 | 0.9452 | | 0.0359 | 15.62 | 2250 | 0.1836 | 0.7510 | 0.8056 | 0.7773 | 0.6358 | 0.9592 | 0.8898 | 0.9446 | | 0.0462 | 15.69 | 2260 | 0.1806 | 0.7535 | 0.8048 | 0.7783 | 0.6371 | 0.9594 | 0.8896 | 0.9453 | | 0.0497 | 15.76 | 2270 | 0.1826 | 0.7493 | 0.8077 | 0.7774 | 0.6359 | 0.9591 | 0.8907 | 0.9445 | | 0.0533 | 15.83 | 2280 | 0.1799 | 0.7564 | 0.8020 | 0.7786 | 0.6374 | 0.9596 | 0.8885 | 0.9457 | | 0.0553 | 15.9 | 2290 | 0.1843 | 0.7412 | 0.8123 | 0.7751 | 0.6328 | 0.9583 | 0.8924 | 0.9440 | | 0.0558 | 15.97 | 2300 | 0.1782 | 0.7577 | 0.8006 | 0.7785 | 0.6374 | 0.9597 | 0.8879 | 0.9459 | | 0.041 | 16.04 | 2310 | 0.1826 | 0.7502 | 0.8072 | 0.7776 | 0.6362 | 0.9592 | 0.8905 | 0.9446 | | 0.0499 | 16.11 | 2320 | 0.1817 | 0.7499 | 0.8082 | 0.7780 | 0.6366 | 0.9592 | 0.8910 | 0.9449 | | 0.0573 | 16.18 | 2330 | 0.1864 | 0.7454 | 0.8094 | 0.7761 | 0.6341 | 0.9587 | 0.8913 | 0.9438 | | 0.0423 | 16.25 | 2340 | 0.1811 | 0.7521 | 0.8062 | 0.7782 | 0.6370 | 0.9593 | 0.8902 | 0.9452 | | 0.0461 | 16.32 | 2350 | 0.1805 | 0.7535 | 0.8040 | 0.7779 | 0.6366 | 0.9594 | 0.8892 | 0.9451 | | 0.0581 | 16.39 | 2360 | 0.1835 | 0.7494 | 0.8065 | 0.7769 | 0.6352 | 0.9590 | 0.8902 | 0.9446 | | 0.0484 | 16.46 | 2370 | 0.1805 | 0.7488 | 0.8081 | 0.7773 | 0.6358 | 0.9590 | 0.8909 | 0.9451 | | 0.0601 | 16.53 | 2380 | 0.1801 | 0.7555 | 0.8025 | 0.7783 | 0.6371 | 0.9596 | 0.8887 | 0.9456 | | 0.0427 | 16.6 | 2390 | 0.1811 | 0.7496 | 0.8077 | 0.7775 | 0.6361 | 0.9591 | 0.8907 | 0.9451 | | 0.0564 | 16.67 | 2400 | 0.1829 | 0.7512 | 0.8068 | 0.7780 | 0.6366 | 0.9593 | 0.8904 | 0.9450 | | 0.0502 | 16.74 | 2410 | 0.1822 | 0.7497 | 0.8070 | 0.7773 | 0.6357 | 0.9591 | 0.8904 | 0.9450 | | 0.0469 | 16.81 | 2420 | 0.1815 | 0.7518 | 0.8064 | 0.7781 | 0.6368 | 0.9593 | 0.8903 | 0.9451 | | 0.0467 | 16.88 | 2430 | 0.1794 | 0.7547 | 0.8048 | 0.7790 | 0.6379 | 0.9596 | 0.8897 | 0.9456 | | 0.0461 | 16.94 | 2440 | 0.1822 | 0.7480 | 0.8090 | 0.7773 | 0.6357 | 0.9590 | 0.8913 | 0.9449 | | 0.0494 | 17.01 | 2450 | 0.1810 | 0.7531 | 0.8056 | 0.7785 | 0.6373 | 0.9594 | 0.8900 | 0.9455 | | 0.0524 | 17.08 | 2460 | 0.1861 | 0.7404 | 0.8134 | 0.7752 | 0.6329 | 0.9583 | 0.8928 | 0.9436 | | 0.0504 | 17.15 | 2470 | 0.1823 | 0.7558 | 0.8024 | 0.7784 | 0.6372 | 0.9596 | 0.8886 | 0.9453 | | 0.0492 | 17.22 | 2480 | 0.1819 | 0.7464 | 0.8097 | 0.7767 | 0.6350 | 0.9588 | 0.8915 | 0.9448 | | 0.0501 | 17.29 | 2490 | 0.1816 | 0.7515 | 0.8060 | 0.7778 | 0.6364 | 0.9592 | 0.8900 | 0.9451 | | 0.0452 | 17.36 | 2500 | 0.1795 | 0.7546 | 0.8032 | 0.7781 | 0.6368 | 0.9595 | 0.8889 | 0.9456 | | 0.0451 | 17.43 | 2510 | 0.1824 | 0.7509 | 0.8061 | 0.7775 | 0.6360 | 0.9592 | 0.8901 | 0.9448 | | 0.0409 | 17.5 | 2520 | 0.1826 | 0.7469 | 0.8086 | 0.7766 | 0.6347 | 0.9588 | 0.8910 | 0.9447 | | 0.0469 | 17.57 | 2530 | 0.1811 | 0.7468 | 0.8087 | 0.7765 | 0.6347 | 0.9588 | 0.8911 | 0.9449 | | 0.0463 | 17.64 | 2540 | 0.1832 | 0.7484 | 0.8091 | 0.7776 | 0.6361 | 0.9591 | 0.8914 | 0.9446 | | 0.054 | 17.71 | 2550 | 0.1814 | 0.7504 | 0.8076 | 0.7779 | 0.6365 | 0.9592 | 0.8907 | 0.9451 | | 0.0454 | 17.78 | 2560 | 0.1811 | 0.7480 | 0.8085 | 0.7771 | 0.6354 | 0.9590 | 0.8910 | 0.9450 | | 0.0492 | 17.85 | 2570 | 0.1818 | 0.7497 | 0.8076 | 0.7776 | 0.6361 | 0.9591 | 0.8907 | 0.9450 | | 0.0551 | 17.92 | 2580 | 0.1835 | 0.7485 | 0.8086 | 0.7774 | 0.6359 | 0.9590 | 0.8911 | 0.9445 | | 0.049 | 17.99 | 2590 | 0.1837 | 0.7483 | 0.8083 | 0.7771 | 0.6355 | 0.9590 | 0.8910 | 0.9446 | | 0.0554 | 18.06 | 2600 | 0.1825 | 0.7481 | 0.8081 | 0.7769 | 0.6352 | 0.9589 | 0.8908 | 0.9448 | | 0.0524 | 18.12 | 2610 | 0.1832 | 0.7491 | 0.8081 | 0.7775 | 0.6360 | 0.9591 | 0.8909 | 0.9448 | | 0.0488 | 18.19 | 2620 | 0.1832 | 0.7475 | 0.8090 | 0.7770 | 0.6354 | 0.9589 | 0.8912 | 0.9447 | | 0.0442 | 18.26 | 2630 | 0.1834 | 0.7484 | 0.8081 | 0.7771 | 0.6354 | 0.9590 | 0.8909 | 0.9447 | | 0.0428 | 18.33 | 2640 | 0.1825 | 0.7503 | 0.8078 | 0.7780 | 0.6367 | 0.9592 | 0.8909 | 0.9449 | | 0.0549 | 18.4 | 2650 | 0.1823 | 0.7513 | 0.8069 | 0.7781 | 0.6368 | 0.9593 | 0.8905 | 0.9451 | | 0.0463 | 18.47 | 2660 | 0.1819 | 0.7522 | 0.8065 | 0.7784 | 0.6372 | 0.9594 | 0.8904 | 0.9453 | | 0.0438 | 18.54 | 2670 | 0.1819 | 0.7505 | 0.8082 | 0.7783 | 0.6371 | 0.9593 | 0.8911 | 0.9451 | | 0.0504 | 18.61 | 2680 | 0.1827 | 0.7494 | 0.8090 | 0.7781 | 0.6368 | 0.9592 | 0.8914 | 0.9448 | | 0.0423 | 18.68 | 2690 | 0.1830 | 0.7493 | 0.8090 | 0.7780 | 0.6367 | 0.9592 | 0.8914 | 0.9448 | | 0.0453 | 18.75 | 2700 | 0.1831 | 0.7489 | 0.8091 | 0.7779 | 0.6365 | 0.9591 | 0.8914 | 0.9447 | | 0.0502 | 18.82 | 2710 | 0.1834 | 0.7505 | 0.8078 | 0.7781 | 0.6368 | 0.9592 | 0.8909 | 0.9449 | | 0.0363 | 18.89 | 2720 | 0.1827 | 0.7497 | 0.8083 | 0.7779 | 0.6366 | 0.9592 | 0.8911 | 0.9448 | | 0.0543 | 18.96 | 2730 | 0.1822 | 0.7502 | 0.8082 | 0.7781 | 0.6368 | 0.9592 | 0.8910 | 0.9450 | | 0.0473 | 19.03 | 2740 | 0.1824 | 0.7491 | 0.8090 | 0.7779 | 0.6365 | 0.9591 | 0.8913 | 0.9449 | | 0.0527 | 19.1 | 2750 | 0.1824 | 0.7475 | 0.8101 | 0.7775 | 0.6360 | 0.9590 | 0.8917 | 0.9448 | | 0.0518 | 19.17 | 2760 | 0.1825 | 0.7489 | 0.8085 | 0.7776 | 0.6361 | 0.9591 | 0.8911 | 0.9448 | | 0.0395 | 19.24 | 2770 | 0.1823 | 0.7506 | 0.8065 | 0.7775 | 0.6360 | 0.9592 | 0.8902 | 0.9450 | | 0.0473 | 19.31 | 2780 | 0.1825 | 0.7507 | 0.8069 | 0.7778 | 0.6364 | 0.9592 | 0.8904 | 0.9449 | | 0.0445 | 19.38 | 2790 | 0.1822 | 0.7511 | 0.8069 | 0.7780 | 0.6367 | 0.9593 | 0.8905 | 0.9450 | | 0.0517 | 19.44 | 2800 | 0.1817 | 0.7510 | 0.8069 | 0.7780 | 0.6366 | 0.9592 | 0.8905 | 0.9451 | | 0.0578 | 19.51 | 2810 | 0.1821 | 0.7495 | 0.8081 | 0.7777 | 0.6362 | 0.9591 | 0.8909 | 0.9449 | | 0.0451 | 19.58 | 2820 | 0.1820 | 0.7490 | 0.8093 | 0.7780 | 0.6366 | 0.9591 | 0.8915 | 0.9450 | | 0.0526 | 19.65 | 2830 | 0.1815 | 0.7494 | 0.8086 | 0.7779 | 0.6365 | 0.9591 | 0.8912 | 0.9451 | | 0.0543 | 19.72 | 2840 | 0.1817 | 0.7497 | 0.8082 | 0.7779 | 0.6365 | 0.9592 | 0.8910 | 0.9451 | | 0.0486 | 19.79 | 2850 | 0.1817 | 0.75 | 0.8080 | 0.7779 | 0.6365 | 0.9592 | 0.8909 | 0.9451 | | 0.0463 | 19.86 | 2860 | 0.1820 | 0.7500 | 0.8074 | 0.7776 | 0.6362 | 0.9591 | 0.8906 | 0.9450 | | 0.0466 | 19.93 | 2870 | 0.1822 | 0.7498 | 0.8074 | 0.7775 | 0.6360 | 0.9591 | 0.8906 | 0.9450 | | 0.0502 | 20.0 | 2880 | 0.1823 | 0.7497 | 0.8076 | 0.7776 | 0.6361 | 0.9591 | 0.8907 | 0.9450 | | 0.0422 | 20.07 | 2890 | 0.1824 | 0.7495 | 0.8081 | 0.7777 | 0.6362 | 0.9591 | 0.8909 | 0.9449 | | 0.0468 | 20.14 | 2900 | 0.1826 | 0.7490 | 0.8087 | 0.7777 | 0.6363 | 0.9591 | 0.8912 | 0.9449 | | 0.0534 | 20.21 | 2910 | 0.1825 | 0.7491 | 0.8086 | 0.7777 | 0.6363 | 0.9591 | 0.8912 | 0.9449 | | 0.0503 | 20.28 | 2920 | 0.1824 | 0.7494 | 0.8081 | 0.7776 | 0.6362 | 0.9591 | 0.8909 | 0.9449 | | 0.0464 | 20.35 | 2930 | 0.1824 | 0.7495 | 0.8078 | 0.7776 | 0.6361 | 0.9591 | 0.8908 | 0.9449 | | 0.0479 | 20.42 | 2940 | 0.1824 | 0.7494 | 0.8078 | 0.7775 | 0.6360 | 0.9591 | 0.8908 | 0.9449 | | 0.0475 | 20.49 | 2950 | 0.1824 | 0.7494 | 0.8078 | 0.7775 | 0.6360 | 0.9591 | 0.8908 | 0.9449 | | 0.055 | 20.56 | 2960 | 0.1824 | 0.7494 | 0.8078 | 0.7775 | 0.6360 | 0.9591 | 0.8908 | 0.9449 | | 0.0438 | 20.62 | 2970 | 0.1824 | 0.7495 | 0.8078 | 0.7776 | 0.6361 | 0.9591 | 0.8908 | 0.9449 | | 0.0457 | 20.69 | 2980 | 0.1824 | 0.7495 | 0.8078 | 0.7776 | 0.6361 | 0.9591 | 0.8908 | 0.9449 | | 0.0509 | 20.76 | 2990 | 0.1824 | 0.7495 | 0.8078 | 0.7776 | 0.6361 | 0.9591 | 0.8908 | 0.9449 | | 0.0473 | 20.83 | 3000 | 0.1824 | 0.7495 | 0.8078 | 0.7776 | 0.6361 | 0.9591 | 0.8908 | 0.9449 | ### Framework versions - Transformers 4.34.1 - Pytorch 2.0.1 - Datasets 2.14.6 - Tokenizers 0.14.1