README.md

metadata

license: apache-2.0
base_model: distilbert-base-uncased
tags:
  - generated_from_trainer
datasets:
  - sembr2023
metrics:
  - precision
  - recall
  - f1
  - accuracy
model-index:
  - name: sembr2023-distilbert-base-uncased
    results:
      - task:
          name: Token Classification
          type: token-classification
        dataset:
          name: sembr2023
          type: sembr2023
          config: sembr2023
          split: test
          args: sembr2023
        metrics:
          - name: Precision
            type: precision
            value: 0.7620265497503349
          - name: Recall
            type: recall
            value: 0.8264430062078986
          - name: F1
            type: f1
            value: 0.7929286528957039
          - name: Accuracy
            type: accuracy
            value: 0.9618085989084832

sembr2023-distilbert-base-uncased

This model is a fine-tuned version of distilbert-base-uncased on the sembr2023 dataset. It achieves the following results on the evaluation set:

• Loss: 0.4067
• Precision: 0.7620
• Recall: 0.8264
• F1: 0.7929
• Iou: 0.6569
• Accuracy: 0.9618
• Balanced Accuracy: 0.9007
• Overall Accuracy: 0.9491

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 64
• eval_batch_size: 128
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: cosine
• training_steps: 5000

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Iou	Accuracy	Balanced Accuracy	Overall Accuracy
0.4044	0.07	10	0.3985	0	0.0	0.0	0.0	0.9115	0.5	0.9115
0.3812	0.14	20	0.3805	0	0.0	0.0	0.0	0.9115	0.5	0.9115
0.3625	0.21	30	0.3230	0.9048	0.0025	0.0050	0.0025	0.9117	0.5012	0.9117
0.26	0.28	40	0.2489	0.8689	0.2993	0.4452	0.2864	0.9340	0.6475	0.9306
0.2189	0.35	50	0.2131	0.7638	0.6234	0.6865	0.5226	0.9496	0.8024	0.9369
0.1858	0.42	60	0.1959	0.7855	0.6977	0.7390	0.5860	0.9564	0.8396	0.9411
0.1814	0.49	70	0.2147	0.6614	0.8093	0.7279	0.5722	0.9465	0.8845	0.9256
0.1546	0.56	80	0.1806	0.7952	0.7364	0.7646	0.6190	0.9599	0.8590	0.9422
0.1348	0.62	90	0.1702	0.7701	0.7685	0.7693	0.6251	0.9592	0.8731	0.9418
0.1233	0.69	100	0.1692	0.8123	0.7440	0.7766	0.6348	0.9621	0.8637	0.9468
0.1175	0.76	110	0.1745	0.8160	0.7430	0.7778	0.6364	0.9624	0.8634	0.9449
0.1251	0.83	120	0.1897	0.7078	0.8260	0.7624	0.6160	0.9544	0.8965	0.9368
0.0936	0.9	130	0.1635	0.7832	0.7912	0.7872	0.6490	0.9621	0.8850	0.9443
0.0816	0.97	140	0.1713	0.7883	0.7852	0.7867	0.6485	0.9623	0.8824	0.9451
0.0804	1.04	150	0.1615	0.7769	0.8132	0.7947	0.6593	0.9628	0.8953	0.9475
0.0719	1.11	160	0.1560	0.7848	0.8058	0.7952	0.6600	0.9633	0.8922	0.9482
0.0662	1.18	170	0.1867	0.7452	0.8212	0.7813	0.6411	0.9593	0.8970	0.9431
0.0736	1.25	180	0.1560	0.8034	0.7920	0.7977	0.6634	0.9644	0.8866	0.9519
0.079	1.32	190	0.1875	0.7420	0.8287	0.7829	0.6433	0.9593	0.9004	0.9439
0.0756	1.39	200	0.1659	0.7833	0.8039	0.7934	0.6576	0.9630	0.8911	0.9476
0.0657	1.46	210	0.1715	0.7907	0.8015	0.7961	0.6612	0.9637	0.8904	0.9478
0.0576	1.53	220	0.1929	0.7594	0.8177	0.7875	0.6495	0.9610	0.8963	0.9433
0.0582	1.6	230	0.1563	0.8275	0.7591	0.7918	0.6554	0.9647	0.8719	0.9526
0.0572	1.67	240	0.1882	0.7681	0.8148	0.7907	0.6539	0.9618	0.8955	0.9457
0.0651	1.74	250	0.1674	0.7762	0.8081	0.7918	0.6554	0.9624	0.8927	0.9495
0.0537	1.81	260	0.1659	0.7770	0.8083	0.7924	0.6562	0.9625	0.8929	0.9480
0.0541	1.88	270	0.1689	0.7543	0.8222	0.7868	0.6485	0.9606	0.8981	0.9471
0.0582	1.94	280	0.1609	0.7774	0.8167	0.7966	0.6619	0.9631	0.8970	0.9528
0.0471	2.01	290	0.1887	0.7562	0.8279	0.7904	0.6535	0.9612	0.9010	0.9460
0.0372	2.08	300	0.1692	0.7662	0.8188	0.7916	0.6551	0.9619	0.8973	0.9493
0.0416	2.15	310	0.2022	0.7540	0.8221	0.7866	0.6482	0.9605	0.8980	0.9463
0.0411	2.22	320	0.2024	0.7574	0.8243	0.7895	0.6521	0.9611	0.8994	0.9468
0.0424	2.29	330	0.1850	0.7730	0.8152	0.7936	0.6578	0.9625	0.8960	0.9498
0.0438	2.36	340	0.1888	0.7715	0.8140	0.7922	0.6559	0.9622	0.8953	0.9490
0.0342	2.43	350	0.1905	0.7734	0.8167	0.7944	0.6590	0.9626	0.8967	0.9478
0.0302	2.5	360	0.1734	0.8042	0.7954	0.7998	0.6664	0.9648	0.8883	0.9528
0.0325	2.57	370	0.1770	0.7926	0.7969	0.7947	0.6593	0.9636	0.8883	0.9521
0.0349	2.64	380	0.1968	0.7564	0.8251	0.7893	0.6519	0.9610	0.8997	0.9475
0.0416	2.71	390	0.1859	0.7648	0.8167	0.7899	0.6528	0.9616	0.8961	0.9467
0.0329	2.78	400	0.1908	0.7643	0.8231	0.7926	0.6565	0.9619	0.8992	0.9495
0.0295	2.85	410	0.1853	0.8073	0.7856	0.7963	0.6616	0.9644	0.8837	0.9519
0.0323	2.92	420	0.2054	0.7354	0.8389	0.7837	0.6444	0.9590	0.9048	0.9453
0.0243	2.99	430	0.1907	0.7679	0.8179	0.7921	0.6557	0.9620	0.8969	0.9495
0.0335	3.06	440	0.2236	0.7619	0.8237	0.7916	0.6550	0.9616	0.8993	0.9473
0.0253	3.12	450	0.1981	0.7736	0.8011	0.7871	0.6489	0.9617	0.8892	0.9506
0.0303	3.19	460	0.2123	0.7755	0.8167	0.7955	0.6605	0.9629	0.8969	0.9501
0.0239	3.26	470	0.2166	0.7530	0.8196	0.7849	0.6460	0.9603	0.8967	0.9470
0.0229	3.33	480	0.2032	0.7565	0.8204	0.7871	0.6490	0.9607	0.8974	0.9498
0.0178	3.4	490	0.2072	0.7636	0.8193	0.7905	0.6536	0.9616	0.8973	0.9492
0.0188	3.47	500	0.2136	0.7554	0.8241	0.7883	0.6505	0.9608	0.8991	0.9476
0.0211	3.54	510	0.2295	0.7346	0.8383	0.7830	0.6435	0.9589	0.9045	0.9455
0.0169	3.61	520	0.2142	0.7645	0.8226	0.7925	0.6563	0.9619	0.8990	0.9487
0.0189	3.68	530	0.2160	0.7708	0.8113	0.7905	0.6536	0.9620	0.8939	0.9497
0.0191	3.75	540	0.2227	0.7790	0.8087	0.7936	0.6578	0.9628	0.8932	0.9498
0.02	3.82	550	0.2276	0.7388	0.8367	0.7847	0.6457	0.9594	0.9040	0.9456
0.0213	3.89	560	0.2201	0.7586	0.8138	0.7852	0.6463	0.9606	0.8943	0.9476
0.0155	3.96	570	0.2211	0.7269	0.8407	0.7797	0.6389	0.9580	0.9050	0.9470
0.0146	4.03	580	0.2247	0.7587	0.8160	0.7863	0.6479	0.9608	0.8954	0.9477
0.0147	4.1	590	0.2316	0.7644	0.8132	0.7880	0.6502	0.9613	0.8945	0.9483
0.0156	4.17	600	0.2323	0.7639	0.8214	0.7916	0.6551	0.9617	0.8984	0.9506
0.0132	4.24	610	0.2471	0.7413	0.8350	0.7854	0.6466	0.9596	0.9034	0.9469
0.0167	4.31	620	0.2340	0.7784	0.7992	0.7887	0.6511	0.9621	0.8886	0.9486
0.0155	4.38	630	0.2316	0.7337	0.8344	0.7808	0.6404	0.9585	0.9025	0.9477
0.0178	4.44	640	0.2227	0.7834	0.8025	0.7928	0.6568	0.9629	0.8905	0.9501
0.0161	4.51	650	0.2466	0.7292	0.8393	0.7804	0.6398	0.9582	0.9045	0.9456
0.0139	4.58	660	0.2617	0.7376	0.8217	0.7774	0.6358	0.9584	0.8967	0.9441
0.0141	4.65	670	0.2386	0.7556	0.8196	0.7863	0.6478	0.9606	0.8969	0.9476
0.0136	4.72	680	0.2414	0.7530	0.8223	0.7862	0.6477	0.9604	0.8981	0.9472
0.0121	4.79	690	0.2413	0.7499	0.8267	0.7865	0.6481	0.9603	0.9000	0.9470
0.011	4.86	700	0.2447	0.7672	0.8095	0.7878	0.6499	0.9614	0.8928	0.9482
0.0167	4.93	710	0.2438	0.7629	0.8087	0.7852	0.6463	0.9608	0.8922	0.9485
0.0132	5.0	720	0.2583	0.7353	0.8340	0.7815	0.6414	0.9587	0.9024	0.9472
0.0111	5.07	730	0.2514	0.7654	0.8131	0.7885	0.6509	0.9614	0.8945	0.9507
0.0091	5.14	740	0.2417	0.7553	0.8196	0.7861	0.6476	0.9605	0.8969	0.9500
0.0093	5.21	750	0.2570	0.7454	0.8231	0.7823	0.6425	0.9595	0.8979	0.9466
0.0108	5.28	760	0.2699	0.7632	0.8094	0.7856	0.6470	0.9609	0.8925	0.9478
0.0113	5.35	770	0.2447	0.7684	0.8013	0.7845	0.6454	0.9610	0.8889	0.9486
0.0095	5.42	780	0.2600	0.7651	0.8148	0.7892	0.6518	0.9615	0.8953	0.9492
0.0102	5.49	790	0.2526	0.7461	0.8301	0.7859	0.6473	0.9600	0.9014	0.9492
0.0074	5.56	800	0.2671	0.7471	0.8251	0.7842	0.6450	0.9598	0.8990	0.9483
0.013	5.62	810	0.2597	0.7337	0.8357	0.7814	0.6412	0.9586	0.9031	0.9488
0.009	5.69	820	0.2585	0.7793	0.8002	0.7896	0.6523	0.9623	0.8891	0.9503
0.0083	5.76	830	0.2455	0.7634	0.8204	0.7909	0.6541	0.9616	0.8978	0.9506
0.0131	5.83	840	0.2434	0.7678	0.8123	0.7894	0.6521	0.9617	0.8942	0.9498
0.0096	5.9	850	0.2683	0.7468	0.8274	0.7850	0.6461	0.9599	0.9001	0.9474
0.0089	5.97	860	0.2687	0.7326	0.8391	0.7822	0.6424	0.9587	0.9047	0.9462
0.0065	6.04	870	0.3050	0.7296	0.8404	0.7811	0.6409	0.9583	0.9051	0.9456
0.0064	6.11	880	0.2895	0.7431	0.8299	0.7841	0.6449	0.9596	0.9010	0.9474
0.0057	6.18	890	0.2819	0.7631	0.8049	0.7834	0.6440	0.9606	0.8903	0.9480
0.008	6.25	900	0.2882	0.7539	0.8234	0.7871	0.6490	0.9606	0.8987	0.9489
0.01	6.32	910	0.2661	0.7397	0.8263	0.7806	0.6401	0.9589	0.8990	0.9481
0.009	6.39	920	0.2615	0.7526	0.8202	0.7850	0.6461	0.9602	0.8970	0.9493
0.0075	6.46	930	0.2813	0.7466	0.8185	0.7809	0.6406	0.9594	0.8958	0.9460
0.0087	6.53	940	0.2920	0.7187	0.8435	0.7761	0.6341	0.9569	0.9057	0.9434
0.01	6.6	950	0.3029	0.7336	0.8362	0.7816	0.6414	0.9586	0.9034	0.9465
0.0097	6.67	960	0.2884	0.7340	0.8379	0.7825	0.6428	0.9588	0.9042	0.9439
0.0085	6.74	970	0.2585	0.7882	0.7961	0.7921	0.6558	0.9630	0.8876	0.9513
0.0108	6.81	980	0.2473	0.7426	0.8311	0.7843	0.6452	0.9596	0.9016	0.9481
0.0069	6.88	990	0.3008	0.7397	0.8395	0.7864	0.6480	0.9597	0.9054	0.9452
0.0065	6.94	1000	0.2674	0.7489	0.8253	0.7852	0.6464	0.9601	0.8992	0.9476
0.0073	7.01	1010	0.2632	0.7700	0.8097	0.7893	0.6520	0.9618	0.8931	0.9494
0.0065	7.08	1020	0.2967	0.7702	0.8119	0.7905	0.6536	0.9619	0.8942	0.9496
0.006	7.15	1030	0.2652	0.7758	0.8029	0.7891	0.6517	0.9620	0.8902	0.9510
0.0057	7.22	1040	0.2660	0.7752	0.8090	0.7918	0.6553	0.9623	0.8931	0.9505
0.0083	7.29	1050	0.2830	0.7505	0.8222	0.7847	0.6457	0.9601	0.8978	0.9477
0.0037	7.36	1060	0.2928	0.7778	0.8046	0.7910	0.6543	0.9624	0.8912	0.9509
0.0067	7.43	1070	0.2678	0.7534	0.8198	0.7852	0.6464	0.9603	0.8969	0.9487
0.0081	7.5	1080	0.2849	0.7718	0.8147	0.7926	0.6565	0.9623	0.8957	0.9499
0.0049	7.57	1090	0.2787	0.7351	0.8272	0.7784	0.6373	0.9583	0.8991	0.9457
0.0061	7.64	1100	0.3090	0.7580	0.8164	0.7861	0.6476	0.9607	0.8956	0.9476
0.0061	7.71	1110	0.2962	0.7565	0.8180	0.7861	0.6475	0.9606	0.8962	0.9477
0.0058	7.78	1120	0.3089	0.7612	0.8209	0.7899	0.6528	0.9614	0.8979	0.9481
0.0056	7.85	1130	0.2688	0.7565	0.8109	0.7827	0.6430	0.9602	0.8928	0.9477
0.0076	7.92	1140	0.2946	0.7531	0.8164	0.7835	0.6441	0.9601	0.8952	0.9474
0.0056	7.99	1150	0.2830	0.7620	0.8093	0.7849	0.6460	0.9608	0.8924	0.9490
0.0043	8.06	1160	0.2700	0.7501	0.8278	0.7870	0.6488	0.9604	0.9005	0.9495
0.0064	8.12	1170	0.2852	0.7476	0.8330	0.7880	0.6502	0.9603	0.9029	0.9481
0.0043	8.19	1180	0.3124	0.7422	0.8337	0.7853	0.6465	0.9597	0.9028	0.9479
0.0059	8.26	1190	0.3273	0.7572	0.8242	0.7893	0.6519	0.9611	0.8993	0.9466
0.0055	8.33	1200	0.3113	0.7606	0.8193	0.7889	0.6514	0.9612	0.8971	0.9468
0.0076	8.4	1210	0.3085	0.7655	0.8139	0.7889	0.6514	0.9615	0.8948	0.9486
0.0064	8.47	1220	0.3107	0.7436	0.8143	0.7773	0.6358	0.9587	0.8935	0.9454
0.0067	8.54	1230	0.2876	0.7760	0.7996	0.7876	0.6496	0.9618	0.8886	0.9497
0.0056	8.61	1240	0.2885	0.7477	0.8185	0.7815	0.6414	0.9595	0.8959	0.9475
0.0055	8.68	1250	0.2806	0.7596	0.8124	0.7851	0.6462	0.9607	0.8937	0.9486
0.0042	8.75	1260	0.3050	0.7629	0.8094	0.7854	0.6467	0.9609	0.8925	0.9489
0.0036	8.82	1270	0.3332	0.7343	0.8268	0.7778	0.6364	0.9582	0.8989	0.9449
0.0052	8.89	1280	0.3299	0.7200	0.8340	0.7728	0.6298	0.9566	0.9012	0.9444
0.0059	8.96	1290	0.3039	0.7459	0.8220	0.7821	0.6421	0.9595	0.8974	0.9467
0.006	9.03	1300	0.2971	0.7554	0.8249	0.7886	0.6510	0.9609	0.8995	0.9496
0.0044	9.1	1310	0.2904	0.7627	0.8111	0.7861	0.6476	0.9610	0.8933	0.9489
0.0025	9.17	1320	0.3074	0.7595	0.8218	0.7894	0.6521	0.9612	0.8983	0.9490
0.0036	9.24	1330	0.3025	0.7517	0.8251	0.7867	0.6484	0.9604	0.8993	0.9473
0.0045	9.31	1340	0.3297	0.7543	0.8208	0.7861	0.6476	0.9605	0.8974	0.9463
0.0045	9.38	1350	0.3389	0.7446	0.8246	0.7826	0.6428	0.9595	0.8986	0.9455
0.0044	9.44	1360	0.3234	0.7570	0.8183	0.7864	0.6480	0.9607	0.8964	0.9468
0.004	9.51	1370	0.2960	0.7552	0.8124	0.7828	0.6431	0.9601	0.8934	0.9484
0.0034	9.58	1380	0.3135	0.7355	0.8300	0.7799	0.6392	0.9585	0.9005	0.9454
0.0037	9.65	1390	0.3199	0.7599	0.8167	0.7872	0.6491	0.9609	0.8958	0.9483
0.0031	9.72	1400	0.2958	0.7707	0.8045	0.7873	0.6492	0.9615	0.8906	0.9497
0.0056	9.79	1410	0.2923	0.7875	0.8033	0.7953	0.6602	0.9634	0.8911	0.9524
0.0041	9.86	1420	0.3007	0.7853	0.8033	0.7942	0.6587	0.9632	0.8910	0.9493
0.0045	9.93	1430	0.2946	0.7739	0.8122	0.7926	0.6565	0.9624	0.8946	0.9497
0.0038	10.0	1440	0.2966	0.7665	0.8239	0.7942	0.6586	0.9622	0.8998	0.9506
0.0034	10.07	1450	0.3444	0.7657	0.8296	0.7964	0.6616	0.9625	0.9025	0.9491
0.0039	10.14	1460	0.3293	0.7460	0.8367	0.7888	0.6512	0.9603	0.9045	0.9476
0.0037	10.21	1470	0.3170	0.7692	0.8241	0.7957	0.6607	0.9626	0.9000	0.9488
0.0026	10.28	1480	0.2905	0.7707	0.8225	0.7957	0.6608	0.9626	0.8994	0.9501
0.0022	10.35	1490	0.3046	0.7745	0.8135	0.7935	0.6577	0.9625	0.8953	0.9497
0.002	10.42	1500	0.3164	0.7673	0.8226	0.7940	0.6584	0.9622	0.8992	0.9495
0.0027	10.49	1510	0.3068	0.7515	0.8365	0.7917	0.6553	0.9611	0.9048	0.9485
0.0028	10.56	1520	0.3090	0.7674	0.8235	0.7945	0.6590	0.9623	0.8997	0.9497
0.0035	10.62	1530	0.3240	0.7685	0.8123	0.7898	0.6526	0.9617	0.8943	0.9493
0.0029	10.69	1540	0.3074	0.7807	0.8083	0.7943	0.6588	0.9630	0.8932	0.9499
0.0031	10.76	1550	0.3121	0.7636	0.8239	0.7926	0.6565	0.9619	0.8996	0.9515
0.0029	10.83	1560	0.3198	0.7565	0.8304	0.7917	0.6552	0.9613	0.9022	0.9489
0.003	10.9	1570	0.3207	0.7681	0.8208	0.7936	0.6578	0.9622	0.8984	0.9498
0.0022	10.97	1580	0.3139	0.7792	0.8103	0.7945	0.6590	0.9629	0.8940	0.9511
0.0022	11.04	1590	0.3254	0.7658	0.8177	0.7909	0.6542	0.9618	0.8967	0.9489
0.0026	11.11	1600	0.3404	0.7626	0.8246	0.7924	0.6561	0.9618	0.8998	0.9498
0.0033	11.18	1610	0.3316	0.7423	0.8391	0.7878	0.6499	0.9600	0.9054	0.9469
0.0019	11.25	1620	0.3167	0.7522	0.8270	0.7878	0.6499	0.9606	0.9003	0.9475
0.0041	11.32	1630	0.3387	0.7567	0.8276	0.7906	0.6537	0.9612	0.9009	0.9483
0.0028	11.39	1640	0.3365	0.7490	0.8332	0.7888	0.6513	0.9605	0.9030	0.9478
0.0033	11.46	1650	0.3313	0.7512	0.8254	0.7865	0.6482	0.9604	0.8994	0.9481
0.0041	11.53	1660	0.3290	0.7667	0.8214	0.7931	0.6572	0.9621	0.8986	0.9497
0.0026	11.6	1670	0.3249	0.7623	0.8177	0.7890	0.6515	0.9613	0.8965	0.9490
0.0029	11.67	1680	0.3270	0.7617	0.8276	0.7933	0.6574	0.9618	0.9013	0.9490
0.003	11.74	1690	0.3220	0.7553	0.8316	0.7916	0.6551	0.9613	0.9027	0.9489
0.0022	11.81	1700	0.3279	0.7474	0.8393	0.7906	0.6538	0.9607	0.9059	0.9481
0.0038	11.88	1710	0.3338	0.7481	0.8315	0.7876	0.6496	0.9603	0.9021	0.9476
0.0021	11.94	1720	0.3371	0.7608	0.8262	0.7921	0.6558	0.9616	0.9005	0.9488
0.0034	12.01	1730	0.2970	0.7611	0.8231	0.7909	0.6541	0.9615	0.8990	0.9496
0.0026	12.08	1740	0.3286	0.7646	0.8263	0.7943	0.6587	0.9621	0.9008	0.9486
0.0028	12.15	1750	0.3328	0.7537	0.8381	0.7936	0.6579	0.9614	0.9057	0.9493
0.0027	12.22	1760	0.3360	0.7660	0.8292	0.7963	0.6616	0.9625	0.9023	0.9486
0.0011	12.29	1770	0.3393	0.7689	0.8194	0.7934	0.6575	0.9622	0.8978	0.9486
0.0022	12.36	1780	0.3074	0.7634	0.8242	0.7926	0.6565	0.9618	0.8997	0.9497
0.0034	12.43	1790	0.2978	0.7716	0.8168	0.7935	0.6577	0.9624	0.8967	0.9515
0.0022	12.5	1800	0.3406	0.7615	0.8296	0.7941	0.6585	0.9619	0.9022	0.9474
0.0027	12.57	1810	0.3015	0.7722	0.8185	0.7947	0.6593	0.9626	0.8975	0.9517
0.0027	12.64	1820	0.3410	0.7726	0.8086	0.7902	0.6532	0.9620	0.8928	0.9495
0.0029	12.71	1830	0.3502	0.7596	0.8209	0.7891	0.6516	0.9612	0.8978	0.9488
0.002	12.78	1840	0.3431	0.7423	0.8275	0.7826	0.6428	0.9593	0.8998	0.9470
0.0026	12.85	1850	0.3509	0.7199	0.8449	0.7774	0.6359	0.9572	0.9065	0.9442
0.0037	12.92	1860	0.3322	0.7559	0.8181	0.7858	0.6472	0.9605	0.8962	0.9474
0.0037	12.99	1870	0.3351	0.7566	0.8160	0.7852	0.6464	0.9605	0.8953	0.9473
0.0022	13.06	1880	0.3241	0.7744	0.8086	0.7912	0.6545	0.9622	0.8929	0.9498
0.0042	13.12	1890	0.3370	0.7561	0.8193	0.7864	0.6480	0.9606	0.8968	0.9478
0.0023	13.19	1900	0.3372	0.7390	0.8250	0.7796	0.6388	0.9587	0.8984	0.9464
0.0032	13.26	1910	0.3448	0.7727	0.8091	0.7905	0.6536	0.9621	0.8930	0.9478
0.0021	13.33	1920	0.3529	0.7616	0.8176	0.7886	0.6510	0.9612	0.8964	0.9481
0.0021	13.4	1930	0.3332	0.7527	0.8280	0.7886	0.6509	0.9607	0.9008	0.9496
0.0025	13.47	1940	0.3456	0.7485	0.8274	0.7859	0.6474	0.9601	0.9002	0.9471
0.0014	13.54	1950	0.3375	0.7540	0.8262	0.7884	0.6507	0.9608	0.9000	0.9488
0.0029	13.61	1960	0.3187	0.7791	0.8106	0.7945	0.6591	0.9629	0.8941	0.9517
0.0016	13.68	1970	0.3296	0.7663	0.8205	0.7925	0.6563	0.9620	0.8981	0.9498
0.0016	13.75	1980	0.3524	0.7574	0.8251	0.7898	0.6526	0.9611	0.8997	0.9467
0.0026	13.82	1990	0.3295	0.7560	0.8243	0.7887	0.6511	0.9609	0.8993	0.9494
0.0021	13.89	2000	0.3474	0.7544	0.8234	0.7874	0.6493	0.9607	0.8987	0.9477
0.002	13.96	2010	0.3723	0.7484	0.8229	0.7839	0.6446	0.9599	0.8980	0.9450
0.0016	14.03	2020	0.3514	0.7628	0.8192	0.7900	0.6528	0.9615	0.8972	0.9481
0.0013	14.1	2030	0.3403	0.7777	0.8115	0.7943	0.6587	0.9628	0.8945	0.9498
0.0024	14.17	2040	0.3612	0.7582	0.8239	0.7897	0.6525	0.9612	0.8992	0.9472
0.0027	14.24	2050	0.3539	0.7610	0.8296	0.7938	0.6581	0.9619	0.9022	0.9481
0.0015	14.31	2060	0.3567	0.7473	0.8291	0.7860	0.6475	0.9601	0.9009	0.9464
0.0021	14.38	2070	0.3313	0.7698	0.8136	0.7911	0.6544	0.9620	0.8950	0.9497
0.0014	14.44	2080	0.3261	0.7591	0.8218	0.7892	0.6518	0.9612	0.8982	0.9490
0.001	14.51	2090	0.3227	0.7571	0.8250	0.7896	0.6523	0.9611	0.8996	0.9483
0.0013	14.58	2100	0.3590	0.7459	0.8324	0.7868	0.6485	0.9601	0.9024	0.9466
0.0011	14.65	2110	0.3553	0.7536	0.8234	0.7870	0.6488	0.9606	0.8986	0.9475
0.0018	14.72	2120	0.3418	0.7661	0.8222	0.7931	0.6572	0.9621	0.8989	0.9497
0.0015	14.79	2130	0.3744	0.7604	0.8231	0.7905	0.6536	0.9614	0.8990	0.9480
0.0013	14.86	2140	0.3617	0.7616	0.8213	0.7903	0.6534	0.9614	0.8982	0.9480
0.0027	14.93	2150	0.3696	0.7576	0.8247	0.7897	0.6525	0.9611	0.8996	0.9476
0.0015	15.0	2160	0.3678	0.7474	0.8239	0.7838	0.6445	0.9598	0.8985	0.9468
0.002	15.07	2170	0.3781	0.7522	0.8263	0.7875	0.6495	0.9605	0.8999	0.9469
0.0034	15.14	2180	0.3841	0.7388	0.8346	0.7838	0.6445	0.9593	0.9030	0.9464
0.0016	15.21	2190	0.3352	0.7560	0.8241	0.7885	0.6509	0.9609	0.8991	0.9485
0.0017	15.28	2200	0.3612	0.7524	0.8250	0.7870	0.6489	0.9605	0.8993	0.9470
0.0023	15.35	2210	0.3486	0.7726	0.8119	0.7918	0.6553	0.9622	0.8944	0.9489
0.0025	15.42	2220	0.3504	0.7478	0.8263	0.7851	0.6462	0.9600	0.8996	0.9474
0.0021	15.49	2230	0.3382	0.7642	0.8153	0.7889	0.6514	0.9614	0.8955	0.9485
0.0018	15.56	2240	0.3561	0.7576	0.8275	0.7910	0.6542	0.9613	0.9009	0.9485
0.0013	15.62	2250	0.3649	0.7603	0.8214	0.7897	0.6524	0.9613	0.8981	0.9478
0.0011	15.69	2260	0.3601	0.7446	0.8282	0.7841	0.6449	0.9597	0.9003	0.9463
0.0016	15.76	2270	0.3623	0.7574	0.8175	0.7863	0.6479	0.9607	0.8960	0.9478
0.0022	15.83	2280	0.3911	0.7487	0.8342	0.7892	0.6517	0.9606	0.9035	0.9463
0.0012	15.9	2290	0.3762	0.7497	0.8311	0.7883	0.6505	0.9605	0.9021	0.9470
0.0011	15.97	2300	0.3721	0.7401	0.8320	0.7834	0.6439	0.9593	0.9018	0.9460
0.0011	16.04	2310	0.3569	0.7613	0.8200	0.7895	0.6522	0.9613	0.8975	0.9488
0.0017	16.11	2320	0.3845	0.7393	0.8381	0.7856	0.6469	0.9595	0.9047	0.9460
0.0016	16.18	2330	0.3753	0.7417	0.8346	0.7854	0.6466	0.9596	0.9032	0.9469
0.0008	16.25	2340	0.3564	0.7636	0.8246	0.7929	0.6569	0.9619	0.8999	0.9488
0.0006	16.32	2350	0.3696	0.7617	0.8282	0.7935	0.6577	0.9619	0.9015	0.9488
0.0019	16.39	2360	0.3732	0.7611	0.8249	0.7917	0.6552	0.9616	0.8999	0.9483
0.0017	16.46	2370	0.3586	0.7543	0.8287	0.7897	0.6525	0.9610	0.9012	0.9482
0.002	16.53	2380	0.3660	0.7548	0.8295	0.7904	0.6534	0.9611	0.9017	0.9481
0.0009	16.6	2390	0.3637	0.7561	0.8271	0.7900	0.6529	0.9611	0.9006	0.9478
0.0015	16.67	2400	0.3894	0.7456	0.8356	0.7880	0.6502	0.9602	0.9039	0.9469
0.0012	16.74	2410	0.3621	0.7737	0.8176	0.7950	0.6598	0.9627	0.8972	0.9497
0.0008	16.81	2420	0.3579	0.7618	0.8263	0.7928	0.6567	0.9618	0.9006	0.9486
0.0015	16.88	2430	0.3312	0.7693	0.8250	0.7962	0.6614	0.9626	0.9005	0.9509
0.001	16.94	2440	0.3385	0.7770	0.8179	0.7969	0.6624	0.9631	0.8975	0.9518
0.0013	17.01	2450	0.3606	0.7574	0.8288	0.7915	0.6549	0.9614	0.9015	0.9488
0.001	17.08	2460	0.3395	0.7701	0.8181	0.7934	0.6575	0.9623	0.8972	0.9521
0.0011	17.15	2470	0.3755	0.7608	0.8243	0.7913	0.6547	0.9615	0.8996	0.9486
0.0009	17.22	2480	0.3700	0.7740	0.8122	0.7927	0.6565	0.9624	0.8946	0.9499
0.0015	17.29	2490	0.3767	0.7632	0.8231	0.7920	0.6557	0.9618	0.8992	0.9487
0.0014	17.36	2500	0.3732	0.7611	0.8233	0.7909	0.6542	0.9615	0.8991	0.9488
0.001	17.43	2510	0.3604	0.7670	0.8171	0.7913	0.6546	0.9619	0.8965	0.9493
0.0012	17.5	2520	0.3745	0.7458	0.8303	0.7857	0.6471	0.9599	0.9014	0.9475
0.002	17.57	2530	0.3699	0.7475	0.8296	0.7864	0.6480	0.9601	0.9012	0.9471
0.0012	17.64	2540	0.3655	0.7698	0.8168	0.7926	0.6565	0.9622	0.8965	0.9492
0.002	17.71	2550	0.3797	0.7504	0.8363	0.7911	0.6543	0.9609	0.9047	0.9470
0.0017	17.78	2560	0.3572	0.7719	0.8212	0.7958	0.6608	0.9627	0.8988	0.9500
0.0004	17.85	2570	0.3714	0.7559	0.8251	0.7890	0.6515	0.9610	0.8996	0.9481
0.0015	17.92	2580	0.3860	0.7484	0.8336	0.7887	0.6511	0.9605	0.9032	0.9470
0.0016	17.99	2590	0.3769	0.7729	0.8164	0.7941	0.6585	0.9625	0.8966	0.9488
0.0012	18.06	2600	0.3571	0.7686	0.8187	0.7928	0.6568	0.9621	0.8974	0.9506
0.0012	18.12	2610	0.3859	0.7526	0.8254	0.7873	0.6492	0.9605	0.8995	0.9481
0.0011	18.19	2620	0.3586	0.7840	0.8037	0.7938	0.6581	0.9630	0.8911	0.9504
0.0009	18.26	2630	0.3939	0.7498	0.8286	0.7872	0.6491	0.9604	0.9009	0.9472
0.001	18.33	2640	0.3741	0.7763	0.8147	0.7951	0.6598	0.9628	0.8960	0.9502
0.0006	18.4	2650	0.3940	0.7564	0.8295	0.7912	0.6546	0.9613	0.9018	0.9477
0.0012	18.47	2660	0.3584	0.7600	0.8286	0.7928	0.6567	0.9617	0.9016	0.9499
0.0024	18.54	2670	0.3707	0.7627	0.8303	0.7950	0.6598	0.9621	0.9026	0.9490
0.0007	18.61	2680	0.3716	0.7544	0.8329	0.7917	0.6552	0.9612	0.9033	0.9484
0.0002	18.68	2690	0.3727	0.7649	0.8247	0.7937	0.6580	0.9621	0.9001	0.9493
0.0015	18.75	2700	0.3965	0.7497	0.8330	0.7892	0.6518	0.9606	0.9030	0.9468
0.0015	18.82	2710	0.3857	0.7701	0.8163	0.7925	0.6563	0.9622	0.8963	0.9485
0.0011	18.89	2720	0.3919	0.7414	0.8295	0.7830	0.6434	0.9593	0.9007	0.9456
0.001	18.96	2730	0.3731	0.7622	0.8110	0.7858	0.6472	0.9609	0.8932	0.9478
0.0007	19.03	2740	0.3790	0.7493	0.8254	0.7855	0.6468	0.9601	0.8993	0.9467
0.0013	19.1	2750	0.3736	0.7565	0.8229	0.7883	0.6506	0.9609	0.8986	0.9481
0.0016	19.17	2760	0.3724	0.7602	0.8230	0.7903	0.6534	0.9614	0.8989	0.9479
0.0008	19.24	2770	0.3552	0.7610	0.8251	0.7918	0.6553	0.9616	0.9000	0.9498
0.0003	19.31	2780	0.3826	0.7620	0.8209	0.7904	0.6534	0.9615	0.8980	0.9481
0.0004	19.38	2790	0.3750	0.7560	0.8259	0.7894	0.6521	0.9610	0.9000	0.9481
0.0015	19.44	2800	0.3716	0.7502	0.8262	0.7863	0.6479	0.9603	0.8997	0.9474
0.0007	19.51	2810	0.3620	0.7643	0.8204	0.7914	0.6548	0.9617	0.8979	0.9499
0.0011	19.58	2820	0.3664	0.7539	0.8279	0.7892	0.6518	0.9609	0.9008	0.9486
0.0011	19.65	2830	0.3937	0.7507	0.8279	0.7874	0.6494	0.9605	0.9006	0.9469
0.0007	19.72	2840	0.3805	0.7591	0.8270	0.7916	0.6551	0.9615	0.9007	0.9485
0.0004	19.79	2850	0.3837	0.7564	0.8280	0.7906	0.6537	0.9612	0.9011	0.9476
0.0005	19.86	2860	0.3765	0.7523	0.8266	0.7877	0.6498	0.9606	0.9001	0.9478
0.0006	19.93	2870	0.3685	0.7537	0.8247	0.7876	0.6497	0.9607	0.8993	0.9478
0.0008	20.0	2880	0.3648	0.7666	0.8155	0.7903	0.6533	0.9617	0.8957	0.9496
0.0008	20.07	2890	0.3824	0.7611	0.8200	0.7894	0.6521	0.9613	0.8975	0.9487
0.0012	20.14	2900	0.3940	0.7522	0.8280	0.7883	0.6506	0.9607	0.9008	0.9473
0.0012	20.21	2910	0.3789	0.7665	0.8173	0.7911	0.6544	0.9618	0.8966	0.9496
0.0006	20.28	2920	0.3859	0.7559	0.8283	0.7904	0.6535	0.9611	0.9012	0.9485
0.001	20.35	2930	0.3871	0.7712	0.8172	0.7935	0.6577	0.9624	0.8968	0.9494
0.0005	20.42	2940	0.3897	0.7556	0.8300	0.7910	0.6543	0.9612	0.9020	0.9483
0.0009	20.49	2950	0.4065	0.7456	0.8319	0.7864	0.6479	0.9600	0.9022	0.9469
0.0008	20.56	2960	0.3785	0.7704	0.8172	0.7931	0.6571	0.9623	0.8968	0.9498
0.0005	20.62	2970	0.4003	0.7561	0.8242	0.7887	0.6511	0.9609	0.8992	0.9479
0.0007	20.69	2980	0.3964	0.7725	0.8131	0.7923	0.6560	0.9623	0.8949	0.9487
0.0003	20.76	2990	0.3927	0.7515	0.8315	0.7894	0.6521	0.9608	0.9024	0.9474
0.0005	20.83	3000	0.3626	0.7785	0.8107	0.7943	0.6588	0.9628	0.8942	0.9512
0.0006	20.9	3010	0.3946	0.7568	0.8283	0.7909	0.6542	0.9613	0.9012	0.9482
0.0008	20.97	3020	0.3895	0.7730	0.8175	0.7946	0.6592	0.9626	0.8971	0.9491
0.0006	21.04	3030	0.3750	0.7601	0.8279	0.7926	0.6564	0.9617	0.9013	0.9486
0.0008	21.11	3040	0.3803	0.7693	0.8184	0.7931	0.6571	0.9622	0.8973	0.9488
0.0003	21.18	3050	0.3911	0.7649	0.8201	0.7916	0.6550	0.9618	0.8978	0.9482
0.0008	21.25	3060	0.3972	0.7565	0.8319	0.7924	0.6562	0.9614	0.9029	0.9480
0.0012	21.32	3070	0.4029	0.7561	0.8290	0.7908	0.6540	0.9612	0.9015	0.9472
0.001	21.39	3080	0.3945	0.7513	0.8327	0.7899	0.6527	0.9608	0.9029	0.9473
0.0004	21.46	3090	0.3875	0.7587	0.8290	0.7923	0.6560	0.9615	0.9017	0.9482
0.0007	21.53	3100	0.4054	0.7558	0.8293	0.7909	0.6541	0.9612	0.9017	0.9475
0.0003	21.6	3110	0.3798	0.7629	0.8234	0.7920	0.6557	0.9617	0.8993	0.9492
0.001	21.67	3120	0.4012	0.7498	0.8332	0.7893	0.6519	0.9606	0.9031	0.9472
0.0007	21.74	3130	0.3827	0.7700	0.8135	0.7911	0.6544	0.9620	0.8950	0.9492
0.0009	21.81	3140	0.3879	0.7575	0.8237	0.7892	0.6518	0.9611	0.8990	0.9482
0.0004	21.88	3150	0.3863	0.7678	0.8169	0.7916	0.6551	0.9619	0.8965	0.9487
0.0004	21.94	3160	0.3952	0.7460	0.8320	0.7866	0.6483	0.9601	0.9022	0.9465
0.0006	22.01	3170	0.3841	0.7597	0.8259	0.7914	0.6548	0.9615	0.9003	0.9485
0.0006	22.08	3180	0.4018	0.7642	0.8233	0.7926	0.6565	0.9619	0.8993	0.9483
0.0006	22.15	3190	0.3931	0.7544	0.8291	0.7900	0.6529	0.9610	0.9014	0.9483
0.0005	22.22	3200	0.3803	0.7577	0.8263	0.7905	0.6536	0.9612	0.9003	0.9487
0.0002	22.29	3210	0.3846	0.7544	0.8280	0.7895	0.6522	0.9609	0.9009	0.9479
0.0012	22.36	3220	0.3975	0.7512	0.8295	0.7884	0.6507	0.9606	0.9014	0.9467
0.0006	22.43	3230	0.3687	0.7764	0.8131	0.7943	0.6588	0.9627	0.8952	0.9497
0.0005	22.5	3240	0.3863	0.7623	0.8251	0.7925	0.6563	0.9618	0.9001	0.9489
0.0004	22.57	3250	0.4062	0.7553	0.8263	0.7892	0.6518	0.9609	0.9002	0.9479
0.0008	22.64	3260	0.4026	0.7596	0.8268	0.7918	0.6554	0.9615	0.9007	0.9484
0.0006	22.71	3270	0.4057	0.7526	0.8291	0.7890	0.6515	0.9608	0.9013	0.9480
0.0006	22.78	3280	0.3985	0.7673	0.8229	0.7941	0.6586	0.9623	0.8993	0.9490
0.0004	22.85	3290	0.3911	0.7647	0.8278	0.7950	0.6598	0.9622	0.9015	0.9490
0.0008	22.92	3300	0.3828	0.7714	0.8233	0.7965	0.6618	0.9628	0.8998	0.9499
0.0005	22.99	3310	0.4088	0.7498	0.8330	0.7892	0.6518	0.9606	0.9030	0.9470
0.0008	23.06	3320	0.3973	0.7539	0.8316	0.7909	0.6541	0.9611	0.9026	0.9478
0.0008	23.12	3330	0.3820	0.7749	0.8190	0.7964	0.6617	0.9629	0.8980	0.9501
0.0008	23.19	3340	0.3839	0.7713	0.8192	0.7945	0.6591	0.9625	0.8978	0.9499
0.001	23.26	3350	0.3861	0.7576	0.8290	0.7917	0.6552	0.9614	0.9016	0.9488
0.0006	23.33	3360	0.4031	0.7496	0.8329	0.7891	0.6516	0.9606	0.9030	0.9474
0.0007	23.4	3370	0.3906	0.7648	0.8221	0.7924	0.6562	0.9619	0.8988	0.9491
0.0007	23.47	3380	0.3793	0.7586	0.8272	0.7914	0.6549	0.9614	0.9008	0.9495
0.0002	23.54	3390	0.3765	0.7569	0.8243	0.7892	0.6518	0.9610	0.8993	0.9492
0.0005	23.61	3400	0.3716	0.7639	0.8201	0.7910	0.6543	0.9617	0.8977	0.9496
0.0008	23.68	3410	0.3701	0.7690	0.8204	0.7938	0.6582	0.9623	0.8982	0.9501
0.0003	23.75	3420	0.3863	0.7656	0.8264	0.7948	0.6595	0.9623	0.9009	0.9497
0.0011	23.82	3430	0.3907	0.7656	0.8263	0.7948	0.6595	0.9623	0.9009	0.9496
0.0003	23.89	3440	0.3847	0.7708	0.8234	0.7962	0.6614	0.9627	0.8998	0.9500
0.0004	23.96	3450	0.3850	0.7678	0.8251	0.7954	0.6604	0.9625	0.9005	0.9500
0.0004	24.03	3460	0.3917	0.7640	0.8260	0.7938	0.6581	0.9620	0.9006	0.9493
0.0004	24.1	3470	0.3972	0.7613	0.8253	0.7920	0.6556	0.9616	0.9001	0.9487
0.0005	24.17	3480	0.3947	0.7519	0.8319	0.7899	0.6527	0.9608	0.9026	0.9481
0.0004	24.24	3490	0.3777	0.7570	0.8307	0.7921	0.6558	0.9614	0.9024	0.9501
0.0004	24.31	3500	0.3893	0.7678	0.8226	0.7943	0.6588	0.9623	0.8992	0.9503
0.0002	24.38	3510	0.3987	0.7576	0.8283	0.7913	0.6547	0.9614	0.9013	0.9488
0.0006	24.44	3520	0.4019	0.7548	0.8296	0.7905	0.6535	0.9611	0.9017	0.9485
0.0007	24.51	3530	0.3940	0.7629	0.8225	0.7916	0.6551	0.9617	0.8988	0.9493
0.0002	24.58	3540	0.4015	0.7592	0.8251	0.7908	0.6540	0.9614	0.8999	0.9485
0.0004	24.65	3550	0.4048	0.7525	0.8295	0.7891	0.6517	0.9608	0.9015	0.9478
0.0011	24.72	3560	0.3947	0.7637	0.8230	0.7922	0.6560	0.9618	0.8991	0.9490
0.0009	24.79	3570	0.3920	0.7559	0.8276	0.7902	0.6531	0.9611	0.9008	0.9487
0.0006	24.86	3580	0.3964	0.7583	0.8270	0.7911	0.6544	0.9614	0.9007	0.9488
0.0008	24.93	3590	0.3969	0.7577	0.8284	0.7915	0.6549	0.9614	0.9014	0.9489
0.0004	25.0	3600	0.3893	0.7599	0.8293	0.7931	0.6571	0.9617	0.9020	0.9493
0.0002	25.07	3610	0.3893	0.7595	0.8279	0.7922	0.6559	0.9616	0.9012	0.9492
0.0003	25.14	3620	0.3895	0.7657	0.8238	0.7937	0.6580	0.9621	0.8997	0.9498
0.0002	25.21	3630	0.4032	0.7529	0.8319	0.7904	0.6535	0.9610	0.9027	0.9487
0.0004	25.28	3640	0.4006	0.7523	0.8336	0.7909	0.6541	0.9610	0.9035	0.9491
0.0007	25.35	3650	0.3961	0.7543	0.8338	0.7921	0.6558	0.9613	0.9037	0.9491
0.0005	25.42	3660	0.3899	0.7670	0.8225	0.7938	0.6580	0.9622	0.8991	0.9501
0.0005	25.49	3670	0.3908	0.7642	0.8241	0.7930	0.6570	0.9619	0.8997	0.9501
0.0007	25.56	3680	0.3955	0.7527	0.8308	0.7898	0.6526	0.9609	0.9022	0.9493
0.0002	25.62	3690	0.3988	0.7544	0.8295	0.7901	0.6531	0.9610	0.9016	0.9493
0.0004	25.69	3700	0.3983	0.7703	0.8206	0.7947	0.6593	0.9625	0.8984	0.9503
0.0007	25.76	3710	0.4074	0.7587	0.8259	0.7909	0.6541	0.9614	0.9002	0.9488
0.0004	25.83	3720	0.4113	0.7575	0.8268	0.7907	0.6538	0.9613	0.9006	0.9483
0.0006	25.9	3730	0.3985	0.7679	0.8208	0.7935	0.6576	0.9622	0.8983	0.9497
0.0006	25.97	3740	0.3902	0.7656	0.8231	0.7933	0.6575	0.9621	0.8993	0.9500
0.0004	26.04	3750	0.3937	0.7573	0.8303	0.7921	0.6558	0.9614	0.9022	0.9494
0.0006	26.11	3760	0.3979	0.7524	0.8316	0.7900	0.6529	0.9609	0.9025	0.9489
0.0003	26.18	3770	0.3914	0.7645	0.8239	0.7931	0.6571	0.9620	0.8996	0.9504
0.001	26.25	3780	0.3939	0.7621	0.8246	0.7921	0.6558	0.9617	0.8998	0.9501
0.0011	26.32	3790	0.4015	0.7536	0.8313	0.7906	0.6537	0.9610	0.9025	0.9489
0.0004	26.39	3800	0.3952	0.7592	0.8274	0.7918	0.6554	0.9615	0.9009	0.9495
0.0002	26.46	3810	0.3864	0.7700	0.8200	0.7942	0.6587	0.9624	0.8981	0.9505
0.0004	26.53	3820	0.3897	0.7644	0.8249	0.7935	0.6576	0.9620	0.9001	0.9499
0.0005	26.6	3830	0.3912	0.7640	0.8260	0.7938	0.6581	0.9620	0.9006	0.9498
0.0006	26.67	3840	0.3896	0.7609	0.8271	0.7926	0.6565	0.9617	0.9009	0.9495
0.0004	26.74	3850	0.3896	0.7651	0.8227	0.7929	0.6569	0.9620	0.8991	0.9496
0.0005	26.81	3860	0.3891	0.7703	0.8180	0.7934	0.6576	0.9623	0.8972	0.9502
0.0006	26.88	3870	0.3914	0.7645	0.8216	0.7920	0.6556	0.9618	0.8985	0.9497
0.0001	26.94	3880	0.3925	0.7595	0.8249	0.7908	0.6540	0.9614	0.8997	0.9492
0.0009	27.01	3890	0.3876	0.7705	0.8198	0.7944	0.6589	0.9625	0.8981	0.9504
0.0008	27.08	3900	0.3928	0.7683	0.8204	0.7935	0.6577	0.9622	0.8982	0.9499
0.0004	27.15	3910	0.4046	0.7614	0.8264	0.7926	0.6564	0.9617	0.9007	0.9490
0.0001	27.22	3920	0.4051	0.7637	0.8253	0.7933	0.6574	0.9619	0.9002	0.9489
0.0009	27.29	3930	0.4008	0.7658	0.8231	0.7934	0.6576	0.9621	0.8994	0.9495
0.0004	27.36	3940	0.3989	0.7645	0.8242	0.7932	0.6573	0.9620	0.8998	0.9497
0.0003	27.43	3950	0.4018	0.7614	0.8263	0.7926	0.6564	0.9617	0.9006	0.9494
0.0006	27.5	3960	0.4048	0.7603	0.8274	0.7924	0.6562	0.9616	0.9010	0.9491
0.0005	27.57	3970	0.4018	0.7631	0.8262	0.7934	0.6575	0.9619	0.9006	0.9495
0.0009	27.64	3980	0.3989	0.7622	0.8253	0.7925	0.6563	0.9618	0.9001	0.9497
0.0001	27.71	3990	0.4047	0.7657	0.8237	0.7936	0.6579	0.9621	0.8996	0.9495
0.0004	27.78	4000	0.4064	0.7649	0.8246	0.7936	0.6579	0.9621	0.9000	0.9493
0.0004	27.85	4010	0.4100	0.7610	0.8276	0.7929	0.6569	0.9618	0.9012	0.9491
0.0002	27.92	4020	0.4093	0.7623	0.8266	0.7932	0.6572	0.9619	0.9008	0.9496
0.0006	27.99	4030	0.4012	0.7711	0.8194	0.7945	0.6591	0.9625	0.8979	0.9504
0.0003	28.06	4040	0.4017	0.7726	0.8172	0.7943	0.6588	0.9625	0.8969	0.9503
0.0002	28.12	4050	0.4142	0.7593	0.8278	0.7920	0.6557	0.9615	0.9011	0.9488
0.0002	28.19	4060	0.4203	0.7526	0.8313	0.7900	0.6529	0.9609	0.9024	0.9480
0.0001	28.26	4070	0.4261	0.7501	0.8336	0.7896	0.6524	0.9607	0.9033	0.9476
0.0001	28.33	4080	0.4191	0.7526	0.8328	0.7906	0.6538	0.9610	0.9031	0.9482
0.0003	28.4	4090	0.4087	0.7633	0.8271	0.7939	0.6583	0.9620	0.9011	0.9496
0.0003	28.47	4100	0.4021	0.7673	0.8217	0.7935	0.6578	0.9622	0.8987	0.9499
0.0002	28.54	4110	0.4031	0.7649	0.8238	0.7933	0.6574	0.9620	0.8996	0.9500
0.0008	28.61	4120	0.4051	0.7626	0.8247	0.7924	0.6562	0.9618	0.8999	0.9496
0.0005	28.68	4130	0.4058	0.7603	0.8270	0.7922	0.6559	0.9616	0.9008	0.9495
0.0006	28.75	4140	0.4036	0.7616	0.8272	0.7931	0.6571	0.9618	0.9011	0.9497
0.0003	28.82	4150	0.4002	0.7648	0.8263	0.7944	0.6589	0.9621	0.9008	0.9498
0.0005	28.89	4160	0.3991	0.7652	0.8251	0.7940	0.6584	0.9621	0.9003	0.9497
0.0002	28.96	4170	0.3976	0.7677	0.8222	0.7940	0.6584	0.9623	0.8990	0.9499
0.0006	29.03	4180	0.3978	0.7691	0.8217	0.7945	0.6591	0.9624	0.8989	0.9501
0.0002	29.1	4190	0.3961	0.7722	0.8196	0.7952	0.6600	0.9626	0.8980	0.9505
0.0004	29.17	4200	0.3967	0.7704	0.8223	0.7956	0.6605	0.9626	0.8993	0.9504
0.0004	29.24	4210	0.4029	0.7642	0.8259	0.7939	0.6582	0.9621	0.9006	0.9495
0.0001	29.31	4220	0.4032	0.7638	0.8263	0.7938	0.6581	0.9620	0.9008	0.9494
0.0003	29.38	4230	0.4010	0.7657	0.8251	0.7943	0.6588	0.9622	0.9003	0.9497
0.0002	29.44	4240	0.4002	0.7684	0.8246	0.7955	0.6604	0.9625	0.9002	0.9500
0.0002	29.51	4250	0.4060	0.7588	0.8283	0.7920	0.6557	0.9615	0.9014	0.9490
0.0002	29.58	4260	0.4083	0.7586	0.8283	0.7919	0.6556	0.9615	0.9014	0.9490
0.0005	29.65	4270	0.4146	0.7565	0.8283	0.7907	0.6539	0.9612	0.9012	0.9485
0.0002	29.72	4280	0.4140	0.7604	0.8260	0.7918	0.6554	0.9616	0.9004	0.9488
0.0005	29.79	4290	0.4117	0.7663	0.8225	0.7934	0.6576	0.9621	0.8991	0.9494
0.0006	29.86	4300	0.4104	0.7689	0.8216	0.7944	0.6589	0.9624	0.8988	0.9497
0.0004	29.93	4310	0.4084	0.7696	0.8218	0.7948	0.6595	0.9625	0.8990	0.9500
0.0005	30.0	4320	0.4107	0.7633	0.8251	0.7930	0.6570	0.9619	0.9001	0.9494
0.0004	30.07	4330	0.4120	0.7571	0.8295	0.7916	0.6551	0.9614	0.9018	0.9488
0.0002	30.14	4340	0.4107	0.7581	0.8286	0.7917	0.6553	0.9614	0.9014	0.9489
0.0005	30.21	4350	0.4097	0.7591	0.8286	0.7923	0.6560	0.9616	0.9015	0.9490
0.0002	30.28	4360	0.4113	0.7578	0.8283	0.7915	0.6549	0.9614	0.9013	0.9487
0.0003	30.35	4370	0.4092	0.7620	0.8268	0.7931	0.6571	0.9618	0.9009	0.9491
0.0002	30.42	4380	0.4082	0.7630	0.8257	0.7931	0.6571	0.9619	0.9004	0.9493
0.0005	30.49	4390	0.4064	0.7646	0.8255	0.7939	0.6582	0.9621	0.9004	0.9495
0.0008	30.56	4400	0.4046	0.7661	0.8247	0.7944	0.6589	0.9622	0.9001	0.9497
0.0004	30.62	4410	0.4033	0.7669	0.8241	0.7945	0.6590	0.9623	0.8999	0.9498
0.0002	30.69	4420	0.4064	0.7647	0.8247	0.7936	0.6578	0.9620	0.9000	0.9496
0.0006	30.76	4430	0.4078	0.7625	0.8251	0.7926	0.6564	0.9618	0.9001	0.9493
0.0002	30.83	4440	0.4085	0.7605	0.8257	0.7917	0.6552	0.9616	0.9002	0.9491
0.0008	30.9	4450	0.4091	0.7595	0.8264	0.7916	0.6550	0.9615	0.9005	0.9490
0.0002	30.97	4460	0.4085	0.76	0.8257	0.7915	0.6549	0.9615	0.9002	0.9490
0.0001	31.04	4470	0.4076	0.7604	0.8251	0.7915	0.6549	0.9615	0.8999	0.9491
0.0007	31.11	4480	0.4071	0.7615	0.8251	0.7920	0.6556	0.9617	0.9000	0.9493
0.0002	31.18	4490	0.4047	0.7630	0.8243	0.7925	0.6563	0.9618	0.8997	0.9495
0.0005	31.25	4500	0.4029	0.7652	0.8237	0.7934	0.6575	0.9620	0.8996	0.9498
0.0005	31.32	4510	0.4042	0.7635	0.8241	0.7926	0.6565	0.9618	0.8996	0.9495
0.0002	31.39	4520	0.4068	0.7608	0.8250	0.7916	0.6551	0.9616	0.8999	0.9491
0.0003	31.46	4530	0.4079	0.7601	0.8264	0.7919	0.6555	0.9616	0.9006	0.9490
0.0001	31.53	4540	0.4085	0.7588	0.8278	0.7918	0.6553	0.9615	0.9011	0.9489
0.0004	31.6	4550	0.4075	0.7596	0.8270	0.7919	0.6555	0.9615	0.9008	0.9490
0.0003	31.67	4560	0.4051	0.7622	0.8254	0.7925	0.6563	0.9618	0.9002	0.9492
0.0002	31.74	4570	0.4042	0.7626	0.8253	0.7927	0.6566	0.9618	0.9002	0.9493
0.0006	31.81	4580	0.4069	0.7615	0.8259	0.7924	0.6562	0.9617	0.9004	0.9491
0.0009	31.88	4590	0.4087	0.7609	0.8259	0.7921	0.6557	0.9616	0.9004	0.9490
0.0004	31.94	4600	0.4095	0.7603	0.8263	0.7919	0.6556	0.9616	0.9005	0.9488
0.0001	32.01	4610	0.4077	0.7604	0.8264	0.7920	0.6557	0.9616	0.9006	0.9489
0.0003	32.08	4620	0.4067	0.7612	0.8260	0.7923	0.6560	0.9617	0.9004	0.9490
0.0001	32.15	4630	0.4062	0.7616	0.8258	0.7924	0.6562	0.9617	0.9003	0.9491
0.0004	32.22	4640	0.4059	0.7615	0.8255	0.7922	0.6559	0.9617	0.9002	0.9491
0.0002	32.29	4650	0.4048	0.7617	0.8257	0.7924	0.6561	0.9617	0.9003	0.9492
0.0004	32.36	4660	0.4046	0.7614	0.8262	0.7925	0.6563	0.9617	0.9005	0.9492
0.0002	32.43	4670	0.4044	0.7616	0.8263	0.7927	0.6565	0.9618	0.9006	0.9492
0.0003	32.5	4680	0.4044	0.7614	0.8262	0.7925	0.6563	0.9617	0.9005	0.9492
0.0005	32.57	4690	0.4051	0.7607	0.8266	0.7923	0.6560	0.9616	0.9007	0.9491
0.0002	32.64	4700	0.4054	0.7606	0.8264	0.7922	0.6559	0.9616	0.9006	0.9490
0.0004	32.71	4710	0.4058	0.7607	0.8266	0.7923	0.6560	0.9616	0.9007	0.9490
0.0008	32.78	4720	0.4059	0.7610	0.8259	0.7921	0.6558	0.9616	0.9004	0.9490
0.0001	32.85	4730	0.4059	0.7610	0.8262	0.7923	0.6560	0.9617	0.9005	0.9491
0.0002	32.92	4740	0.4063	0.7609	0.8264	0.7923	0.6561	0.9617	0.9006	0.9490
0.0005	32.99	4750	0.4068	0.7609	0.8263	0.7922	0.6560	0.9617	0.9006	0.9490
0.0001	33.06	4760	0.4068	0.7607	0.8260	0.7920	0.6557	0.9616	0.9004	0.9490
0.0006	33.12	4770	0.4061	0.7615	0.8257	0.7923	0.6560	0.9617	0.9003	0.9490
0.0002	33.19	4780	0.4057	0.7620	0.8255	0.7925	0.6563	0.9618	0.9002	0.9491
0.0001	33.26	4790	0.4056	0.7625	0.8253	0.7926	0.6565	0.9618	0.9002	0.9491
0.0003	33.33	4800	0.4058	0.7625	0.8253	0.7926	0.6565	0.9618	0.9002	0.9491
0.0002	33.4	4810	0.4063	0.7622	0.8259	0.7928	0.6567	0.9618	0.9005	0.9490
0.0005	33.47	4820	0.4067	0.7618	0.8263	0.7928	0.6567	0.9618	0.9006	0.9490
0.0003	33.54	4830	0.4069	0.7619	0.8263	0.7928	0.6567	0.9618	0.9006	0.9490
0.0004	33.61	4840	0.4070	0.7618	0.8263	0.7928	0.6567	0.9618	0.9006	0.9490
0.0004	33.68	4850	0.4069	0.7619	0.8263	0.7928	0.6567	0.9618	0.9006	0.9490
0.0001	33.75	4860	0.4067	0.7620	0.8263	0.7929	0.6568	0.9618	0.9006	0.9490
0.0003	33.82	4870	0.4066	0.7621	0.8264	0.7930	0.6570	0.9618	0.9007	0.9490
0.0001	33.89	4880	0.4067	0.7619	0.8266	0.7929	0.6569	0.9618	0.9007	0.9490
0.0004	33.96	4890	0.4066	0.7619	0.8264	0.7929	0.6568	0.9618	0.9007	0.9491
0.0002	34.03	4900	0.4067	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491
0.0003	34.1	4910	0.4067	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491
0.0001	34.17	4920	0.4067	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491
0.0002	34.24	4930	0.4066	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491
0.0002	34.31	4940	0.4066	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491
0.0005	34.38	4950	0.4067	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491
0.0008	34.44	4960	0.4067	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491
0.0004	34.51	4970	0.4067	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491
0.0001	34.58	4980	0.4067	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491
0.0005	34.65	4990	0.4067	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491
0.0005	34.72	5000	0.4067	0.7620	0.8264	0.7929	0.6569	0.9618	0.9007	0.9491

Framework versions

• Transformers 4.34.1
• Pytorch 2.0.1
• Datasets 2.14.6
• Tokenizers 0.14.1