nerugm-pt-pl20-2

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.1897
• Location Precision: 0.8052
• Location Recall: 0.8611
• Location F1: 0.8322
• Location Number: 72
• Organization Precision: 0.7294
• Organization Recall: 0.8267
• Organization F1: 0.7750
• Organization Number: 75
• Person Precision: 0.8671
• Person Recall: 0.9580
• Person F1: 0.9103
• Person Number: 143
• Quantity Precision: 0.6
• Quantity Recall: 0.7826
• Quantity F1: 0.6792
• Quantity Number: 23
• Time Precision: 0.8519
• Time Recall: 0.8846
• Time F1: 0.8679
• Time Number: 26
• Overall Precision: 0.8011
• Overall Recall: 0.8909
• Overall F1: 0.8436
• Overall Accuracy: 0.9605

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100.0

Training results

Training Loss	Epoch	Step	Validation Loss	Location Precision	Location Recall	Location F1	Location Number	Organization Precision	Organization Recall	Organization F1	Organization Number	Person Precision	Person Recall	Person F1	Person Number	Quantity Precision	Quantity Recall	Quantity F1	Quantity Number	Time Precision	Time Recall	Time F1	Time Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.9915	1.0	106	0.5524	0.0	0.0	0.0	72	0.0	0.0	0.0	75	0.125	0.0140	0.0252	143	0.0	0.0	0.0	23	0.0	0.0	0.0	26	0.0690	0.0059	0.0109	0.8479
0.5062	2.0	212	0.3516	0.2857	0.0278	0.0506	72	0.0370	0.0133	0.0196	75	0.4444	0.6434	0.5257	143	0.0	0.0	0.0	23	0.5652	0.5	0.5306	26	0.3927	0.3186	0.3518	0.8919
0.325	3.0	318	0.2219	0.5542	0.6389	0.5935	72	0.4848	0.64	0.5517	75	0.7633	0.9021	0.8269	143	0.3182	0.6087	0.4179	23	0.6897	0.7692	0.7273	26	0.6061	0.7581	0.6737	0.9272
0.2281	4.0	424	0.2034	0.6627	0.7639	0.7097	72	0.5248	0.7067	0.6023	75	0.7870	0.9301	0.8526	143	0.24	0.5217	0.3288	23	0.6	0.8077	0.6885	26	0.6256	0.8083	0.7053	0.9342
0.1893	5.0	530	0.1611	0.7195	0.8194	0.7662	72	0.5446	0.7333	0.625	75	0.8160	0.9301	0.8693	143	0.3846	0.6522	0.4839	23	0.75	0.8077	0.7778	26	0.6852	0.8348	0.7527	0.9442
0.1709	6.0	636	0.1525	0.6383	0.8333	0.7229	72	0.5688	0.8267	0.6739	75	0.8438	0.9441	0.8911	143	0.4571	0.6957	0.5517	23	0.7333	0.8462	0.7857	26	0.6893	0.8702	0.7692	0.9482
0.1574	7.0	742	0.1540	0.7024	0.8194	0.7564	72	0.6224	0.8133	0.7052	75	0.8333	0.9441	0.8852	143	0.4634	0.8261	0.5938	23	0.75	0.8077	0.7778	26	0.7143	0.8702	0.7846	0.9490
0.1455	8.0	848	0.1488	0.6829	0.7778	0.7273	72	0.6117	0.84	0.7079	75	0.8385	0.9441	0.8882	143	0.5758	0.8261	0.6786	23	0.5882	0.7692	0.6667	26	0.7094	0.8643	0.7793	0.9480
0.1415	9.0	954	0.1528	0.7407	0.8333	0.7843	72	0.6038	0.8533	0.7072	75	0.8428	0.9371	0.8874	143	0.6129	0.8261	0.7037	23	0.6452	0.7692	0.7018	26	0.7279	0.8761	0.7952	0.9472
0.1317	10.0	1060	0.1349	0.75	0.7917	0.7703	72	0.5882	0.8	0.6780	75	0.8553	0.9510	0.9007	143	0.5294	0.7826	0.6316	23	0.7	0.8077	0.75	26	0.7282	0.8614	0.7892	0.9527
0.1258	11.0	1166	0.1318	0.7407	0.8333	0.7843	72	0.6932	0.8133	0.7485	75	0.8471	0.9301	0.8867	143	0.5758	0.8261	0.6786	23	0.7333	0.8462	0.7857	26	0.7584	0.8702	0.8104	0.9572
0.1198	12.0	1272	0.1363	0.7403	0.7917	0.7651	72	0.7059	0.8	0.7500	75	0.8535	0.9371	0.8933	143	0.6667	0.8696	0.7547	23	0.8148	0.8462	0.8302	26	0.7793	0.8643	0.8196	0.9580
0.1144	13.0	1378	0.1362	0.7125	0.7917	0.75	72	0.6321	0.8933	0.7403	75	0.8608	0.9510	0.9037	143	0.7037	0.8261	0.76	23	0.7857	0.8462	0.8148	26	0.7544	0.8879	0.8157	0.9570
0.1142	14.0	1484	0.1354	0.7632	0.8056	0.7838	72	0.7143	0.8667	0.7831	75	0.8662	0.9510	0.9067	143	0.5278	0.8261	0.6441	23	0.7667	0.8846	0.8214	26	0.7718	0.8879	0.8258	0.9587
0.1079	15.0	1590	0.1299	0.7568	0.7778	0.7671	72	0.7273	0.8533	0.7853	75	0.8662	0.9510	0.9067	143	0.6333	0.8261	0.7170	23	0.7857	0.8462	0.8148	26	0.7878	0.8761	0.8296	0.9595
0.1044	16.0	1696	0.1469	0.7595	0.8333	0.7947	72	0.6667	0.9067	0.7684	75	0.8544	0.9441	0.8970	143	0.6207	0.7826	0.6923	23	0.8462	0.8462	0.8462	26	0.7690	0.8938	0.8267	0.9547
0.099	17.0	1802	0.1367	0.7632	0.8056	0.7838	72	0.7159	0.84	0.7730	75	0.8526	0.9301	0.8896	143	0.5625	0.7826	0.6545	23	0.8462	0.8462	0.8462	26	0.7778	0.8673	0.8201	0.9570
0.095	18.0	1908	0.1454	0.7867	0.8194	0.8027	72	0.7174	0.88	0.7904	75	0.8516	0.9231	0.8859	143	0.5806	0.7826	0.6667	23	0.7857	0.8462	0.8148	26	0.7795	0.8761	0.825	0.9575
0.0926	19.0	2014	0.1384	0.7895	0.8333	0.8108	72	0.6989	0.8667	0.7738	75	0.8636	0.9301	0.8956	143	0.5625	0.7826	0.6545	23	0.8462	0.8462	0.8462	26	0.7822	0.8791	0.8278	0.9582
0.088	20.0	2120	0.1605	0.7821	0.8472	0.8133	72	0.6804	0.88	0.7674	75	0.8710	0.9441	0.9060	143	0.5588	0.8261	0.6667	23	0.8077	0.8077	0.8077	26	0.7744	0.8909	0.8285	0.9542
0.0878	21.0	2226	0.1483	0.7763	0.8194	0.7973	72	0.6476	0.9067	0.7556	75	0.8710	0.9441	0.9060	143	0.6129	0.8261	0.7037	23	0.88	0.8462	0.8627	26	0.7730	0.8938	0.8290	0.9562
0.089	22.0	2332	0.1543	0.7867	0.8194	0.8027	72	0.6422	0.9333	0.7609	75	0.8616	0.9580	0.9073	143	0.5278	0.8261	0.6441	23	0.7778	0.8077	0.7925	26	0.7537	0.9027	0.8215	0.9535
0.0835	23.0	2438	0.1461	0.8	0.8333	0.8163	72	0.6737	0.8533	0.7529	75	0.8758	0.9371	0.9054	143	0.5455	0.7826	0.6429	23	0.8077	0.8077	0.8077	26	0.7775	0.8761	0.8239	0.9557
0.0789	24.0	2544	0.1454	0.8289	0.875	0.8514	72	0.7045	0.8267	0.7607	75	0.8774	0.9510	0.9128	143	0.5455	0.7826	0.6429	23	0.84	0.8077	0.8235	26	0.7958	0.8850	0.8380	0.9567
0.0773	25.0	2650	0.1376	0.84	0.875	0.8571	72	0.7111	0.8533	0.7758	75	0.8701	0.9371	0.9024	143	0.5806	0.7826	0.6667	23	0.7333	0.8462	0.7857	26	0.7921	0.8879	0.8373	0.9590
0.0779	26.0	2756	0.1367	0.8243	0.8472	0.8356	72	0.6702	0.84	0.7456	75	0.8662	0.9510	0.9067	143	0.6207	0.7826	0.6923	23	0.75	0.8077	0.7778	26	0.7827	0.8820	0.8294	0.9600
0.0735	27.0	2862	0.1394	0.8378	0.8611	0.8493	72	0.7229	0.8	0.7595	75	0.8831	0.9510	0.9158	143	0.6207	0.7826	0.6923	23	0.8519	0.8846	0.8679	26	0.8147	0.8820	0.8470	0.9630
0.0718	28.0	2968	0.1376	0.8108	0.8333	0.8219	72	0.7079	0.84	0.7683	75	0.8874	0.9371	0.9116	143	0.6	0.7826	0.6792	23	0.7333	0.8462	0.7857	26	0.7941	0.8761	0.8331	0.9605
0.071	29.0	3074	0.1549	0.7895	0.8333	0.8108	72	0.6701	0.8667	0.7558	75	0.8774	0.9510	0.9128	143	0.5455	0.7826	0.6429	23	0.7333	0.8462	0.7857	26	0.7698	0.8879	0.8247	0.9572
0.0717	30.0	3180	0.1433	0.7838	0.8056	0.7945	72	0.6957	0.8533	0.7665	75	0.8896	0.9580	0.9226	143	0.6	0.7826	0.6792	23	0.7778	0.8077	0.7925	26	0.7905	0.8791	0.8324	0.9605
0.071	31.0	3286	0.1437	0.8267	0.8611	0.8435	72	0.7253	0.88	0.7952	75	0.8831	0.9510	0.9158	143	0.6667	0.7826	0.72	23	0.8077	0.8077	0.8077	26	0.8123	0.8938	0.8511	0.9620
0.0652	32.0	3392	0.1425	0.8108	0.8333	0.8219	72	0.7273	0.8533	0.7853	75	0.8693	0.9301	0.8986	143	0.6429	0.7826	0.7059	23	0.7778	0.8077	0.7925	26	0.8	0.8732	0.8350	0.9605
0.0664	33.0	3498	0.1493	0.8158	0.8611	0.8378	72	0.7143	0.8667	0.7831	75	0.8758	0.9371	0.9054	143	0.6429	0.7826	0.7059	23	0.8462	0.8462	0.8462	26	0.8048	0.8879	0.8443	0.9612
0.0623	34.0	3604	0.1654	0.775	0.8611	0.8158	72	0.6907	0.8933	0.7791	75	0.8718	0.9510	0.9097	143	0.5806	0.7826	0.6667	23	0.7	0.8077	0.75	26	0.7716	0.8968	0.8295	0.9572
0.0615	35.0	3710	0.1494	0.7895	0.8333	0.8108	72	0.7111	0.8533	0.7758	75	0.8693	0.9301	0.8986	143	0.6207	0.7826	0.6923	23	0.75	0.8077	0.7778	26	0.7872	0.8732	0.8280	0.9595
0.0589	36.0	3816	0.1494	0.8052	0.8611	0.8322	72	0.6989	0.8667	0.7738	75	0.8766	0.9441	0.9091	143	0.6429	0.7826	0.7059	23	0.8462	0.8462	0.8462	26	0.7989	0.8909	0.8424	0.9612
0.0576	37.0	3922	0.1579	0.7468	0.8194	0.7815	72	0.6947	0.88	0.7765	75	0.8718	0.9510	0.9097	143	0.6429	0.7826	0.7059	23	0.8462	0.8462	0.8462	26	0.7839	0.8879	0.8326	0.9592
0.0586	38.0	4028	0.1528	0.7973	0.8194	0.8082	72	0.7442	0.8533	0.7950	75	0.8608	0.9510	0.9037	143	0.6	0.7826	0.6792	23	0.7778	0.8077	0.7925	26	0.7947	0.8791	0.8347	0.9590
0.0577	39.0	4134	0.1617	0.8158	0.8611	0.8378	72	0.6989	0.8667	0.7738	75	0.8903	0.9650	0.9262	143	0.6429	0.7826	0.7059	23	0.8462	0.8462	0.8462	26	0.8069	0.8997	0.8508	0.9600
0.0536	40.0	4240	0.1580	0.8	0.8889	0.8421	72	0.7045	0.8267	0.7607	75	0.8766	0.9441	0.9091	143	0.6	0.7826	0.6792	23	0.75	0.8077	0.7778	26	0.7895	0.8850	0.8345	0.9602
0.0572	41.0	4346	0.1550	0.8052	0.8611	0.8322	72	0.6957	0.8533	0.7665	75	0.8734	0.9650	0.9169	143	0.6429	0.7826	0.7059	23	0.8846	0.8846	0.8846	26	0.8005	0.8997	0.8472	0.9597
0.0524	42.0	4452	0.1589	0.7722	0.8472	0.8079	72	0.7143	0.8667	0.7831	75	0.8599	0.9441	0.9	143	0.6129	0.8261	0.7037	23	0.7586	0.8462	0.8	26	0.7804	0.8909	0.8320	0.9590
0.052	43.0	4558	0.1501	0.7895	0.8333	0.8108	72	0.7381	0.8267	0.7799	75	0.8766	0.9441	0.9091	143	0.6429	0.7826	0.7059	23	0.8462	0.8462	0.8462	26	0.8071	0.8761	0.8402	0.9610
0.0509	44.0	4664	0.1587	0.7792	0.8333	0.8054	72	0.7412	0.84	0.7875	75	0.8782	0.9580	0.9164	143	0.6207	0.7826	0.6923	23	0.7778	0.8077	0.7925	26	0.7995	0.8820	0.8387	0.9597
0.049	45.0	4770	0.1580	0.7722	0.8472	0.8079	72	0.7294	0.8267	0.7750	75	0.8608	0.9510	0.9037	143	0.6552	0.8261	0.7308	23	0.75	0.8077	0.7778	26	0.7889	0.8820	0.8329	0.9607
0.0479	46.0	4876	0.1540	0.8289	0.875	0.8514	72	0.7381	0.8267	0.7799	75	0.8718	0.9510	0.9097	143	0.6552	0.8261	0.7308	23	0.7857	0.8462	0.8148	26	0.8097	0.8909	0.8483	0.9627
0.0488	47.0	4982	0.1686	0.8158	0.8611	0.8378	72	0.6932	0.8133	0.7485	75	0.8272	0.9371	0.8787	143	0.6429	0.7826	0.7059	23	0.8148	0.8462	0.8302	26	0.7795	0.8761	0.825	0.9565
0.0468	48.0	5088	0.1526	0.84	0.875	0.8571	72	0.7059	0.8	0.7500	75	0.8645	0.9371	0.8993	143	0.6429	0.7826	0.7059	23	0.8519	0.8846	0.8679	26	0.8054	0.8791	0.8406	0.9632
0.0474	49.0	5194	0.1667	0.7922	0.8472	0.8188	72	0.7045	0.8267	0.7607	75	0.8734	0.9650	0.9169	143	0.6207	0.7826	0.6923	23	0.8462	0.8462	0.8462	26	0.7963	0.8879	0.8396	0.9605
0.0485	50.0	5300	0.1526	0.8243	0.8472	0.8356	72	0.7531	0.8133	0.7821	75	0.8774	0.9510	0.9128	143	0.7037	0.8261	0.76	23	0.88	0.8462	0.8627	26	0.8260	0.8820	0.8531	0.9635
0.0443	51.0	5406	0.1694	0.8267	0.8611	0.8435	72	0.7065	0.8667	0.7784	75	0.8854	0.9720	0.9267	143	0.6333	0.8261	0.7170	23	0.8462	0.8462	0.8462	26	0.8079	0.9056	0.8540	0.9612
0.0468	52.0	5512	0.1636	0.8133	0.8472	0.8299	72	0.7209	0.8267	0.7702	75	0.8599	0.9441	0.9	143	0.5862	0.7391	0.6538	23	0.7241	0.8077	0.7636	26	0.7872	0.8732	0.8280	0.9585
0.0439	53.0	5618	0.1686	0.8082	0.8194	0.8138	72	0.7273	0.8533	0.7853	75	0.8846	0.9650	0.9231	143	0.5758	0.8261	0.6786	23	0.8462	0.8462	0.8462	26	0.8032	0.8909	0.8448	0.9597
0.0449	54.0	5724	0.1678	0.8077	0.875	0.8400	72	0.7326	0.84	0.7826	75	0.8734	0.9650	0.9169	143	0.5806	0.7826	0.6667	23	0.8148	0.8462	0.8302	26	0.8	0.8968	0.8456	0.9602
0.0428	55.0	5830	0.1703	0.7922	0.8472	0.8188	72	0.7143	0.8667	0.7831	75	0.8790	0.9650	0.92	143	0.6429	0.7826	0.7059	23	0.7188	0.8846	0.7931	26	0.7922	0.8997	0.8425	0.9602
0.043	56.0	5936	0.1671	0.7848	0.8611	0.8212	72	0.7033	0.8533	0.7711	75	0.8968	0.9720	0.9329	143	0.6207	0.7826	0.6923	23	0.8148	0.8462	0.8302	26	0.8005	0.8997	0.8472	0.9607
0.0405	57.0	6042	0.1589	0.8108	0.8333	0.8219	72	0.7470	0.8267	0.7848	75	0.8896	0.9580	0.9226	143	0.6552	0.8261	0.7308	23	0.8462	0.8462	0.8462	26	0.8197	0.8850	0.8511	0.9625
0.0402	58.0	6148	0.1672	0.8026	0.8472	0.8243	72	0.7126	0.8267	0.7654	75	0.8726	0.9580	0.9133	143	0.6	0.7826	0.6792	23	0.7857	0.8462	0.8148	26	0.7937	0.8850	0.8368	0.9610
0.0408	59.0	6254	0.1690	0.8026	0.8472	0.8243	72	0.7349	0.8133	0.7722	75	0.8726	0.9580	0.9133	143	0.6207	0.7826	0.6923	23	0.7931	0.8846	0.8364	26	0.8021	0.8850	0.8415	0.9627
0.0384	60.0	6360	0.1786	0.7821	0.8472	0.8133	72	0.6882	0.8533	0.7619	75	0.8790	0.9650	0.92	143	0.6552	0.8261	0.7308	23	0.6875	0.8462	0.7586	26	0.7815	0.8968	0.8352	0.9600
0.0381	61.0	6466	0.1716	0.8406	0.8056	0.8227	72	0.7532	0.7733	0.7632	75	0.8701	0.9371	0.9024	143	0.6333	0.8261	0.7170	23	0.8462	0.8462	0.8462	26	0.8174	0.8584	0.8374	0.9617
0.0393	62.0	6572	0.1672	0.8133	0.8472	0.8299	72	0.7468	0.7867	0.7662	75	0.8782	0.9580	0.9164	143	0.6429	0.7826	0.7059	23	0.8462	0.8462	0.8462	26	0.8159	0.8761	0.8450	0.9632
0.037	63.0	6678	0.1637	0.8243	0.8472	0.8356	72	0.7160	0.7733	0.7436	75	0.8782	0.9580	0.9164	143	0.6207	0.7826	0.6923	23	0.8519	0.8846	0.8679	26	0.8093	0.8761	0.8414	0.9627
0.0357	64.0	6784	0.1763	0.8182	0.875	0.8456	72	0.7011	0.8133	0.7531	75	0.8679	0.9650	0.9139	143	0.6207	0.7826	0.6923	23	0.7857	0.8462	0.8148	26	0.7947	0.8909	0.8401	0.9617
0.0374	65.0	6890	0.1724	0.8158	0.8611	0.8378	72	0.7470	0.8267	0.7848	75	0.8903	0.9650	0.9262	143	0.6	0.7826	0.6792	23	0.8214	0.8846	0.8519	26	0.8145	0.8938	0.8523	0.9622
0.0368	66.0	6996	0.1770	0.8289	0.875	0.8514	72	0.7294	0.8267	0.7750	75	0.8726	0.9580	0.9133	143	0.6552	0.8261	0.7308	23	0.7931	0.8846	0.8364	26	0.8085	0.8968	0.8503	0.9617
0.0374	67.0	7102	0.1792	0.8108	0.8333	0.8219	72	0.7045	0.8267	0.7607	75	0.8726	0.9580	0.9133	143	0.6429	0.7826	0.7059	23	0.8462	0.8462	0.8462	26	0.8016	0.8820	0.8399	0.9620
0.034	68.0	7208	0.1887	0.8026	0.8472	0.8243	72	0.7024	0.7867	0.7421	75	0.8679	0.9650	0.9139	143	0.6	0.7826	0.6792	23	0.7857	0.8462	0.8148	26	0.7905	0.8791	0.8324	0.9595
0.0339	69.0	7314	0.1792	0.8108	0.8333	0.8219	72	0.7262	0.8133	0.7673	75	0.8726	0.9580	0.9133	143	0.6429	0.7826	0.7059	23	0.8462	0.8462	0.8462	26	0.8076	0.8791	0.8418	0.9615
0.0346	70.0	7420	0.1741	0.8	0.8333	0.8163	72	0.7349	0.8133	0.7722	75	0.8782	0.9580	0.9164	143	0.5862	0.7391	0.6538	23	0.7778	0.8077	0.7925	26	0.8	0.8732	0.8350	0.9612
0.0345	71.0	7526	0.1789	0.7949	0.8611	0.8267	72	0.7294	0.8267	0.7750	75	0.8782	0.9580	0.9164	143	0.6552	0.8261	0.7308	23	0.7931	0.8846	0.8364	26	0.8037	0.8938	0.8464	0.9627
0.0339	72.0	7632	0.1791	0.8026	0.8472	0.8243	72	0.7349	0.8133	0.7722	75	0.8718	0.9510	0.9097	143	0.5806	0.7826	0.6667	23	0.8214	0.8846	0.8519	26	0.7995	0.8820	0.8387	0.9610
0.0363	73.0	7738	0.1758	0.8182	0.875	0.8456	72	0.7241	0.84	0.7778	75	0.8782	0.9580	0.9164	143	0.6071	0.7391	0.6667	23	0.8462	0.8462	0.8462	26	0.8075	0.8909	0.8471	0.9620
0.0309	74.0	7844	0.1865	0.8205	0.8889	0.8533	72	0.7093	0.8133	0.7578	75	0.8679	0.9650	0.9139	143	0.6552	0.8261	0.7308	23	0.7931	0.8846	0.8364	26	0.8005	0.8997	0.8472	0.9600
0.0337	75.0	7950	0.1806	0.8182	0.875	0.8456	72	0.7176	0.8133	0.7625	75	0.8734	0.9650	0.9169	143	0.6786	0.8261	0.7451	23	0.7333	0.8462	0.7857	26	0.8016	0.8938	0.8452	0.9610
0.0329	76.0	8056	0.1810	0.8052	0.8611	0.8322	72	0.6848	0.84	0.7545	75	0.8718	0.9510	0.9097	143	0.6786	0.8261	0.7451	23	0.8571	0.9231	0.8889	26	0.7979	0.8968	0.8444	0.9612
0.0325	77.0	8162	0.1784	0.8026	0.8472	0.8243	72	0.6897	0.8	0.7407	75	0.8734	0.9650	0.9169	143	0.6429	0.7826	0.7059	23	0.8519	0.8846	0.8679	26	0.7979	0.8850	0.8392	0.9607
0.0313	78.0	8268	0.1773	0.8289	0.875	0.8514	72	0.7349	0.8133	0.7722	75	0.8662	0.9510	0.9067	143	0.6429	0.7826	0.7059	23	0.8519	0.8846	0.8679	26	0.8113	0.8879	0.8479	0.9620
0.0313	79.0	8374	0.1782	0.8026	0.8472	0.8243	72	0.7381	0.8267	0.7799	75	0.8734	0.9650	0.9169	143	0.6207	0.7826	0.6923	23	0.7931	0.8846	0.8364	26	0.8032	0.8909	0.8448	0.9617
0.0302	80.0	8480	0.1889	0.8052	0.8611	0.8322	72	0.6897	0.8	0.7407	75	0.8734	0.9650	0.9169	143	0.6552	0.8261	0.7308	23	0.7857	0.8462	0.8148	26	0.7942	0.8879	0.8384	0.9600
0.0307	81.0	8586	0.1804	0.7949	0.8611	0.8267	72	0.7262	0.8133	0.7673	75	0.8671	0.9580	0.9103	143	0.6333	0.8261	0.7170	23	0.8519	0.8846	0.8679	26	0.8011	0.8909	0.8436	0.9617
0.0289	82.0	8692	0.1857	0.8026	0.8472	0.8243	72	0.7262	0.8133	0.7673	75	0.8662	0.9510	0.9067	143	0.6552	0.8261	0.7308	23	0.7586	0.8462	0.8	26	0.7973	0.8820	0.8375	0.9610
0.0312	83.0	8798	0.1917	0.7949	0.8611	0.8267	72	0.7294	0.8267	0.7750	75	0.8790	0.9650	0.92	143	0.6129	0.8261	0.7037	23	0.8148	0.8462	0.8302	26	0.8016	0.8938	0.8452	0.9612
0.0286	84.0	8904	0.1832	0.8158	0.8611	0.8378	72	0.7262	0.8133	0.7673	75	0.8654	0.9441	0.9030	143	0.6	0.7826	0.6792	23	0.8519	0.8846	0.8679	26	0.8016	0.8820	0.8399	0.9607
0.0295	85.0	9010	0.1882	0.8133	0.8472	0.8299	72	0.7381	0.8267	0.7799	75	0.8679	0.9650	0.9139	143	0.6	0.7826	0.6792	23	0.8519	0.8846	0.8679	26	0.8053	0.8909	0.8459	0.9607
0.0285	86.0	9116	0.1836	0.8077	0.875	0.8400	72	0.7439	0.8133	0.7771	75	0.8608	0.9510	0.9037	143	0.5667	0.7391	0.6415	23	0.8214	0.8846	0.8519	26	0.7979	0.8850	0.8392	0.9617
0.0264	87.0	9222	0.1859	0.7975	0.875	0.8344	72	0.7349	0.8133	0.7722	75	0.8599	0.9441	0.9	143	0.6207	0.7826	0.6923	23	0.8519	0.8846	0.8679	26	0.8	0.8850	0.8403	0.9617
0.0278	88.0	9328	0.1846	0.7949	0.8611	0.8267	72	0.7349	0.8133	0.7722	75	0.8544	0.9441	0.8970	143	0.6071	0.7391	0.6667	23	0.8519	0.8846	0.8679	26	0.7968	0.8791	0.8359	0.9610
0.0275	89.0	9434	0.1873	0.7821	0.8472	0.8133	72	0.7470	0.8267	0.7848	75	0.8544	0.9441	0.8970	143	0.6552	0.8261	0.7308	23	0.8519	0.8846	0.8679	26	0.8	0.8850	0.8403	0.9615
0.0274	90.0	9540	0.1894	0.7949	0.8611	0.8267	72	0.7381	0.8267	0.7799	75	0.8616	0.9580	0.9073	143	0.6333	0.8261	0.7170	23	0.8519	0.8846	0.8679	26	0.8016	0.8938	0.8452	0.9610
0.0276	91.0	9646	0.1843	0.7949	0.8611	0.8267	72	0.7349	0.8133	0.7722	75	0.8608	0.9510	0.9037	143	0.5862	0.7391	0.6538	23	0.8519	0.8846	0.8679	26	0.7973	0.8820	0.8375	0.9617
0.029	92.0	9752	0.1910	0.8077	0.875	0.8400	72	0.7262	0.8133	0.7673	75	0.8662	0.9510	0.9067	143	0.6333	0.8261	0.7170	23	0.8519	0.8846	0.8679	26	0.8032	0.8909	0.8448	0.9605
0.0272	93.0	9858	0.1884	0.7949	0.8611	0.8267	72	0.7011	0.8133	0.7531	75	0.8662	0.9510	0.9067	143	0.6	0.7826	0.6792	23	0.8519	0.8846	0.8679	26	0.7916	0.8850	0.8357	0.9597
0.0282	94.0	9964	0.1882	0.7949	0.8611	0.8267	72	0.7294	0.8267	0.7750	75	0.8734	0.9650	0.9169	143	0.5667	0.7391	0.6415	23	0.8519	0.8846	0.8679	26	0.7989	0.8909	0.8424	0.9610
0.0288	95.0	10070	0.1896	0.7949	0.8611	0.8267	72	0.7176	0.8133	0.7625	75	0.8608	0.9510	0.9037	143	0.6	0.7826	0.6792	23	0.8519	0.8846	0.8679	26	0.7937	0.8850	0.8368	0.9600
0.028	96.0	10176	0.1878	0.7949	0.8611	0.8267	72	0.7294	0.8267	0.7750	75	0.8671	0.9580	0.9103	143	0.6	0.7826	0.6792	23	0.8519	0.8846	0.8679	26	0.7989	0.8909	0.8424	0.9610
0.028	97.0	10282	0.1894	0.7949	0.8611	0.8267	72	0.7294	0.8267	0.7750	75	0.8671	0.9580	0.9103	143	0.6	0.7826	0.6792	23	0.8519	0.8846	0.8679	26	0.7989	0.8909	0.8424	0.9605
0.0275	98.0	10388	0.1890	0.8052	0.8611	0.8322	72	0.7294	0.8267	0.7750	75	0.8671	0.9580	0.9103	143	0.6	0.7826	0.6792	23	0.8519	0.8846	0.8679	26	0.8011	0.8909	0.8436	0.9605
0.0269	99.0	10494	0.1901	0.8052	0.8611	0.8322	72	0.7294	0.8267	0.7750	75	0.8671	0.9580	0.9103	143	0.6	0.7826	0.6792	23	0.8519	0.8846	0.8679	26	0.8011	0.8909	0.8436	0.9605
0.0282	100.0	10600	0.1897	0.8052	0.8611	0.8322	72	0.7294	0.8267	0.7750	75	0.8671	0.9580	0.9103	143	0.6	0.7826	0.6792	23	0.8519	0.8846	0.8679	26	0.8011	0.8909	0.8436	0.9605

Framework versions

• Transformers 4.39.3
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.15.2