nerugm-lora-r16-1

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.1334
• Location Precision: 0.7284
• Location Recall: 0.8551
• Location F1: 0.7867
• Location Number: 69
• Organization Precision: 0.6145
• Organization Recall: 0.8361
• Organization F1: 0.7083
• Organization Number: 61
• Person Precision: 0.8683
• Person Recall: 0.9477
• Person F1: 0.9062
• Person Number: 153
• Quantity Precision: 0.6579
• Quantity Recall: 0.7812
• Quantity F1: 0.7143
• Quantity Number: 32
• Time Precision: 0.7568
• Time Recall: 0.9032
• Time F1: 0.8235
• Time Number: 31
• Overall Precision: 0.7586
• Overall Recall: 0.8902
• Overall F1: 0.8191
• Overall Accuracy: 0.9611

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100.0

Training results

Training Loss	Epoch	Step	Validation Loss	Location Precision	Location Recall	Location F1	Location Number	Organization Precision	Organization Recall	Organization F1	Organization Number	Person Precision	Person Recall	Person F1	Person Number	Quantity Precision	Quantity Recall	Quantity F1	Quantity Number	Time Precision	Time Recall	Time F1	Time Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
1.142	1.0	106	0.7119	0.0	0.0	0.0	69	0.0	0.0	0.0	61	0.0	0.0	0.0	153	0.0	0.0	0.0	32	0.0	0.0	0.0	31	0.0	0.0	0.0	0.8353
0.6808	2.0	212	0.5941	0.0	0.0	0.0	69	0.0	0.0	0.0	61	0.125	0.0065	0.0124	153	0.0	0.0	0.0	32	0.0	0.0	0.0	31	0.0714	0.0029	0.0056	0.8378
0.5701	3.0	318	0.4630	0.3333	0.0435	0.0769	69	0.0	0.0	0.0	61	0.2941	0.1307	0.1810	153	0.0	0.0	0.0	32	0.3333	0.1613	0.2174	31	0.2718	0.0809	0.1247	0.8608
0.443	4.0	424	0.3387	0.4737	0.2609	0.3364	69	0.3438	0.1803	0.2366	61	0.5549	0.6275	0.5890	153	0.1765	0.0938	0.1224	32	0.5333	0.5161	0.5246	31	0.4966	0.4162	0.4528	0.9041
0.3332	5.0	530	0.2721	0.4889	0.6377	0.5535	69	0.4026	0.5082	0.4493	61	0.7083	0.8889	0.7884	153	0.4359	0.5312	0.4789	32	0.6286	0.7097	0.6667	31	0.5774	0.7225	0.6418	0.9294
0.2703	6.0	636	0.2249	0.5789	0.7971	0.6707	69	0.4815	0.6393	0.5493	61	0.7637	0.9085	0.8299	153	0.5	0.5625	0.5294	32	0.7143	0.8065	0.7576	31	0.6434	0.7977	0.7123	0.9381
0.2315	7.0	742	0.2020	0.6667	0.8406	0.7436	69	0.5	0.6885	0.5793	61	0.7889	0.9281	0.8529	153	0.4634	0.5938	0.5205	32	0.7222	0.8387	0.7761	31	0.6706	0.8295	0.7416	0.9415
0.2078	8.0	848	0.1822	0.6742	0.8696	0.7595	69	0.5	0.7213	0.5906	61	0.8068	0.9281	0.8632	153	0.5405	0.625	0.5797	32	0.6944	0.8065	0.7463	31	0.6831	0.8410	0.7539	0.9453
0.1901	9.0	954	0.1697	0.7059	0.8696	0.7792	69	0.5341	0.7705	0.6309	61	0.8125	0.9346	0.8693	153	0.5128	0.625	0.5634	32	0.7222	0.8387	0.7761	31	0.6981	0.8555	0.7688	0.9485
0.1757	10.0	1060	0.1584	0.7262	0.8841	0.7974	69	0.5529	0.7705	0.6438	61	0.7886	0.9020	0.8415	153	0.5385	0.6562	0.5915	32	0.7027	0.8387	0.7647	31	0.6976	0.8468	0.7650	0.9502
0.1661	11.0	1166	0.1507	0.7439	0.8841	0.8079	69	0.5647	0.7869	0.6575	61	0.8092	0.9150	0.8589	153	0.6154	0.75	0.6761	32	0.6410	0.8065	0.7143	31	0.7129	0.8613	0.7801	0.9527
0.1593	12.0	1272	0.1522	0.7229	0.8696	0.7895	69	0.5730	0.8361	0.6800	61	0.8011	0.9216	0.8571	153	0.625	0.7812	0.6944	32	0.7297	0.8710	0.7941	31	0.7153	0.8786	0.7886	0.9522
0.1511	13.0	1378	0.1420	0.7317	0.8696	0.7947	69	0.5542	0.7541	0.6389	61	0.8208	0.9281	0.8712	153	0.5	0.5938	0.5429	32	0.6757	0.8065	0.7353	31	0.7070	0.8439	0.7694	0.9532
0.1474	14.0	1484	0.1506	0.7317	0.8696	0.7947	69	0.5	0.8361	0.6258	61	0.8068	0.9281	0.8632	153	0.6216	0.7188	0.6667	32	0.7105	0.8710	0.7826	31	0.6966	0.8757	0.7759	0.9502
0.1427	15.0	1590	0.1441	0.7229	0.8696	0.7895	69	0.5568	0.8033	0.6577	61	0.8198	0.9216	0.8677	153	0.6389	0.7188	0.6765	32	0.8	0.9032	0.8485	31	0.7271	0.8699	0.7921	0.9547
0.1376	16.0	1696	0.1401	0.7195	0.8551	0.7815	69	0.5647	0.7869	0.6575	61	0.8114	0.9281	0.8659	153	0.6286	0.6875	0.6567	32	0.7941	0.8710	0.8308	31	0.7251	0.8613	0.7873	0.9549
0.1316	17.0	1802	0.1454	0.7262	0.8841	0.7974	69	0.5155	0.8197	0.6329	61	0.8161	0.9281	0.8685	153	0.6341	0.8125	0.7123	32	0.7368	0.9032	0.8116	31	0.7074	0.8873	0.7872	0.9534
0.1279	18.0	1908	0.1363	0.7262	0.8841	0.7974	69	0.5568	0.8033	0.6577	61	0.8161	0.9281	0.8685	153	0.7222	0.8125	0.7647	32	0.7568	0.9032	0.8235	31	0.7303	0.8844	0.8	0.9576
0.126	19.0	2014	0.1339	0.7317	0.8696	0.7947	69	0.5732	0.7705	0.6573	61	0.8208	0.9281	0.8712	153	0.6341	0.8125	0.7123	32	0.7778	0.9032	0.8358	31	0.7319	0.8757	0.7974	0.9571
0.1234	20.0	2120	0.1434	0.7059	0.8696	0.7792	69	0.5882	0.8197	0.6849	61	0.8218	0.9346	0.8746	153	0.6190	0.8125	0.7027	32	0.7	0.9032	0.7887	31	0.7207	0.8873	0.7953	0.9537
0.1218	21.0	2226	0.1456	0.7407	0.8696	0.8000	69	0.5050	0.8361	0.6296	61	0.8229	0.9412	0.8780	153	0.6842	0.8125	0.7429	32	0.7368	0.9032	0.8116	31	0.7136	0.8931	0.7933	0.9524
0.1208	22.0	2332	0.1364	0.7317	0.8696	0.7947	69	0.5765	0.8033	0.6712	61	0.8314	0.9346	0.8800	153	0.6486	0.75	0.6957	32	0.7179	0.9032	0.8	31	0.7325	0.8786	0.7989	0.9559
0.1175	23.0	2438	0.1306	0.7375	0.8551	0.7919	69	0.5854	0.7869	0.6713	61	0.8218	0.9346	0.8746	153	0.6667	0.75	0.7059	32	0.7568	0.9032	0.8235	31	0.7384	0.8728	0.8000	0.9589
0.1129	24.0	2544	0.1435	0.7317	0.8696	0.7947	69	0.5591	0.8525	0.6753	61	0.8324	0.9412	0.8834	153	0.6047	0.8125	0.6933	32	0.7368	0.9032	0.8116	31	0.7226	0.8960	0.8000	0.9552
0.1109	25.0	2650	0.1366	0.7375	0.8551	0.7919	69	0.5889	0.8689	0.7020	61	0.8372	0.9412	0.8862	153	0.6757	0.7812	0.7246	32	0.7368	0.9032	0.8116	31	0.7410	0.8931	0.8100	0.9591
0.1117	26.0	2756	0.1419	0.7407	0.8696	0.8000	69	0.5532	0.8525	0.6710	61	0.8324	0.9412	0.8834	153	0.6667	0.8125	0.7324	32	0.7568	0.9032	0.8235	31	0.7311	0.8960	0.8052	0.9562
0.1091	27.0	2862	0.1315	0.75	0.8696	0.8054	69	0.6145	0.8361	0.7083	61	0.8314	0.9346	0.8800	153	0.6842	0.8125	0.7429	32	0.7568	0.9032	0.8235	31	0.7512	0.8902	0.8148	0.9609
0.1076	28.0	2968	0.1281	0.75	0.8696	0.8054	69	0.5926	0.7869	0.6761	61	0.8304	0.9281	0.8765	153	0.6667	0.75	0.7059	32	0.7568	0.9032	0.8235	31	0.7457	0.8728	0.8043	0.9591
0.1072	29.0	3074	0.1267	0.75	0.8696	0.8054	69	0.6203	0.8033	0.7	61	0.8353	0.9281	0.8793	153	0.6571	0.7188	0.6866	32	0.8	0.9032	0.8485	31	0.7569	0.8728	0.8107	0.9621
0.1056	30.0	3180	0.1278	0.7692	0.8696	0.8163	69	0.5952	0.8197	0.6897	61	0.8246	0.9216	0.8704	153	0.6857	0.75	0.7164	32	0.7568	0.9032	0.8235	31	0.7481	0.8757	0.8069	0.9601
0.1043	31.0	3286	0.1318	0.75	0.8696	0.8054	69	0.5904	0.8033	0.6806	61	0.8324	0.9412	0.8834	153	0.6944	0.7812	0.7353	32	0.7632	0.9355	0.8406	31	0.7488	0.8873	0.8122	0.9611
0.0992	32.0	3392	0.1243	0.7375	0.8551	0.7919	69	0.6173	0.8197	0.7042	61	0.8353	0.9281	0.8793	153	0.6111	0.6875	0.6471	32	0.7632	0.9355	0.8406	31	0.7457	0.8728	0.8043	0.9609
0.099	33.0	3498	0.1240	0.75	0.8696	0.8054	69	0.6282	0.8033	0.7050	61	0.8304	0.9281	0.8765	153	0.6389	0.7188	0.6765	32	0.7568	0.9032	0.8235	31	0.7512	0.8728	0.8075	0.9609
0.0972	34.0	3604	0.1419	0.75	0.8696	0.8054	69	0.5521	0.8689	0.6752	61	0.8229	0.9412	0.8780	153	0.6579	0.7812	0.7143	32	0.7368	0.9032	0.8116	31	0.7260	0.8960	0.8021	0.9549
0.1017	35.0	3710	0.1357	0.7284	0.8551	0.7867	69	0.5652	0.8525	0.6797	61	0.8229	0.9412	0.8780	153	0.6579	0.7812	0.7143	32	0.7632	0.9355	0.8406	31	0.7288	0.8931	0.8026	0.9574
0.0961	36.0	3816	0.1240	0.7468	0.8551	0.7973	69	0.6410	0.8197	0.7194	61	0.8256	0.9281	0.8738	153	0.6944	0.7812	0.7353	32	0.7632	0.9355	0.8406	31	0.7568	0.8815	0.8144	0.9614
0.0949	37.0	3922	0.1346	0.7595	0.8696	0.8108	69	0.5761	0.8689	0.6928	61	0.8314	0.9346	0.8800	153	0.6579	0.7812	0.7143	32	0.7568	0.9032	0.8235	31	0.7392	0.8931	0.8089	0.9579
0.0933	38.0	4028	0.1337	0.7595	0.8696	0.8108	69	0.6071	0.8361	0.7034	61	0.8171	0.9346	0.8720	153	0.6579	0.7812	0.7143	32	0.7632	0.9355	0.8406	31	0.7440	0.8902	0.8105	0.9596
0.0888	39.0	4134	0.1267	0.7595	0.8696	0.8108	69	0.6098	0.8197	0.6993	61	0.8208	0.9281	0.8712	153	0.6757	0.7812	0.7246	32	0.7568	0.9032	0.8235	31	0.7475	0.8815	0.8090	0.9601
0.0903	40.0	4240	0.1282	0.7595	0.8696	0.8108	69	0.6098	0.8197	0.6993	61	0.8314	0.9346	0.8800	153	0.6757	0.7812	0.7246	32	0.7632	0.9355	0.8406	31	0.7525	0.8873	0.8143	0.9614
0.092	41.0	4346	0.1298	0.7595	0.8696	0.8108	69	0.6047	0.8525	0.7075	61	0.8372	0.9412	0.8862	153	0.6944	0.7812	0.7353	32	0.7838	0.9355	0.8529	31	0.7561	0.8960	0.8201	0.9611
0.0906	42.0	4452	0.1300	0.75	0.8696	0.8054	69	0.6163	0.8689	0.7211	61	0.8324	0.9412	0.8834	153	0.6944	0.7812	0.7353	32	0.7838	0.9355	0.8529	31	0.7549	0.8988	0.8206	0.9621
0.0916	43.0	4558	0.1302	0.75	0.8696	0.8054	69	0.6220	0.8361	0.7133	61	0.8363	0.9346	0.8827	153	0.6757	0.7812	0.7246	32	0.7838	0.9355	0.8529	31	0.7568	0.8902	0.8181	0.9611
0.0908	44.0	4664	0.1241	0.75	0.8696	0.8054	69	0.6104	0.7705	0.6812	61	0.8402	0.9281	0.8820	153	0.6857	0.75	0.7164	32	0.7838	0.9355	0.8529	31	0.7588	0.8728	0.8118	0.9623
0.0886	45.0	4770	0.1271	0.75	0.8696	0.8054	69	0.6375	0.8361	0.7234	61	0.8256	0.9281	0.8738	153	0.6579	0.7812	0.7143	32	0.7838	0.9355	0.8529	31	0.7543	0.8873	0.8154	0.9609
0.0875	46.0	4876	0.1265	0.7284	0.8551	0.7867	69	0.6173	0.8197	0.7042	61	0.8333	0.9477	0.8869	153	0.7353	0.7812	0.7576	32	0.7838	0.9355	0.8529	31	0.7568	0.8902	0.8181	0.9631
0.0863	47.0	4982	0.1273	0.75	0.8696	0.8054	69	0.6220	0.8361	0.7133	61	0.8256	0.9281	0.8738	153	0.6944	0.7812	0.7353	32	0.7838	0.9355	0.8529	31	0.7543	0.8873	0.8154	0.9616
0.0853	48.0	5088	0.1320	0.7407	0.8696	0.8000	69	0.6098	0.8197	0.6993	61	0.8363	0.9346	0.8827	153	0.6486	0.75	0.6957	32	0.7568	0.9032	0.8235	31	0.7475	0.8815	0.8090	0.9596
0.0857	49.0	5194	0.1321	0.7468	0.8551	0.7973	69	0.6	0.8361	0.6986	61	0.8363	0.9346	0.8827	153	0.6857	0.75	0.7164	32	0.7568	0.9032	0.8235	31	0.7494	0.8815	0.8101	0.9596
0.0848	50.0	5300	0.1268	0.7407	0.8696	0.8000	69	0.6049	0.8033	0.6901	61	0.8324	0.9412	0.8834	153	0.6857	0.75	0.7164	32	0.7568	0.9032	0.8235	31	0.7494	0.8815	0.8101	0.9614
0.081	51.0	5406	0.1300	0.75	0.8696	0.8054	69	0.6023	0.8689	0.7114	61	0.8314	0.9346	0.8800	153	0.6667	0.75	0.7059	32	0.7568	0.9032	0.8235	31	0.7458	0.8902	0.8116	0.9596
0.0834	52.0	5512	0.1295	0.7595	0.8696	0.8108	69	0.6047	0.8525	0.7075	61	0.8314	0.9346	0.8800	153	0.6667	0.75	0.7059	32	0.7632	0.9355	0.8406	31	0.7494	0.8902	0.8137	0.9599
0.0832	53.0	5618	0.1349	0.7375	0.8551	0.7919	69	0.5909	0.8525	0.6980	61	0.8314	0.9346	0.8800	153	0.7143	0.7812	0.7463	32	0.7368	0.9032	0.8116	31	0.7433	0.8873	0.8090	0.9589
0.0811	54.0	5724	0.1285	0.7375	0.8551	0.7919	69	0.6	0.8361	0.6986	61	0.8256	0.9281	0.8738	153	0.6944	0.7812	0.7353	32	0.7632	0.9355	0.8406	31	0.7445	0.8844	0.8085	0.9601
0.0814	55.0	5830	0.1383	0.7375	0.8551	0.7919	69	0.6023	0.8689	0.7114	61	0.8521	0.9412	0.8944	153	0.6410	0.7812	0.7042	32	0.7632	0.9355	0.8406	31	0.7488	0.8960	0.8158	0.9591
0.08	56.0	5936	0.1240	0.7595	0.8696	0.8108	69	0.6125	0.8033	0.6950	61	0.8402	0.9281	0.8820	153	0.6944	0.7812	0.7353	32	0.7838	0.9355	0.8529	31	0.7606	0.8815	0.8166	0.9619
0.0805	57.0	6042	0.1233	0.7284	0.8551	0.7867	69	0.625	0.8197	0.7092	61	0.8372	0.9412	0.8862	153	0.6667	0.75	0.7059	32	0.7838	0.9355	0.8529	31	0.7537	0.8844	0.8138	0.9626
0.0785	58.0	6148	0.1265	0.7407	0.8696	0.8000	69	0.6375	0.8361	0.7234	61	0.8421	0.9412	0.8889	153	0.7143	0.7812	0.7463	32	0.7778	0.9032	0.8358	31	0.7643	0.8902	0.8224	0.9623
0.0771	59.0	6254	0.1271	0.7284	0.8551	0.7867	69	0.6145	0.8361	0.7083	61	0.8529	0.9477	0.8978	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7568	0.8902	0.8181	0.9614
0.0778	60.0	6360	0.1311	0.7284	0.8551	0.7867	69	0.6190	0.8525	0.7172	61	0.8521	0.9412	0.8944	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7568	0.8902	0.8181	0.9606
0.0793	61.0	6466	0.1274	0.7407	0.8696	0.8000	69	0.6098	0.8197	0.6993	61	0.8631	0.9477	0.9034	153	0.6857	0.75	0.7164	32	0.7778	0.9032	0.8358	31	0.7637	0.8873	0.8209	0.9621
0.0755	62.0	6572	0.1285	0.7195	0.8551	0.7815	69	0.6173	0.8197	0.7042	61	0.8571	0.9412	0.8972	153	0.6857	0.75	0.7164	32	0.7778	0.9032	0.8358	31	0.7587	0.8815	0.8155	0.9611
0.0765	63.0	6678	0.1259	0.7284	0.8551	0.7867	69	0.6265	0.8525	0.7222	61	0.8462	0.9346	0.8882	153	0.6857	0.75	0.7164	32	0.7778	0.9032	0.8358	31	0.7574	0.8844	0.816	0.9623
0.0756	64.0	6784	0.1308	0.7375	0.8551	0.7919	69	0.6235	0.8689	0.7260	61	0.8683	0.9477	0.9062	153	0.6944	0.7812	0.7353	32	0.7778	0.9032	0.8358	31	0.7673	0.8960	0.8267	0.9616
0.0756	65.0	6890	0.1309	0.7195	0.8551	0.7815	69	0.6220	0.8361	0.7133	61	0.8571	0.9412	0.8972	153	0.6579	0.7812	0.7143	32	0.7568	0.9032	0.8235	31	0.7543	0.8873	0.8154	0.9606
0.0761	66.0	6996	0.1347	0.7195	0.8551	0.7815	69	0.6310	0.8689	0.7310	61	0.8631	0.9477	0.9034	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7617	0.8960	0.8234	0.9604
0.074	67.0	7102	0.1343	0.7407	0.8696	0.8000	69	0.6163	0.8689	0.7211	61	0.8631	0.9477	0.9034	153	0.6579	0.7812	0.7143	32	0.7568	0.9032	0.8235	31	0.7585	0.8988	0.8228	0.9599
0.0745	68.0	7208	0.1315	0.7195	0.8551	0.7815	69	0.6386	0.8689	0.7361	61	0.8462	0.9346	0.8882	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7568	0.8902	0.8181	0.9606
0.0747	69.0	7314	0.1324	0.7595	0.8696	0.8108	69	0.6341	0.8525	0.7273	61	0.8683	0.9477	0.9062	153	0.6944	0.7812	0.7353	32	0.7778	0.9032	0.8358	31	0.775	0.8960	0.8311	0.9609
0.0742	70.0	7420	0.1288	0.7108	0.8551	0.7763	69	0.6173	0.8197	0.7042	61	0.8521	0.9412	0.8944	153	0.6944	0.7812	0.7353	32	0.7778	0.9032	0.8358	31	0.7556	0.8844	0.8149	0.9606
0.0748	71.0	7526	0.1318	0.75	0.8696	0.8054	69	0.6145	0.8361	0.7083	61	0.8563	0.9346	0.8938	153	0.6579	0.7812	0.7143	32	0.7778	0.9032	0.8358	31	0.7599	0.8873	0.8187	0.9601
0.0737	72.0	7632	0.1283	0.7108	0.8551	0.7763	69	0.6173	0.8197	0.7042	61	0.8563	0.9346	0.8938	153	0.6579	0.7812	0.7143	32	0.7778	0.9032	0.8358	31	0.7531	0.8815	0.8123	0.9601
0.0734	73.0	7738	0.1286	0.7108	0.8551	0.7763	69	0.6125	0.8033	0.6950	61	0.8623	0.9412	0.9	153	0.6944	0.7812	0.7353	32	0.7778	0.9032	0.8358	31	0.7587	0.8815	0.8155	0.9609
0.0722	74.0	7844	0.1322	0.7407	0.8696	0.8000	69	0.6	0.8361	0.6986	61	0.8571	0.9412	0.8972	153	0.6579	0.7812	0.7143	32	0.7778	0.9032	0.8358	31	0.7549	0.8902	0.8170	0.9609
0.0739	75.0	7950	0.1294	0.75	0.8696	0.8054	69	0.6173	0.8197	0.7042	61	0.8623	0.9412	0.9	153	0.6579	0.7812	0.7143	32	0.7778	0.9032	0.8358	31	0.7637	0.8873	0.8209	0.9611
0.0725	76.0	8056	0.1313	0.7195	0.8551	0.7815	69	0.6145	0.8361	0.7083	61	0.8623	0.9412	0.9	153	0.6944	0.7812	0.7353	32	0.7778	0.9032	0.8358	31	0.7599	0.8873	0.8187	0.9614
0.0723	77.0	8162	0.1323	0.75	0.8696	0.8054	69	0.6071	0.8361	0.7034	61	0.8623	0.9412	0.9	153	0.6944	0.7812	0.7353	32	0.7778	0.9032	0.8358	31	0.7643	0.8902	0.8224	0.9611
0.0734	78.0	8268	0.1295	0.7407	0.8696	0.8000	69	0.6125	0.8033	0.6950	61	0.8631	0.9477	0.9034	153	0.6667	0.75	0.7059	32	0.7778	0.9032	0.8358	31	0.7631	0.8844	0.8193	0.9611
0.0695	79.0	8374	0.1305	0.7024	0.8551	0.7712	69	0.625	0.8197	0.7092	61	0.8521	0.9412	0.8944	153	0.6944	0.7812	0.7353	32	0.7778	0.9032	0.8358	31	0.7556	0.8844	0.8149	0.9609
0.0722	80.0	8480	0.1344	0.7024	0.8551	0.7712	69	0.6125	0.8033	0.6950	61	0.8571	0.9412	0.8972	153	0.6579	0.7812	0.7143	32	0.7568	0.9032	0.8235	31	0.7494	0.8815	0.8101	0.9596
0.0689	81.0	8586	0.1320	0.7108	0.8551	0.7763	69	0.6203	0.8033	0.7	61	0.8623	0.9412	0.9	153	0.6579	0.7812	0.7143	32	0.7778	0.9032	0.8358	31	0.7568	0.8815	0.8144	0.9601
0.0713	82.0	8692	0.1335	0.7108	0.8551	0.7763	69	0.6173	0.8197	0.7042	61	0.8623	0.9412	0.9	153	0.6579	0.7812	0.7143	32	0.7778	0.9032	0.8358	31	0.7556	0.8844	0.8149	0.9596
0.0701	83.0	8798	0.1303	0.7195	0.8551	0.7815	69	0.6125	0.8033	0.6950	61	0.8521	0.9412	0.8944	153	0.6944	0.7812	0.7353	32	0.8	0.9032	0.8485	31	0.7587	0.8815	0.8155	0.9606
0.0716	84.0	8904	0.1313	0.7195	0.8551	0.7815	69	0.6024	0.8197	0.6944	61	0.8521	0.9412	0.8944	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7518	0.8844	0.8127	0.9604
0.0693	85.0	9010	0.1321	0.7284	0.8551	0.7867	69	0.5976	0.8033	0.6853	61	0.8623	0.9412	0.9	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7568	0.8815	0.8144	0.9604
0.0712	86.0	9116	0.1316	0.75	0.8696	0.8054	69	0.5976	0.8033	0.6853	61	0.8623	0.9412	0.9	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7612	0.8844	0.8182	0.9609
0.067	87.0	9222	0.1326	0.7284	0.8551	0.7867	69	0.6049	0.8033	0.6901	61	0.8623	0.9412	0.9	153	0.6579	0.7812	0.7143	32	0.7778	0.9032	0.8358	31	0.7568	0.8815	0.8144	0.9599
0.0671	88.0	9328	0.1302	0.7284	0.8551	0.7867	69	0.6	0.7869	0.6809	61	0.8623	0.9412	0.9	153	0.6944	0.7812	0.7353	32	0.7778	0.9032	0.8358	31	0.76	0.8786	0.8150	0.9606
0.0693	89.0	9434	0.1321	0.7284	0.8551	0.7867	69	0.5926	0.7869	0.6761	61	0.8623	0.9412	0.9	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7562	0.8786	0.8128	0.9606
0.0689	90.0	9540	0.1343	0.7284	0.8551	0.7867	69	0.6098	0.8197	0.6993	61	0.8623	0.9412	0.9	153	0.6579	0.7812	0.7143	32	0.7568	0.9032	0.8235	31	0.7556	0.8844	0.8149	0.9601
0.0695	91.0	9646	0.1319	0.7284	0.8551	0.7867	69	0.5926	0.7869	0.6761	61	0.8631	0.9477	0.9034	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7568	0.8815	0.8144	0.9609
0.0677	92.0	9752	0.1319	0.7284	0.8551	0.7867	69	0.6049	0.8033	0.6901	61	0.8623	0.9412	0.9	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7587	0.8815	0.8155	0.9609
0.0692	93.0	9858	0.1340	0.7284	0.8551	0.7867	69	0.6145	0.8361	0.7083	61	0.8571	0.9412	0.8972	153	0.6579	0.7812	0.7143	32	0.7568	0.9032	0.8235	31	0.7543	0.8873	0.8154	0.9606
0.0653	94.0	9964	0.1333	0.7284	0.8551	0.7867	69	0.6098	0.8197	0.6993	61	0.8571	0.9412	0.8972	153	0.6757	0.7812	0.7246	32	0.7568	0.9032	0.8235	31	0.7556	0.8844	0.8149	0.9606
0.0661	95.0	10070	0.1330	0.7284	0.8551	0.7867	69	0.6145	0.8361	0.7083	61	0.8571	0.9412	0.8972	153	0.6757	0.7812	0.7246	32	0.7778	0.9032	0.8358	31	0.7580	0.8873	0.8176	0.9611
0.0689	96.0	10176	0.1347	0.7284	0.8551	0.7867	69	0.6071	0.8361	0.7034	61	0.8683	0.9477	0.9062	153	0.6579	0.7812	0.7143	32	0.7568	0.9032	0.8235	31	0.7568	0.8902	0.8181	0.9606
0.0706	97.0	10282	0.1333	0.7284	0.8551	0.7867	69	0.6220	0.8361	0.7133	61	0.8571	0.9412	0.8972	153	0.6579	0.7812	0.7143	32	0.7568	0.9032	0.8235	31	0.7562	0.8873	0.8165	0.9609
0.067	98.0	10388	0.1332	0.7284	0.8551	0.7867	69	0.6173	0.8197	0.7042	61	0.8683	0.9477	0.9062	153	0.6757	0.7812	0.7246	32	0.7568	0.9032	0.8235	31	0.7618	0.8873	0.8198	0.9611
0.0669	99.0	10494	0.1331	0.7284	0.8551	0.7867	69	0.6145	0.8361	0.7083	61	0.8683	0.9477	0.9062	153	0.6757	0.7812	0.7246	32	0.7568	0.9032	0.8235	31	0.7605	0.8902	0.8202	0.9616
0.0697	100.0	10600	0.1334	0.7284	0.8551	0.7867	69	0.6145	0.8361	0.7083	61	0.8683	0.9477	0.9062	153	0.6579	0.7812	0.7143	32	0.7568	0.9032	0.8235	31	0.7586	0.8902	0.8191	0.9611

Framework versions

• Transformers 4.39.3
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.15.2