nyt_ingredients-tagger-gte-small-L3-ingredient-v2

This model is a fine-tuned version of napsternxg/gte-small-L3-ingredient-v2 on the nyt_ingredients dataset. It achieves the following results on the evaluation set:

• Loss: 0.4705
• Comment: {'precision': 0.6653720111664037, 'recall': 0.7644679960953842, 'f1': 0.7114860480207656, 'number': 7171}
• Name: {'precision': 0.7963734889537307, 'recall': 0.8212788823213326, 'f1': 0.8086344637849849, 'number': 9305}
• Qty: {'precision': 0.981755684822845, 'recall': 0.9907938625750501, 'f1': 0.9862540673351484, 'number': 7495}
• Range End: {'precision': 0.6240601503759399, 'recall': 0.9222222222222223, 'f1': 0.7443946188340806, 'number': 90}
• Unit: {'precision': 0.923100969052829, 'recall': 0.9861412589747871, 'f1': 0.95358036651328, 'number': 5989}
• Overall Precision: 0.8312
• Overall Recall: 0.8832
• Overall F1: 0.8564
• Overall Accuracy: 0.8350

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Comment	Name	Qty	Range End	Unit	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.6931	0.2	1000	0.6230	{'precision': 0.5236127508854782, 'recall': 0.6426604839878278, 'f1': 0.5770606987183658, 'number': 6901}	{'precision': 0.7773012207192346, 'recall': 0.7980128711753416, 'f1': 0.7875208913649026, 'number': 8857}	{'precision': 0.9824561403508771, 'recall': 0.9737098344693281, 'f1': 0.9780634343998882, 'number': 7189}	{'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 92}	{'precision': 0.9192320423700762, 'recall': 0.9689462665736218, 'f1': 0.9434346865975879, 'number': 5732}	0.7829	0.8362	0.8086	0.7986
0.5826	0.4	2000	0.5531	{'precision': 0.5435365427205968, 'recall': 0.6756991740327489, 'f1': 0.602454780361757, 'number': 6901}	{'precision': 0.7757141305528402, 'recall': 0.8063678446426555, 'f1': 0.7907440212577502, 'number': 8857}	{'precision': 0.9659028914348063, 'recall': 0.9851161496731117, 'f1': 0.9754149163280765, 'number': 7189}	{'precision': 0.6055045871559633, 'recall': 0.717391304347826, 'f1': 0.6567164179104478, 'number': 92}	{'precision': 0.9177049180327869, 'recall': 0.9766224703419399, 'f1': 0.9462474645030426, 'number': 5732}	0.7837	0.8533	0.8170	0.8079
0.5435	0.59	3000	0.5327	{'precision': 0.5801165331391115, 'recall': 0.6925083321257789, 'f1': 0.6313494946826079, 'number': 6901}	{'precision': 0.7839085513299626, 'recall': 0.8052387941740996, 'f1': 0.7944305207463102, 'number': 8857}	{'precision': 0.9771436487048067, 'recall': 0.9812213103352344, 'f1': 0.9791782343142699, 'number': 7189}	{'precision': 0.6302521008403361, 'recall': 0.8152173913043478, 'f1': 0.7109004739336493, 'number': 92}	{'precision': 0.9126637554585153, 'recall': 0.9844731332868109, 'f1': 0.9472093999160722, 'number': 5732}	0.7999	0.8579	0.8279	0.8150
0.5333	0.79	4000	0.5212	{'precision': 0.5875760104924288, 'recall': 0.7140994058832053, 'f1': 0.6446886446886447, 'number': 6901}	{'precision': 0.786660777385159, 'recall': 0.8043355537992548, 'f1': 0.7953999888349244, 'number': 8857}	{'precision': 0.9837716843872412, 'recall': 0.9781610794269022, 'f1': 0.9809583594894328, 'number': 7189}	{'precision': 0.6390977443609023, 'recall': 0.9239130434782609, 'f1': 0.7555555555555556, 'number': 92}	{'precision': 0.9263366992219831, 'recall': 0.9762735519888346, 'f1': 0.9506497918967128, 'number': 5732}	0.8050	0.8608	0.8319	0.8183
0.5199	0.99	5000	0.5121	{'precision': 0.5873457536898137, 'recall': 0.7035212288074192, 'f1': 0.6402057097646205, 'number': 6901}	{'precision': 0.7890984865101996, 'recall': 0.812351812126002, 'f1': 0.8005563282336579, 'number': 8857}	{'precision': 0.978519955654102, 'recall': 0.9821950201697037, 'f1': 0.9803540437348144, 'number': 7189}	{'precision': 0.6615384615384615, 'recall': 0.9347826086956522, 'f1': 0.7747747747747747, 'number': 92}	{'precision': 0.9197843489625878, 'recall': 0.9822051639916259, 'f1': 0.9499704716105627, 'number': 5732}	0.8047	0.8629	0.8328	0.8186
0.4983	1.19	6000	0.5088	{'precision': 0.6041901894367081, 'recall': 0.6978698739313143, 'f1': 0.6476600322754169, 'number': 6901}	{'precision': 0.7801047120418848, 'recall': 0.8074968951112115, 'f1': 0.7935644937586686, 'number': 8857}	{'precision': 0.980998613037448, 'recall': 0.983864237028794, 'f1': 0.9824293353705119, 'number': 7189}	{'precision': 0.6511627906976745, 'recall': 0.9130434782608695, 'f1': 0.7601809954751132, 'number': 92}	{'precision': 0.9193864229765013, 'recall': 0.9829030006978368, 'f1': 0.9500843170320405, 'number': 5732}	0.8090	0.8606	0.8340	0.8192
0.5031	1.39	7000	0.5031	{'precision': 0.6055345911949686, 'recall': 0.6975800608607449, 'f1': 0.6483065113460373, 'number': 6901}	{'precision': 0.7835422343324251, 'recall': 0.8116743818448685, 'f1': 0.797360248447205, 'number': 8857}	{'precision': 0.9752815160670145, 'recall': 0.9878981777715955, 'f1': 0.9815493055075669, 'number': 7189}	{'precision': 0.6666666666666666, 'recall': 0.9130434782608695, 'f1': 0.7706422018348623, 'number': 92}	{'precision': 0.9269467043001827, 'recall': 0.9740055826936497, 'f1': 0.9498936622713738, 'number': 5732}	0.8107	0.8610	0.8351	0.8199
0.492	1.58	8000	0.5041	{'precision': 0.6209482341557814, 'recall': 0.743950152151862, 'f1': 0.6769068494956819, 'number': 6901}	{'precision': 0.7778260869565218, 'recall': 0.8079485152986339, 'f1': 0.7926012072880323, 'number': 8857}	{'precision': 0.983001254005852, 'recall': 0.9813604117401585, 'f1': 0.9821801475706529, 'number': 7189}	{'precision': 0.6423357664233577, 'recall': 0.9565217391304348, 'f1': 0.7685589519650656, 'number': 92}	{'precision': 0.9215493188905302, 'recall': 0.9795882763433357, 'f1': 0.9496828752642706, 'number': 5732}	0.8113	0.8706	0.8399	0.8246
0.4817	1.78	9000	0.4901	{'precision': 0.6196705426356589, 'recall': 0.7413418345167367, 'f1': 0.6750676255195619, 'number': 6901}	{'precision': 0.7891447368421053, 'recall': 0.8125776222197132, 'f1': 0.8006897702620014, 'number': 8857}	{'precision': 0.9798370390829996, 'recall': 0.9869244679371262, 'f1': 0.9833679833679833, 'number': 7189}	{'precision': 0.6474820143884892, 'recall': 0.9782608695652174, 'f1': 0.7792207792207793, 'number': 92}	{'precision': 0.9168422758956071, 'recall': 0.9867411025819958, 'f1': 0.9505083606419629, 'number': 5732}	0.8134	0.8743	0.8427	0.8293
0.4905	1.98	10000	0.4892	{'precision': 0.6241463414634146, 'recall': 0.7416316475873062, 'f1': 0.6778359049069598, 'number': 6901}	{'precision': 0.7911287653095002, 'recall': 0.8095291859546122, 'f1': 0.8002232142857143, 'number': 8857}	{'precision': 0.9846860643185299, 'recall': 0.983864237028794, 'f1': 0.9842749791260784, 'number': 7189}	{'precision': 0.6717557251908397, 'recall': 0.9565217391304348, 'f1': 0.789237668161435, 'number': 92}	{'precision': 0.9170723790976956, 'recall': 0.9858688066992324, 'f1': 0.9502270052127123, 'number': 5732}	0.8166	0.8724	0.8436	0.8288
0.4757	2.18	11000	0.4954	{'precision': 0.6271186440677966, 'recall': 0.7398927691638892, 'f1': 0.6788539520042544, 'number': 6901}	{'precision': 0.7921020789792103, 'recall': 0.8130292424071356, 'f1': 0.802429240026744, 'number': 8857}	{'precision': 0.9801077496891836, 'recall': 0.9869244679371262, 'f1': 0.9835042971998891, 'number': 7189}	{'precision': 0.6428571428571429, 'recall': 0.9782608695652174, 'f1': 0.7758620689655172, 'number': 92}	{'precision': 0.9226609864001311, 'recall': 0.9823796231681786, 'f1': 0.9515842839036756, 'number': 5732}	0.8179	0.8732	0.8447	0.8274
0.4691	2.38	12000	0.4903	{'precision': 0.6292872780345414, 'recall': 0.7497464135632517, 'f1': 0.6842557693579316, 'number': 6901}	{'precision': 0.7935547734271887, 'recall': 0.8146099130631139, 'f1': 0.803944509443423, 'number': 8857}	{'precision': 0.9806816613771215, 'recall': 0.9885936847962165, 'f1': 0.984621778886118, 'number': 7189}	{'precision': 0.6544117647058824, 'recall': 0.967391304347826, 'f1': 0.780701754385965, 'number': 92}	{'precision': 0.9238204456094364, 'recall': 0.9837752965806001, 'f1': 0.9528556944913822, 'number': 5732}	0.8189	0.8767	0.8468	0.8301
0.4765	2.57	13000	0.4846	{'precision': 0.6338439095550693, 'recall': 0.7555426749746413, 'f1': 0.6893633899649634, 'number': 6901}	{'precision': 0.7977640026566305, 'recall': 0.8137066726882691, 'f1': 0.805656475322788, 'number': 8857}	{'precision': 0.9850891861761427, 'recall': 0.9833078314090973, 'f1': 0.9841977027497391, 'number': 7189}	{'precision': 0.6774193548387096, 'recall': 0.9130434782608695, 'f1': 0.7777777777777777, 'number': 92}	{'precision': 0.9219950940310712, 'recall': 0.9836008374040475, 'f1': 0.9518021440027011, 'number': 5732}	0.8219	0.8763	0.8482	0.8307
0.4747	2.77	14000	0.4844	{'precision': 0.6380844929171368, 'recall': 0.7375742645993334, 'f1': 0.6842317515795134, 'number': 6901}	{'precision': 0.791246160596753, 'recall': 0.8143841029694028, 'f1': 0.8026484170700496, 'number': 8857}	{'precision': 0.9796255506607929, 'recall': 0.9898455974405341, 'f1': 0.9847090569431951, 'number': 7189}	{'precision': 0.6546762589928058, 'recall': 0.9891304347826086, 'f1': 0.7878787878787878, 'number': 92}	{'precision': 0.9195252804422045, 'recall': 0.9867411025819958, 'f1': 0.9519481612387444, 'number': 5732}	0.8212	0.8747	0.8471	0.8314
0.4654	2.97	15000	0.4808	{'precision': 0.6453574975173784, 'recall': 0.7533690769453703, 'f1': 0.6951928862739855, 'number': 6901}	{'precision': 0.7925608011444921, 'recall': 0.8131421474539912, 'f1': 0.8027195720017833, 'number': 8857}	{'precision': 0.9827013562136728, 'recall': 0.9877590763666713, 'f1': 0.9852237252861602, 'number': 7189}	{'precision': 0.6641221374045801, 'recall': 0.9456521739130435, 'f1': 0.7802690582959643, 'number': 92}	{'precision': 0.9255791030064071, 'recall': 0.9829030006978368, 'f1': 0.9533801506049582, 'number': 5732}	0.8246	0.8767	0.8499	0.8332
0.4586	3.17	16000	0.4827	{'precision': 0.6517362858580775, 'recall': 0.7506158527749601, 'f1': 0.6976900801400768, 'number': 6901}	{'precision': 0.7901383703052932, 'recall': 0.812351812126002, 'f1': 0.8010911317708622, 'number': 8857}	{'precision': 0.979906413432425, 'recall': 0.990402003060231, 'f1': 0.9851262538913871, 'number': 7189}	{'precision': 0.6641221374045801, 'recall': 0.9456521739130435, 'f1': 0.7802690582959643, 'number': 92}	{'precision': 0.9193364774760123, 'recall': 0.9862177250523377, 'f1': 0.9516034003871727, 'number': 5732}	0.8247	0.8771	0.8501	0.8317
0.4612	3.37	17000	0.4869	{'precision': 0.6441053408811224, 'recall': 0.7584408056803362, 'f1': 0.6966127636920211, 'number': 6901}	{'precision': 0.7845718637797846, 'recall': 0.8141582928756915, 'f1': 0.7990913120567377, 'number': 8857}	{'precision': 0.9844271412680756, 'recall': 0.9848379468632633, 'f1': 0.9846325012168833, 'number': 7189}	{'precision': 0.6641221374045801, 'recall': 0.9456521739130435, 'f1': 0.7802690582959643, 'number': 92}	{'precision': 0.9158439877002751, 'recall': 0.9872644801116539, 'f1': 0.9502140878179833, 'number': 5732}	0.8200	0.8783	0.8482	0.8308
0.4546	3.56	18000	0.4806	{'precision': 0.6482188295165394, 'recall': 0.7382987972757571, 'f1': 0.6903326332904275, 'number': 6901}	{'precision': 0.788654181184669, 'recall': 0.8177712543750706, 'f1': 0.8029488387561666, 'number': 8857}	{'precision': 0.9817704736914791, 'recall': 0.9888718876060648, 'f1': 0.9853083853083853, 'number': 7189}	{'precision': 0.6854838709677419, 'recall': 0.9239130434782609, 'f1': 0.787037037037037, 'number': 92}	{'precision': 0.9236179260713118, 'recall': 0.9851709699930217, 'f1': 0.9534019922336655, 'number': 5732}	0.8249	0.8752	0.8493	0.8315
0.4471	3.76	19000	0.4823	{'precision': 0.6466100652147164, 'recall': 0.7614838429213158, 'f1': 0.6993611924407772, 'number': 6901}	{'precision': 0.7929254092057564, 'recall': 0.8149486282036807, 'f1': 0.8037861915367484, 'number': 8857}	{'precision': 0.983906770255272, 'recall': 0.9865071637223536, 'f1': 0.9852052510939778, 'number': 7189}	{'precision': 0.676923076923077, 'recall': 0.9565217391304348, 'f1': 0.7927927927927929, 'number': 92}	{'precision': 0.9211943220753793, 'recall': 0.984996510816469, 'f1': 0.9520276536548351, 'number': 5732}	0.8242	0.8793	0.8508	0.8328
0.4542	3.96	20000	0.4758	{'precision': 0.6508980521123198, 'recall': 0.7456890305752789, 'f1': 0.6950766529344229, 'number': 6901}	{'precision': 0.7868081382629621, 'recall': 0.8121260020322908, 'f1': 0.7992666259236624, 'number': 8857}	{'precision': 0.9829734219269103, 'recall': 0.9877590763666713, 'f1': 0.9853604384930272, 'number': 7189}	{'precision': 0.6744186046511628, 'recall': 0.9456521739130435, 'f1': 0.7873303167420815, 'number': 92}	{'precision': 0.920559986977047, 'recall': 0.9865666434054431, 'f1': 0.9524210526315788, 'number': 5732}	0.8244	0.8753	0.8491	0.8326
0.4452	4.16	21000	0.4833	{'precision': 0.6566687938736439, 'recall': 0.7455441240399941, 'f1': 0.6982899022801302, 'number': 6901}	{'precision': 0.7843478260869565, 'recall': 0.8147228181099695, 'f1': 0.7992468294844105, 'number': 8857}	{'precision': 0.981750311074243, 'recall': 0.9877590763666713, 'f1': 0.9847455276660656, 'number': 7189}	{'precision': 0.6854838709677419, 'recall': 0.9239130434782609, 'f1': 0.787037037037037, 'number': 92}	{'precision': 0.9249303392886412, 'recall': 0.9844731332868109, 'f1': 0.9537733457280487, 'number': 5732}	0.8261	0.8755	0.8501	0.8339
0.4412	4.36	22000	0.4888	{'precision': 0.6534954407294833, 'recall': 0.7477177220692653, 'f1': 0.6974386700006758, 'number': 6901}	{'precision': 0.7870067582297798, 'recall': 0.8151744382973919, 'f1': 0.8008429926238145, 'number': 8857}	{'precision': 0.9839268394069558, 'recall': 0.9877590763666713, 'f1': 0.9858392336526447, 'number': 7189}	{'precision': 0.6717557251908397, 'recall': 0.9565217391304348, 'f1': 0.789237668161435, 'number': 92}	{'precision': 0.9248280379954144, 'recall': 0.9851709699930217, 'f1': 0.9540462916033113, 'number': 5732}	0.8261	0.8764	0.8505	0.8325
0.4423	4.55	23000	0.4827	{'precision': 0.6532828282828282, 'recall': 0.7497464135632517, 'f1': 0.6981985021253626, 'number': 6901}	{'precision': 0.7874007180937874, 'recall': 0.817093824093937, 'f1': 0.8019725177304966, 'number': 8857}	{'precision': 0.9835202880487467, 'recall': 0.9878981777715955, 'f1': 0.9857043719639139, 'number': 7189}	{'precision': 0.6766917293233082, 'recall': 0.9782608695652174, 'f1': 0.7999999999999999, 'number': 92}	{'precision': 0.9264850672792911, 'recall': 0.984996510816469, 'f1': 0.9548452562151193, 'number': 5732}	0.8262	0.8776	0.8511	0.8338
0.4507	4.75	24000	0.4740	{'precision': 0.6584520600693108, 'recall': 0.7433705260107231, 'f1': 0.69833923223523, 'number': 6901}	{'precision': 0.7933530766699572, 'recall': 0.8166422039065147, 'f1': 0.8048291977300545, 'number': 8857}	{'precision': 0.9801898472967395, 'recall': 0.9910975100848518, 'f1': 0.9856135011758197, 'number': 7189}	{'precision': 0.6692307692307692, 'recall': 0.9456521739130435, 'f1': 0.7837837837837838, 'number': 92}	{'precision': 0.922976501305483, 'recall': 0.9867411025819958, 'f1': 0.9537942664418213, 'number': 5732}	0.8290	0.8770	0.8523	0.8347
0.4452	4.95	25000	0.4791	{'precision': 0.6528792569659443, 'recall': 0.7639472540211564, 'f1': 0.7040598290598291, 'number': 6901}	{'precision': 0.7875054513737462, 'recall': 0.8155131534379587, 'f1': 0.8012646292084975, 'number': 8857}	{'precision': 0.9825798423890502, 'recall': 0.9885936847962165, 'f1': 0.9855775897933713, 'number': 7189}	{'precision': 0.6640625, 'recall': 0.9239130434782609, 'f1': 0.7727272727272728, 'number': 92}	{'precision': 0.9227881162259223, 'recall': 0.9862177250523377, 'f1': 0.953449148254343, 'number': 5732}	0.8245	0.8807	0.8517	0.8352
0.4274	5.15	26000	0.4807	{'precision': 0.6607946026986506, 'recall': 0.766410665120997, 'f1': 0.7096947333109694, 'number': 6901}	{'precision': 0.795727342803656, 'recall': 0.8158518685785254, 'f1': 0.8056639536180176, 'number': 8857}	{'precision': 0.9844660194174757, 'recall': 0.9873417721518988, 'f1': 0.9859017987360232, 'number': 7189}	{'precision': 0.6935483870967742, 'recall': 0.9347826086956522, 'f1': 0.7962962962962964, 'number': 92}	{'precision': 0.9229010127409344, 'recall': 0.9856943475226797, 'f1': 0.9532647207693606, 'number': 5732}	0.8300	0.8811	0.8548	0.8361
0.4312	5.35	27000	0.4861	{'precision': 0.6542461005199307, 'recall': 0.7658310389798579, 'f1': 0.7056545830829829, 'number': 6901}	{'precision': 0.7903508771929825, 'recall': 0.8138195777351248, 'f1': 0.8019135562107137, 'number': 8857}	{'precision': 0.981501932633904, 'recall': 0.989010989010989, 'f1': 0.9852421533984619, 'number': 7189}	{'precision': 0.6717557251908397, 'recall': 0.9565217391304348, 'f1': 0.789237668161435, 'number': 92}	{'precision': 0.9154405820533549, 'recall': 0.9877878576413119, 'f1': 0.9502391541495343, 'number': 5732}	0.8243	0.8812	0.8518	0.8335
0.4315	5.54	28000	0.4820	{'precision': 0.6583983883152859, 'recall': 0.7577162730039124, 'f1': 0.7045745469244761, 'number': 6901}	{'precision': 0.7930996593780903, 'recall': 0.8149486282036807, 'f1': 0.8038757099899767, 'number': 8857}	{'precision': 0.9831328632655882, 'recall': 0.9891500904159132, 'f1': 0.9861322978782415, 'number': 7189}	{'precision': 0.6796875, 'recall': 0.9456521739130435, 'f1': 0.7909090909090909, 'number': 92}	{'precision': 0.9204878048780488, 'recall': 0.9876133984647593, 'f1': 0.9528698872243729, 'number': 5732}	0.8282	0.8796	0.8531	0.8341
0.4316	5.74	29000	0.4762	{'precision': 0.6612373737373738, 'recall': 0.7588755252861904, 'f1': 0.7066999527697188, 'number': 6901}	{'precision': 0.7980441709702231, 'recall': 0.8200293553121825, 'f1': 0.8088874039425326, 'number': 8857}	{'precision': 0.9830040071852978, 'recall': 0.9895673946306858, 'f1': 0.9862747816442535, 'number': 7189}	{'precision': 0.672, 'recall': 0.9130434782608695, 'f1': 0.7741935483870968, 'number': 92}	{'precision': 0.9263813739957371, 'recall': 0.9856943475226797, 'f1': 0.955117910573916, 'number': 5732}	0.8316	0.8810	0.8556	0.8370
0.4278	5.94	30000	0.4823	{'precision': 0.6596223583843942, 'recall': 0.7643819736270105, 'f1': 0.7081487447979596, 'number': 6901}	{'precision': 0.7918309242225142, 'recall': 0.8164163938128034, 'f1': 0.8039357385068653, 'number': 8857}	{'precision': 0.9835339698353397, 'recall': 0.9887327862011406, 'f1': 0.9861265260821309, 'number': 7189}	{'precision': 0.68, 'recall': 0.9239130434782609, 'f1': 0.783410138248848, 'number': 92}	{'precision': 0.9244109947643979, 'recall': 0.9856943475226797, 'f1': 0.9540695710908478, 'number': 5732}	0.8286	0.8811	0.8540	0.8348
0.4211	6.14	31000	0.4794	{'precision': 0.6637281206081512, 'recall': 0.7527894508042313, 'f1': 0.705458989679522, 'number': 6901}	{'precision': 0.7826885671061162, 'recall': 0.8177712543750706, 'f1': 0.7998453978245265, 'number': 8857}	{'precision': 0.9804649883065071, 'recall': 0.9913757128947003, 'f1': 0.9858901646147462, 'number': 7189}	{'precision': 0.6854838709677419, 'recall': 0.9239130434782609, 'f1': 0.787037037037037, 'number': 92}	{'precision': 0.925495333224169, 'recall': 0.9860432658757851, 'f1': 0.9548103724976772, 'number': 5732}	0.8274	0.8794	0.8526	0.8356
0.4231	6.34	32000	0.4757	{'precision': 0.6627510420613869, 'recall': 0.7603245906390378, 'f1': 0.7081927385612093, 'number': 6901}	{'precision': 0.7868816735672259, 'recall': 0.815400248391103, 'f1': 0.8008871638480732, 'number': 8857}	{'precision': 0.9844875346260388, 'recall': 0.9887327862011406, 'f1': 0.9866055937261433, 'number': 7189}	{'precision': 0.696, 'recall': 0.9456521739130435, 'f1': 0.8018433179723502, 'number': 92}	{'precision': 0.9235918367346939, 'recall': 0.9869155617585486, 'f1': 0.9542042675212956, 'number': 5732}	0.8284	0.8801	0.8535	0.8364
0.4302	6.53	33000	0.4786	{'precision': 0.6624333248666497, 'recall': 0.7558324880452109, 'f1': 0.706057529610829, 'number': 6901}	{'precision': 0.7953421948808085, 'recall': 0.8174325392345038, 'f1': 0.8062360801781736, 'number': 8857}	{'precision': 0.9832664914949523, 'recall': 0.989010989010989, 'f1': 0.986130374479889, 'number': 7189}	{'precision': 0.7017543859649122, 'recall': 0.8695652173913043, 'f1': 0.7766990291262136, 'number': 92}	{'precision': 0.9243216737495914, 'recall': 0.9865666434054431, 'f1': 0.9544303797468354, 'number': 5732}	0.8312	0.8794	0.8546	0.8355
0.4223	6.73	34000	0.4795	{'precision': 0.6597820577800304, 'recall': 0.7545283292276481, 'f1': 0.703981612925032, 'number': 6901}	{'precision': 0.7922049485439019, 'recall': 0.8169809190470814, 'f1': 0.8044022011005503, 'number': 8857}	{'precision': 0.9832664914949523, 'recall': 0.989010989010989, 'f1': 0.986130374479889, 'number': 7189}	{'precision': 0.6904761904761905, 'recall': 0.9456521739130435, 'f1': 0.7981651376146789, 'number': 92}	{'precision': 0.923730197615548, 'recall': 0.9867411025819958, 'f1': 0.9541965415436525, 'number': 5732}	0.8292	0.8792	0.8535	0.8363
0.4184	6.93	35000	0.4803	{'precision': 0.6614741641337386, 'recall': 0.7568468337922041, 'f1': 0.7059539095762654, 'number': 6901}	{'precision': 0.788057099269914, 'recall': 0.8165292988596591, 'f1': 0.8020405899966729, 'number': 8857}	{'precision': 0.9823472624465591, 'recall': 0.9908193072750034, 'f1': 0.9865650969529086, 'number': 7189}	{'precision': 0.6821705426356589, 'recall': 0.9565217391304348, 'f1': 0.7963800904977375, 'number': 92}	{'precision': 0.9216229428059313, 'recall': 0.9867411025819958, 'f1': 0.9530710253601821, 'number': 5732}	0.8278	0.8801	0.8532	0.8356
0.4071	7.13	36000	0.4882	{'precision': 0.6610340479192938, 'recall': 0.7596000579626141, 'f1': 0.7068977142471848, 'number': 6901}	{'precision': 0.7952072111685171, 'recall': 0.8167551089533702, 'f1': 0.8058371393561323, 'number': 8857}	{'precision': 0.9823423920540765, 'recall': 0.9905411044651551, 'f1': 0.9864247125640672, 'number': 7189}	{'precision': 0.6904761904761905, 'recall': 0.9456521739130435, 'f1': 0.7981651376146789, 'number': 92}	{'precision': 0.9252826478780928, 'recall': 0.9851709699930217, 'f1': 0.9542881284326151, 'number': 5732}	0.8304	0.8804	0.8547	0.8358
0.4093	7.33	37000	0.4856	{'precision': 0.6579605098725319, 'recall': 0.7629329082741632, 'f1': 0.7065691471515801, 'number': 6901}	{'precision': 0.794249972566663, 'recall': 0.8172067291407926, 'f1': 0.8055648302726766, 'number': 8857}	{'precision': 0.9832734310201825, 'recall': 0.9894282932257615, 'f1': 0.9863412604867227, 'number': 7189}	{'precision': 0.7, 'recall': 0.9130434782608695, 'f1': 0.7924528301886793, 'number': 92}	{'precision': 0.9225248735932148, 'recall': 0.9867411025819958, 'f1': 0.9535530641490347, 'number': 5732}	0.8286	0.8813	0.8542	0.8367
0.4124	7.52	38000	0.4802	{'precision': 0.6584084084084084, 'recall': 0.762498188668309, 'f1': 0.7066407036862955, 'number': 6901}	{'precision': 0.7942951179374658, 'recall': 0.8174325392345038, 'f1': 0.8056977520587582, 'number': 8857}	{'precision': 0.9831375259156876, 'recall': 0.9894282932257615, 'f1': 0.9862728785357736, 'number': 7189}	{'precision': 0.6821705426356589, 'recall': 0.9565217391304348, 'f1': 0.7963800904977375, 'number': 92}	{'precision': 0.9221244705115673, 'recall': 0.9874389392882066, 'f1': 0.9536647009267059, 'number': 5732}	0.8286	0.8815	0.8543	0.8362
0.414	7.72	39000	0.4830	{'precision': 0.6575084681972149, 'recall': 0.7594551514273293, 'f1': 0.7048144163528779, 'number': 6901}	{'precision': 0.7878721779910568, 'recall': 0.8156260584848143, 'f1': 0.8015089315433264, 'number': 8857}	{'precision': 0.9819235545743066, 'recall': 0.9898455974405341, 'f1': 0.9858686616791354, 'number': 7189}	{'precision': 0.6850393700787402, 'recall': 0.9456521739130435, 'f1': 0.7945205479452054, 'number': 92}	{'precision': 0.925229057591623, 'recall': 0.9865666434054431, 'f1': 0.9549138804457953, 'number': 5732}	0.8268	0.8802	0.8527	0.8366
0.4212	7.92	40000	0.4803	{'precision': 0.6614674319940105, 'recall': 0.7681495435444139, 'f1': 0.7108280254777071, 'number': 6901}	{'precision': 0.7921052631578948, 'recall': 0.8156260584848143, 'f1': 0.8036936084997496, 'number': 8857}	{'precision': 0.9846089850249584, 'recall': 0.9877590763666713, 'f1': 0.9861815151725575, 'number': 7189}	{'precision': 0.6854838709677419, 'recall': 0.9239130434782609, 'f1': 0.787037037037037, 'number': 92}	{'precision': 0.9240444299248611, 'recall': 0.9869155617585486, 'f1': 0.9544457567065969, 'number': 5732}	0.8292	0.8817	0.8547	0.8373
0.3994	8.12	41000	0.4923	{'precision': 0.6586345381526104, 'recall': 0.7604694971743226, 'f1': 0.7058981774161006, 'number': 6901}	{'precision': 0.7905782052683353, 'recall': 0.8166422039065147, 'f1': 0.8033988670443185, 'number': 8857}	{'precision': 0.9830016583747927, 'recall': 0.9894282932257615, 'f1': 0.9862045060658579, 'number': 7189}	{'precision': 0.6821705426356589, 'recall': 0.9565217391304348, 'f1': 0.7963800904977375, 'number': 92}	{'precision': 0.9232903541700669, 'recall': 0.9869155617585486, 'f1': 0.9540433426089888, 'number': 5732}	0.8278	0.8807	0.8535	0.8355
0.4052	8.32	42000	0.4866	{'precision': 0.6577553593947036, 'recall': 0.7558324880452109, 'f1': 0.7033915447373744, 'number': 6901}	{'precision': 0.7920087575259989, 'recall': 0.8168680140002258, 'f1': 0.8042463317029791, 'number': 8857}	{'precision': 0.9823326432022084, 'recall': 0.9899846988454584, 'f1': 0.9861438270749618, 'number': 7189}	{'precision': 0.6846153846153846, 'recall': 0.967391304347826, 'f1': 0.8018018018018018, 'number': 92}	{'precision': 0.9250531827851416, 'recall': 0.9862177250523377, 'f1': 0.9546567592670776, 'number': 5732}	0.8285	0.8797	0.8533	0.8360
0.4042	8.51	43000	0.4866	{'precision': 0.663912546078556, 'recall': 0.7568468337922041, 'f1': 0.7073401950162513, 'number': 6901}	{'precision': 0.7910823838737949, 'recall': 0.8152873433442475, 'f1': 0.8030025020850708, 'number': 8857}	{'precision': 0.980462300495322, 'recall': 0.991236611489776, 'f1': 0.9858200179843675, 'number': 7189}	{'precision': 0.6796875, 'recall': 0.9456521739130435, 'f1': 0.7909090909090909, 'number': 92}	{'precision': 0.921961550993809, 'recall': 0.9872644801116539, 'f1': 0.9534962089300758, 'number': 5732}	0.8292	0.8799	0.8538	0.8365
0.4135	8.71	44000	0.4830	{'precision': 0.664262212098203, 'recall': 0.7606144037096073, 'f1': 0.7091805715057758, 'number': 6901}	{'precision': 0.7914884282110344, 'recall': 0.8147228181099695, 'f1': 0.802937576499388, 'number': 8857}	{'precision': 0.9812594736116853, 'recall': 0.9905411044651551, 'f1': 0.985878443859892, 'number': 7189}	{'precision': 0.6829268292682927, 'recall': 0.9130434782608695, 'f1': 0.7813953488372093, 'number': 92}	{'precision': 0.9230141901810471, 'recall': 0.9872644801116539, 'f1': 0.9540588384051252, 'number': 5732}	0.8296	0.8804	0.8543	0.8368
0.3958	8.91	45000	0.4859	{'precision': 0.6619275289380976, 'recall': 0.7623532821330242, 'f1': 0.7085999057175567, 'number': 6901}	{'precision': 0.7909240021869874, 'recall': 0.8166422039065147, 'f1': 0.8035773802910788, 'number': 8857}	{'precision': 0.9831445150594087, 'recall': 0.9898455974405341, 'f1': 0.9864836764400082, 'number': 7189}	{'precision': 0.6910569105691057, 'recall': 0.9239130434782609, 'f1': 0.7906976744186046, 'number': 92}	{'precision': 0.9235543939888925, 'recall': 0.9863921842288904, 'f1': 0.9539395984477813, 'number': 5732}	0.8290	0.8811	0.8543	0.8371
0.3985	9.11	46000	0.4897	{'precision': 0.6627135934710533, 'recall': 0.7530792638748007, 'f1': 0.7050125483280201, 'number': 6901}	{'precision': 0.7878688881629097, 'recall': 0.8168680140002258, 'f1': 0.8021064301552105, 'number': 8857}	{'precision': 0.9842192691029901, 'recall': 0.989010989010989, 'f1': 0.9866093110386457, 'number': 7189}	{'precision': 0.6771653543307087, 'recall': 0.9347826086956522, 'f1': 0.7853881278538813, 'number': 92}	{'precision': 0.9269413889344935, 'recall': 0.984996510816469, 'f1': 0.9550875412331895, 'number': 5732}	0.8296	0.8785	0.8533	0.8352
0.3944	9.31	47000	0.4890	{'precision': 0.6661152818424736, 'recall': 0.7585857122156209, 'f1': 0.709349593495935, 'number': 6901}	{'precision': 0.7902785363189514, 'recall': 0.8168680140002258, 'f1': 0.8033533200088829, 'number': 8857}	{'precision': 0.9839535205422604, 'recall': 0.9894282932257615, 'f1': 0.9866833125260092, 'number': 7189}	{'precision': 0.6854838709677419, 'recall': 0.9239130434782609, 'f1': 0.787037037037037, 'number': 92}	{'precision': 0.9251923391717138, 'recall': 0.9860432658757851, 'f1': 0.954649100582721, 'number': 5732}	0.8308	0.8801	0.8547	0.8369
0.3959	9.5	48000	0.4869	{'precision': 0.6632755589047978, 'recall': 0.765251412838719, 'f1': 0.7106236964273699, 'number': 6901}	{'precision': 0.7917122239230264, 'recall': 0.8175454442813593, 'f1': 0.8044214853080043, 'number': 8857}	{'precision': 0.9835476289229919, 'recall': 0.9895673946306858, 'f1': 0.9865483289418943, 'number': 7189}	{'precision': 0.688, 'recall': 0.9347826086956522, 'f1': 0.7926267281105991, 'number': 92}	{'precision': 0.9240196078431373, 'recall': 0.9865666434054431, 'f1': 0.9542693216334796, 'number': 5732}	0.8297	0.8820	0.8551	0.8369
0.3979	9.7	49000	0.4878	{'precision': 0.666244939271255, 'recall': 0.7630778148094479, 'f1': 0.7113812901046943, 'number': 6901}	{'precision': 0.7906239755218009, 'recall': 0.8168680140002258, 'f1': 0.8035317636605953, 'number': 8857}	{'precision': 0.9835453539823009, 'recall': 0.9894282932257615, 'f1': 0.9864780528396089, 'number': 7189}	{'precision': 0.6829268292682927, 'recall': 0.9130434782608695, 'f1': 0.7813953488372093, 'number': 92}	{'precision': 0.9240071907174375, 'recall': 0.9863921842288904, 'f1': 0.9541810817652518, 'number': 5732}	0.8304	0.8812	0.8550	0.8369
0.4095	9.9	50000	0.4862	{'precision': 0.665783497350492, 'recall': 0.7646717866975801, 'f1': 0.7118095366561004, 'number': 6901}	{'precision': 0.7912472647702407, 'recall': 0.8165292988596591, 'f1': 0.80368950380619, 'number': 8857}	{'precision': 0.9832734310201825, 'recall': 0.9894282932257615, 'f1': 0.9863412604867227, 'number': 7189}	{'precision': 0.6829268292682927, 'recall': 0.9130434782608695, 'f1': 0.7813953488372093, 'number': 92}	{'precision': 0.9244604316546763, 'recall': 0.9863921842288904, 'f1': 0.9544226873733964, 'number': 5732}	0.8304	0.8814	0.8552	0.8373

Framework versions

• Transformers 4.34.1
• Pytorch 2.1.0+cu118
• Datasets 2.14.5
• Tokenizers 0.14.1