t5-base-finetuned-en-to-fr

This model is a fine-tuned version of Demosthene-OR/t5-base-finetuned-en-to-fr on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.0189
• Bleu: 99.5662
• Gen Len: 5.9091

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 150

Training results

Training Loss	Epoch	Step	Validation Loss	Bleu	Gen Len
No log	1.0	2	0.9476	91.8099	6.2727
No log	2.0	4	0.8626	91.2967	6.3636
No log	3.0	6	0.7928	91.2967	6.3636
No log	4.0	8	0.7310	91.2967	6.3636
No log	5.0	10	0.6734	91.2967	6.3636
No log	6.0	12	0.6195	91.7685	6.4545
No log	7.0	14	0.5711	92.7714	6.3636
No log	8.0	16	0.5311	92.7714	6.3636
No log	9.0	18	0.4952	93.8091	6.2727
No log	10.0	20	0.4598	93.8091	6.2727
No log	11.0	22	0.4246	93.8091	6.2727
No log	12.0	24	0.3919	93.8091	6.2727
No log	13.0	26	0.3602	93.8091	6.2727
No log	14.0	28	0.3308	93.8091	6.2727
No log	15.0	30	0.3050	93.8091	6.2727
No log	16.0	32	0.2828	94.9904	6.2273
No log	17.0	34	0.2633	95.4618	5.8636
No log	18.0	36	0.2452	95.4618	5.8636
No log	19.0	38	0.2278	96.624	5.8182
No log	20.0	40	0.2143	96.0313	5.9545
No log	21.0	42	0.2027	96.0313	5.9545
No log	22.0	44	0.1921	96.4897	5.9091
No log	23.0	46	0.1831	96.4897	5.9091
No log	24.0	48	0.1739	96.4897	5.9091
No log	25.0	50	0.1648	96.4897	5.9091
No log	26.0	52	0.1570	96.4897	5.9091
No log	27.0	54	0.1511	96.9417	5.8182
No log	28.0	56	0.1458	96.9417	5.8182
No log	29.0	58	0.1409	96.9417	5.8182
No log	30.0	60	0.1377	96.9417	5.8182
No log	31.0	62	0.1342	96.9417	5.8182
No log	32.0	64	0.1313	96.9417	5.8182
No log	33.0	66	0.1282	96.9417	5.8182
No log	34.0	68	0.1252	96.9417	5.8182
No log	35.0	70	0.1216	96.9417	5.8182
No log	36.0	72	0.1172	96.9417	5.8182
No log	37.0	74	0.1128	96.9417	5.8182
No log	38.0	76	0.1094	96.9417	5.8182
No log	39.0	78	0.1060	96.9417	5.8182
No log	40.0	80	0.1033	97.3874	5.8636
No log	41.0	82	0.1007	97.3874	5.8636
No log	42.0	84	0.0978	97.3874	5.8636
No log	43.0	86	0.0945	97.3874	5.8636
No log	44.0	88	0.0912	97.3874	5.8636
No log	45.0	90	0.0882	97.3874	5.8636
No log	46.0	92	0.0855	97.3874	5.8636
No log	47.0	94	0.0835	97.3874	5.8636
No log	48.0	96	0.0818	97.3874	6.1364
No log	49.0	98	0.0800	97.3874	6.1364
No log	50.0	100	0.0781	97.3874	6.1364
No log	51.0	102	0.0764	97.3874	6.1364
No log	52.0	104	0.0748	97.3874	5.8636
No log	53.0	106	0.0735	97.3874	5.8636
No log	54.0	108	0.0726	97.3874	5.8636
No log	55.0	110	0.0716	97.3874	5.8636
No log	56.0	112	0.0707	97.3874	5.8636
No log	57.0	114	0.0702	97.3874	5.8636
No log	58.0	116	0.0705	97.3874	5.8636
No log	59.0	118	0.0705	97.3874	5.8636
No log	60.0	120	0.0703	97.3874	5.8636
No log	61.0	122	0.0708	97.3874	5.8636
No log	62.0	124	0.0707	97.3874	5.8636
No log	63.0	126	0.0714	97.3874	5.8636
No log	64.0	128	0.0717	97.3874	5.8636
No log	65.0	130	0.0717	97.3874	5.8636
No log	66.0	132	0.0707	97.3874	5.8636
No log	67.0	134	0.0700	97.3874	5.8636
No log	68.0	136	0.0682	97.3874	5.8636
No log	69.0	138	0.0669	97.3874	5.8636
No log	70.0	140	0.0652	97.3874	5.8636
No log	71.0	142	0.0630	97.3874	5.8636
No log	72.0	144	0.0615	97.3874	5.8636
No log	73.0	146	0.0595	97.3874	5.8636
No log	74.0	148	0.0580	97.3874	5.8636
No log	75.0	150	0.0566	97.3874	5.8636
No log	76.0	152	0.0557	97.3874	5.8636
No log	77.0	154	0.0545	97.3874	5.8636
No log	78.0	156	0.0535	97.3874	5.8636
No log	79.0	158	0.0523	97.3874	5.8636
No log	80.0	160	0.0511	97.3874	5.8636
No log	81.0	162	0.0499	97.3874	5.8636
No log	82.0	164	0.0490	97.3874	5.8636
No log	83.0	166	0.0482	97.3874	5.8636
No log	84.0	168	0.0474	97.3874	5.8636
No log	85.0	170	0.0466	97.3874	5.8636
No log	86.0	172	0.0458	97.3874	5.8636
No log	87.0	174	0.0449	97.3874	5.8636
No log	88.0	176	0.0439	97.3874	5.8636
No log	89.0	178	0.0428	97.3874	5.8636
No log	90.0	180	0.0423	97.3874	5.8636
No log	91.0	182	0.0419	97.3874	5.8636
No log	92.0	184	0.0415	97.3874	5.8636
No log	93.0	186	0.0411	97.3874	5.8636
No log	94.0	188	0.0409	97.3874	5.8636
No log	95.0	190	0.0404	97.3874	5.8636
No log	96.0	192	0.0398	98.4309	5.9091
No log	97.0	194	0.0394	98.4309	5.9091
No log	98.0	196	0.0391	98.4309	5.9091
No log	99.0	198	0.0388	97.3874	5.8636
No log	100.0	200	0.0385	97.3874	5.8636
No log	101.0	202	0.0381	99.5662	5.9091
No log	102.0	204	0.0373	99.5662	5.9091
No log	103.0	206	0.0365	99.5662	5.9091
No log	104.0	208	0.0356	99.5662	5.9091
No log	105.0	210	0.0345	99.5662	5.9091
No log	106.0	212	0.0334	99.5662	5.9091
No log	107.0	214	0.0324	99.5662	5.9091
No log	108.0	216	0.0315	99.5662	5.9091
No log	109.0	218	0.0305	99.5662	5.9091
No log	110.0	220	0.0294	99.5662	5.9091
No log	111.0	222	0.0283	99.5662	5.9091
No log	112.0	224	0.0273	99.5662	5.9091
No log	113.0	226	0.0264	99.5662	5.9091
No log	114.0	228	0.0257	99.5662	5.9091
No log	115.0	230	0.0251	99.5662	5.9091
No log	116.0	232	0.0246	99.5662	5.9091
No log	117.0	234	0.0241	99.5662	5.9091
No log	118.0	236	0.0237	99.5662	5.9091
No log	119.0	238	0.0233	99.5662	5.9091
No log	120.0	240	0.0228	99.5662	5.9091
No log	121.0	242	0.0224	99.5662	5.9091
No log	122.0	244	0.0221	99.5662	5.9091
No log	123.0	246	0.0217	99.5662	5.9091
No log	124.0	248	0.0212	99.5662	5.9091
No log	125.0	250	0.0208	99.5662	5.9091
No log	126.0	252	0.0204	99.5662	5.9091
No log	127.0	254	0.0201	99.5662	5.9091
No log	128.0	256	0.0199	99.5662	5.9091
No log	129.0	258	0.0197	99.5662	5.9091
No log	130.0	260	0.0197	99.5662	5.9091
No log	131.0	262	0.0196	99.5662	5.9091
No log	132.0	264	0.0197	99.5662	5.9091
No log	133.0	266	0.0197	99.5662	5.9091
No log	134.0	268	0.0196	99.5662	5.9091
No log	135.0	270	0.0195	99.5662	5.9091
No log	136.0	272	0.0193	99.5662	5.9091
No log	137.0	274	0.0191	99.5662	5.9091
No log	138.0	276	0.0190	99.5662	5.9091
No log	139.0	278	0.0190	99.5662	5.9091
No log	140.0	280	0.0189	99.5662	5.9091
No log	141.0	282	0.0189	99.5662	5.9091
No log	142.0	284	0.0189	99.5662	5.9091
No log	143.0	286	0.0189	99.5662	5.9091
No log	144.0	288	0.0189	99.5662	5.9091
No log	145.0	290	0.0189	99.5662	5.9091
No log	146.0	292	0.0189	99.5662	5.9091
No log	147.0	294	0.0189	99.5662	5.9091
No log	148.0	296	0.0189	99.5662	5.9091
No log	149.0	298	0.0189	99.5662	5.9091
No log	150.0	300	0.0189	99.5662	5.9091

Framework versions

• Transformers 4.33.1
• Pytorch 2.0.1
• Datasets 2.13.0
• Tokenizers 0.13.2