fb-bart-large-finetuned-trade-the-event-finance-summarizer

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.5103
• Rouge1: 57.6289
• Rouge2: 53.0421
• Rougel: 56.54
• Rougelsum: 56.5636

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5.6e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Rougelsum
1.8188	1.0	1688	1.7495	37.9629	22.0496	32.2942	32.4631
1.2551	2.0	3376	1.7559	38.5548	22.7487	32.9304	33.0737
0.8629	3.0	5064	1.9539	39.3912	22.8503	33.2043	33.4378
0.5661	4.0	6752	2.1153	39.1514	22.8104	33.1306	33.2955
0.3484	5.0	8440	2.3289	39.0093	22.4364	32.5868	32.7545
0.2009	6.0	10128	2.5754	39.0874	22.4444	32.6894	32.8413
0.1105	7.0	11816	2.8093	39.0905	22.4051	32.597	32.8183
0.0609	8.0	13504	0.5103	57.6289	53.0421	56.54	56.5636

Framework versions

• Transformers 4.16.2
• Pytorch 1.10.0+cu111
• Datasets 1.18.3
• Tokenizers 0.11.0