metadata
base_model: ''
tags:
- generated_from_trainer
metrics:
- rouge
model-index:
- name: hubert2BertMusic100
results: []
hubert2BertMusic100
This model is a fine-tuned version of on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 2.5867
- Rouge1: 36.0915
- Rouge2: 12.101
- Rougel: 26.2764
- Rougelsum: 26.2441
- Gen Len: 25.98
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 10
Training results
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|---|---|---|---|---|---|---|---|---|
| 5.4394 | 1.0 | 983 | 4.7204 | 22.0764 | 4.0274 | 20.3934 | 20.4011 | 61.19 |
| 4.8173 | 2.0 | 1966 | 4.2071 | 35.9784 | 15.4735 | 29.1397 | 29.0838 | 34.98 |
| 4.2216 | 3.0 | 2949 | 3.6499 | 39.0915 | 15.7932 | 29.828 | 29.8062 | 32.73 |
| 3.7867 | 4.0 | 3932 | 3.3676 | 38.2403 | 15.4761 | 28.9872 | 28.9768 | 28.6 |
| 3.502 | 5.0 | 4915 | 3.1133 | 41.6179 | 17.8598 | 29.2306 | 29.2435 | 29.2 |
| 3.2367 | 6.0 | 5898 | 2.8908 | 36.6649 | 13.4593 | 27.1849 | 27.2161 | 26.21 |
| 3.079 | 7.0 | 6881 | 2.7573 | 35.1153 | 11.8019 | 25.6868 | 25.6664 | 23.17 |
| 2.9658 | 8.0 | 7864 | 2.6532 | 39.4462 | 13.8979 | 28.2899 | 28.296 | 33.88 |
| 2.8801 | 9.0 | 8847 | 2.6063 | 39.2319 | 13.9339 | 28.2368 | 28.265 | 30.96 |
| 2.8509 | 10.0 | 9830 | 2.5867 | 36.0915 | 12.101 | 26.2764 | 26.2441 | 25.98 |
Framework versions
- Transformers 4.31.0
- Pytorch 2.0.1+cu117
- Datasets 2.14.2
- Tokenizers 0.13.3