metadata
license: apache-2.0
base_model: google-t5/t5-base
tags:
- generated_from_trainer
metrics:
- rouge
model-index:
- name: t5-base-finetuned-stocknews_2000_longshort_100
results: []
t5-base-finetuned-stocknews_2000_longshort_100
This model is a fine-tuned version of google-t5/t5-base on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 1.2433
- Rouge1: 47.379
- Rouge2: 37.1581
- Rougel: 44.4701
- Rougelsum: 44.9076
- Gen Len: 18.9725
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 150
- mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|---|---|---|---|---|---|---|---|---|
| No log | 1.0 | 200 | 0.9141 | 38.5343 | 24.2777 | 34.8367 | 35.2768 | 18.93 |
| No log | 2.0 | 400 | 0.8487 | 40.3489 | 26.7081 | 36.8437 | 37.2973 | 18.905 |
| 0.9964 | 3.0 | 600 | 0.8132 | 40.5675 | 26.9863 | 37.1398 | 37.6554 | 18.92 |
| 0.9964 | 4.0 | 800 | 0.7866 | 40.9242 | 27.5104 | 37.3596 | 37.8172 | 18.9175 |
| 0.7772 | 5.0 | 1000 | 0.7671 | 42.9708 | 29.7805 | 39.4356 | 39.9334 | 18.925 |
| 0.7772 | 6.0 | 1200 | 0.7591 | 43.3101 | 30.5015 | 39.8299 | 40.3437 | 18.9225 |
| 0.7772 | 7.0 | 1400 | 0.7478 | 43.3538 | 30.7684 | 40.0205 | 40.4603 | 18.915 |
| 0.6424 | 8.0 | 1600 | 0.7443 | 43.691 | 31.528 | 40.5718 | 41.0246 | 18.94 |
| 0.6424 | 9.0 | 1800 | 0.7403 | 44.2767 | 32.1741 | 40.9753 | 41.4431 | 18.935 |
| 0.5559 | 10.0 | 2000 | 0.7445 | 44.2641 | 32.2749 | 41.238 | 41.6911 | 18.9325 |
| 0.5559 | 11.0 | 2200 | 0.7402 | 44.9439 | 33.2834 | 41.8866 | 42.3044 | 18.9375 |
| 0.5559 | 12.0 | 2400 | 0.7453 | 44.8006 | 33.0754 | 41.69 | 42.1809 | 18.94 |
| 0.4838 | 13.0 | 2600 | 0.7466 | 45.861 | 34.1523 | 42.8088 | 43.2566 | 18.9425 |
| 0.4838 | 14.0 | 2800 | 0.7469 | 45.5954 | 34.1822 | 42.7063 | 43.1481 | 18.9425 |
| 0.4255 | 15.0 | 3000 | 0.7520 | 45.6216 | 34.4968 | 42.7157 | 43.1601 | 18.9425 |
| 0.4255 | 16.0 | 3200 | 0.7630 | 45.8129 | 34.5464 | 42.8766 | 43.3734 | 18.9425 |
| 0.4255 | 17.0 | 3400 | 0.7691 | 45.5398 | 34.1635 | 42.7054 | 43.2133 | 18.9475 |
| 0.374 | 18.0 | 3600 | 0.7794 | 45.956 | 34.9695 | 43.2425 | 43.7921 | 18.9475 |
| 0.374 | 19.0 | 3800 | 0.7858 | 46.3277 | 35.375 | 43.5397 | 44.0538 | 18.95 |
| 0.3378 | 20.0 | 4000 | 0.7908 | 45.7738 | 34.8592 | 43.0466 | 43.5114 | 18.97 |
| 0.3378 | 21.0 | 4200 | 0.8030 | 46.4438 | 35.484 | 43.5796 | 43.9963 | 18.9725 |
| 0.3378 | 22.0 | 4400 | 0.8122 | 46.3839 | 35.5331 | 43.5935 | 44.0138 | 18.97 |
| 0.2962 | 23.0 | 4600 | 0.8170 | 46.1935 | 35.3128 | 43.3188 | 43.7615 | 18.9475 |
| 0.2962 | 24.0 | 4800 | 0.8259 | 46.7935 | 35.9441 | 43.7662 | 44.2772 | 18.95 |
| 0.2696 | 25.0 | 5000 | 0.8331 | 46.6253 | 35.8821 | 43.727 | 44.1886 | 18.9525 |
| 0.2696 | 26.0 | 5200 | 0.8374 | 46.5525 | 35.9618 | 43.7777 | 44.1759 | 18.9525 |
| 0.2696 | 27.0 | 5400 | 0.8538 | 46.4477 | 35.7819 | 43.5644 | 43.9848 | 18.9525 |
| 0.2399 | 28.0 | 5600 | 0.8612 | 46.7679 | 36.2854 | 44.1508 | 44.5167 | 18.9525 |
| 0.2399 | 29.0 | 5800 | 0.8620 | 46.7708 | 36.1656 | 43.9684 | 44.3859 | 18.9525 |
| 0.218 | 30.0 | 6000 | 0.8781 | 46.93 | 36.5689 | 44.4382 | 44.8294 | 18.9525 |
| 0.218 | 31.0 | 6200 | 0.8809 | 46.9622 | 36.5912 | 44.2164 | 44.6975 | 18.9525 |
| 0.218 | 32.0 | 6400 | 0.8909 | 46.9908 | 36.4725 | 44.145 | 44.6297 | 18.9725 |
| 0.1979 | 33.0 | 6600 | 0.9007 | 47.0094 | 36.5598 | 44.1484 | 44.6246 | 18.9725 |
| 0.1979 | 34.0 | 6800 | 0.9032 | 47.0099 | 36.4015 | 43.9565 | 44.511 | 18.9525 |
| 0.1803 | 35.0 | 7000 | 0.9113 | 47.0771 | 36.4655 | 44.0139 | 44.4934 | 18.9525 |
| 0.1803 | 36.0 | 7200 | 0.9193 | 47.0419 | 36.6874 | 44.1141 | 44.5545 | 18.9525 |
| 0.1803 | 37.0 | 7400 | 0.9276 | 47.0573 | 36.7703 | 44.2841 | 44.7604 | 18.9525 |
| 0.1619 | 38.0 | 7600 | 0.9363 | 47.3043 | 37.0269 | 44.4301 | 44.8272 | 18.9525 |
| 0.1619 | 39.0 | 7800 | 0.9370 | 47.015 | 36.6241 | 44.1216 | 44.4495 | 18.9525 |
| 0.1516 | 40.0 | 8000 | 0.9524 | 47.2931 | 36.7869 | 44.356 | 44.7442 | 18.9525 |
| 0.1516 | 41.0 | 8200 | 0.9585 | 47.1871 | 36.7163 | 44.2597 | 44.6574 | 18.9525 |
| 0.1516 | 42.0 | 8400 | 0.9633 | 47.2776 | 36.7057 | 44.336 | 44.7328 | 18.9525 |
| 0.1374 | 43.0 | 8600 | 0.9690 | 47.2502 | 36.759 | 44.4381 | 44.8798 | 18.9525 |
| 0.1374 | 44.0 | 8800 | 0.9791 | 47.3719 | 36.8917 | 44.577 | 44.9546 | 18.9525 |
| 0.1258 | 45.0 | 9000 | 0.9796 | 47.3306 | 36.9041 | 44.4739 | 44.8264 | 18.9725 |
| 0.1258 | 46.0 | 9200 | 0.9824 | 47.1484 | 36.847 | 44.2686 | 44.6887 | 18.9525 |
| 0.1258 | 47.0 | 9400 | 1.0006 | 47.1981 | 36.8111 | 44.3574 | 44.7138 | 18.9525 |
| 0.1179 | 48.0 | 9600 | 0.9993 | 47.314 | 36.7132 | 44.0765 | 44.5151 | 18.9525 |
| 0.1179 | 49.0 | 9800 | 1.0100 | 47.0527 | 36.7627 | 44.1905 | 44.5119 | 18.9525 |
| 0.1095 | 50.0 | 10000 | 1.0155 | 47.127 | 36.773 | 44.3325 | 44.6517 | 18.9525 |
| 0.1095 | 51.0 | 10200 | 1.0182 | 47.1701 | 36.7509 | 44.2938 | 44.6916 | 18.9725 |
| 0.1095 | 52.0 | 10400 | 1.0242 | 47.2623 | 36.8327 | 44.4037 | 44.7943 | 18.9725 |
| 0.1004 | 53.0 | 10600 | 1.0275 | 47.5715 | 37.1557 | 44.6796 | 45.0297 | 18.9725 |
| 0.1004 | 54.0 | 10800 | 1.0359 | 47.3342 | 36.9982 | 44.469 | 44.8337 | 18.9525 |
| 0.0936 | 55.0 | 11000 | 1.0366 | 47.6092 | 37.1985 | 44.7346 | 45.0989 | 18.9725 |
| 0.0936 | 56.0 | 11200 | 1.0535 | 47.6625 | 37.2267 | 44.6937 | 45.0813 | 18.9525 |
| 0.0936 | 57.0 | 11400 | 1.0434 | 47.1472 | 36.736 | 44.3177 | 44.641 | 18.9525 |
| 0.0868 | 58.0 | 11600 | 1.0535 | 47.1669 | 36.63 | 44.3785 | 44.7253 | 18.9525 |
| 0.0868 | 59.0 | 11800 | 1.0524 | 47.0978 | 36.46 | 44.1152 | 44.4164 | 18.9525 |
| 0.0816 | 60.0 | 12000 | 1.0629 | 46.9521 | 36.4969 | 44.0844 | 44.4438 | 18.9725 |
| 0.0816 | 61.0 | 12200 | 1.0650 | 47.2896 | 36.9284 | 44.4427 | 44.8343 | 18.9725 |
| 0.0816 | 62.0 | 12400 | 1.0756 | 47.2056 | 36.6007 | 44.2689 | 44.6388 | 18.9725 |
| 0.0763 | 63.0 | 12600 | 1.0757 | 47.2394 | 36.8165 | 44.256 | 44.561 | 18.9725 |
| 0.0763 | 64.0 | 12800 | 1.0808 | 47.2861 | 36.8009 | 44.3111 | 44.6663 | 18.9725 |
| 0.0739 | 65.0 | 13000 | 1.0871 | 47.0393 | 36.4886 | 44.108 | 44.4587 | 18.9725 |
| 0.0739 | 66.0 | 13200 | 1.0935 | 47.0034 | 36.6509 | 43.99 | 44.3965 | 18.9525 |
| 0.0739 | 67.0 | 13400 | 1.0916 | 47.0806 | 36.6237 | 44.0661 | 44.5176 | 18.9725 |
| 0.068 | 68.0 | 13600 | 1.1006 | 47.1444 | 36.5177 | 44.2365 | 44.6788 | 18.9725 |
| 0.068 | 69.0 | 13800 | 1.1053 | 47.0907 | 36.4401 | 44.1416 | 44.5535 | 18.9725 |
| 0.0643 | 70.0 | 14000 | 1.1006 | 47.2846 | 36.7274 | 44.3121 | 44.7264 | 18.9725 |
| 0.0643 | 71.0 | 14200 | 1.1139 | 47.4036 | 36.9528 | 44.5044 | 44.9003 | 18.9725 |
| 0.0643 | 72.0 | 14400 | 1.1099 | 47.3805 | 37.0484 | 44.5352 | 44.935 | 18.9725 |
| 0.0623 | 73.0 | 14600 | 1.1126 | 47.2923 | 36.7686 | 44.3123 | 44.717 | 18.9725 |
| 0.0623 | 74.0 | 14800 | 1.1197 | 47.316 | 36.8541 | 44.3815 | 44.8115 | 18.9725 |
| 0.0581 | 75.0 | 15000 | 1.1175 | 47.3956 | 36.9679 | 44.3779 | 44.8287 | 18.9725 |
| 0.0581 | 76.0 | 15200 | 1.1334 | 47.0912 | 36.6596 | 44.2089 | 44.6322 | 18.9725 |
| 0.0581 | 77.0 | 15400 | 1.1302 | 47.3066 | 36.8107 | 44.4113 | 44.8553 | 18.9725 |
| 0.0548 | 78.0 | 15600 | 1.1360 | 47.3241 | 36.9129 | 44.5069 | 44.922 | 18.9725 |
| 0.0548 | 79.0 | 15800 | 1.1353 | 47.2705 | 37.0027 | 44.4539 | 44.8693 | 18.9725 |
| 0.0525 | 80.0 | 16000 | 1.1394 | 47.2088 | 36.8393 | 44.3551 | 44.7349 | 18.9725 |
| 0.0525 | 81.0 | 16200 | 1.1467 | 47.1913 | 36.7994 | 44.3602 | 44.7693 | 18.9725 |
| 0.0525 | 82.0 | 16400 | 1.1516 | 47.0243 | 36.6827 | 44.2269 | 44.5925 | 18.9725 |
| 0.0499 | 83.0 | 16600 | 1.1481 | 47.2883 | 36.7582 | 44.5134 | 44.8985 | 18.9725 |
| 0.0499 | 84.0 | 16800 | 1.1481 | 47.2414 | 36.8938 | 44.4629 | 44.8504 | 18.9725 |
| 0.0488 | 85.0 | 17000 | 1.1659 | 47.0325 | 36.7187 | 44.1609 | 44.574 | 18.9725 |
| 0.0488 | 86.0 | 17200 | 1.1608 | 47.0348 | 36.7733 | 44.2843 | 44.755 | 18.9725 |
| 0.0488 | 87.0 | 17400 | 1.1620 | 47.289 | 36.957 | 44.3967 | 44.833 | 18.9725 |
| 0.0459 | 88.0 | 17600 | 1.1640 | 47.2488 | 37.0562 | 44.4618 | 44.8901 | 18.9725 |
| 0.0459 | 89.0 | 17800 | 1.1611 | 47.253 | 36.8942 | 44.3236 | 44.7534 | 18.9725 |
| 0.0433 | 90.0 | 18000 | 1.1713 | 47.0768 | 36.7887 | 44.1503 | 44.6221 | 18.9725 |
| 0.0433 | 91.0 | 18200 | 1.1760 | 47.2611 | 36.91 | 44.3145 | 44.7267 | 18.9725 |
| 0.0433 | 92.0 | 18400 | 1.1742 | 47.1569 | 36.8205 | 44.1965 | 44.6291 | 18.9725 |
| 0.0429 | 93.0 | 18600 | 1.1802 | 47.1488 | 36.8472 | 44.2746 | 44.7273 | 18.9725 |
| 0.0429 | 94.0 | 18800 | 1.1776 | 47.1428 | 36.8405 | 44.2248 | 44.677 | 18.9725 |
| 0.0406 | 95.0 | 19000 | 1.1787 | 47.2424 | 37.0243 | 44.3605 | 44.8277 | 18.9725 |
| 0.0406 | 96.0 | 19200 | 1.1888 | 46.9867 | 36.8466 | 44.138 | 44.6028 | 18.9725 |
| 0.0406 | 97.0 | 19400 | 1.1842 | 47.221 | 36.9451 | 44.3828 | 44.8279 | 18.9725 |
| 0.0402 | 98.0 | 19600 | 1.1931 | 47.3532 | 36.9798 | 44.4183 | 44.8908 | 18.9725 |
| 0.0402 | 99.0 | 19800 | 1.1910 | 47.3024 | 37.0443 | 44.4254 | 44.8128 | 18.9725 |
| 0.0379 | 100.0 | 20000 | 1.1866 | 47.0876 | 36.7997 | 44.2002 | 44.5963 | 18.9725 |
| 0.0379 | 101.0 | 20200 | 1.1954 | 47.3442 | 36.8921 | 44.5062 | 44.9326 | 18.9725 |
| 0.0379 | 102.0 | 20400 | 1.1932 | 47.3439 | 36.9949 | 44.4978 | 44.9289 | 18.9725 |
| 0.0371 | 103.0 | 20600 | 1.1995 | 47.4909 | 37.1924 | 44.627 | 44.9876 | 18.9725 |
| 0.0371 | 104.0 | 20800 | 1.1873 | 47.3608 | 37.1436 | 44.5186 | 44.8913 | 18.9725 |
| 0.0371 | 105.0 | 21000 | 1.2004 | 47.2225 | 36.947 | 44.2986 | 44.7392 | 18.9725 |
| 0.0371 | 106.0 | 21200 | 1.2038 | 47.3322 | 37.1391 | 44.4508 | 44.8944 | 18.9725 |
| 0.0371 | 107.0 | 21400 | 1.2032 | 47.4927 | 37.2393 | 44.5274 | 44.9546 | 18.9725 |
| 0.0351 | 108.0 | 21600 | 1.2088 | 47.1914 | 36.9084 | 44.2846 | 44.6942 | 18.9725 |
| 0.0351 | 109.0 | 21800 | 1.2055 | 47.1807 | 37.0308 | 44.2609 | 44.6812 | 18.9725 |
| 0.0342 | 110.0 | 22000 | 1.2033 | 47.3249 | 37.188 | 44.4933 | 44.9173 | 18.9725 |
| 0.0342 | 111.0 | 22200 | 1.2109 | 47.3209 | 37.2169 | 44.43 | 44.8419 | 18.9725 |
| 0.0342 | 112.0 | 22400 | 1.2112 | 47.2884 | 37.0231 | 44.4526 | 44.8678 | 18.9725 |
| 0.0339 | 113.0 | 22600 | 1.2122 | 47.4514 | 37.1338 | 44.5042 | 44.9023 | 18.9725 |
| 0.0339 | 114.0 | 22800 | 1.2133 | 47.4942 | 37.2246 | 44.6414 | 45.0367 | 18.9725 |
| 0.0319 | 115.0 | 23000 | 1.2188 | 47.3496 | 37.07 | 44.4763 | 44.8769 | 18.9725 |
| 0.0319 | 116.0 | 23200 | 1.2196 | 47.3476 | 37.0494 | 44.4154 | 44.8526 | 18.9725 |
| 0.0319 | 117.0 | 23400 | 1.2184 | 47.3939 | 37.0739 | 44.4843 | 44.8791 | 18.9725 |
| 0.0318 | 118.0 | 23600 | 1.2153 | 47.297 | 37.1253 | 44.4336 | 44.8667 | 18.9725 |
| 0.0318 | 119.0 | 23800 | 1.2204 | 47.2655 | 37.0161 | 44.315 | 44.7425 | 18.9725 |
| 0.031 | 120.0 | 24000 | 1.2300 | 47.1659 | 36.9164 | 44.2885 | 44.6854 | 18.9725 |
| 0.031 | 121.0 | 24200 | 1.2244 | 47.2323 | 37.0646 | 44.3231 | 44.7741 | 18.9725 |
| 0.031 | 122.0 | 24400 | 1.2246 | 47.2887 | 37.1099 | 44.4102 | 44.8013 | 18.9725 |
| 0.0314 | 123.0 | 24600 | 1.2227 | 47.2844 | 37.1004 | 44.477 | 44.8791 | 18.9725 |
| 0.0314 | 124.0 | 24800 | 1.2261 | 47.4595 | 37.182 | 44.525 | 44.9282 | 18.9725 |
| 0.0299 | 125.0 | 25000 | 1.2250 | 47.4474 | 37.1837 | 44.4691 | 44.8932 | 18.9725 |
| 0.0299 | 126.0 | 25200 | 1.2270 | 47.3974 | 37.1118 | 44.4632 | 44.8601 | 18.9725 |
| 0.0299 | 127.0 | 25400 | 1.2268 | 47.4627 | 37.1918 | 44.5778 | 45.0057 | 18.9725 |
| 0.0304 | 128.0 | 25600 | 1.2300 | 47.5374 | 37.3058 | 44.5345 | 44.9816 | 18.9725 |
| 0.0304 | 129.0 | 25800 | 1.2320 | 47.5205 | 37.2863 | 44.5928 | 44.9842 | 18.9725 |
| 0.0283 | 130.0 | 26000 | 1.2337 | 47.3531 | 37.2235 | 44.538 | 44.9476 | 18.9725 |
| 0.0283 | 131.0 | 26200 | 1.2374 | 47.3214 | 37.0934 | 44.5008 | 44.897 | 18.9725 |
| 0.0283 | 132.0 | 26400 | 1.2372 | 47.3673 | 37.0916 | 44.4828 | 44.9017 | 18.9725 |
| 0.0292 | 133.0 | 26600 | 1.2376 | 47.3677 | 37.065 | 44.4243 | 44.8378 | 18.9725 |
| 0.0292 | 134.0 | 26800 | 1.2361 | 47.3707 | 37.1482 | 44.4561 | 44.8555 | 18.9725 |
| 0.0277 | 135.0 | 27000 | 1.2375 | 47.1611 | 37.016 | 44.2671 | 44.7125 | 18.9725 |
| 0.0277 | 136.0 | 27200 | 1.2408 | 47.2849 | 37.0969 | 44.4603 | 44.8522 | 18.9725 |
| 0.0277 | 137.0 | 27400 | 1.2387 | 47.3732 | 37.1009 | 44.4399 | 44.8788 | 18.9725 |
| 0.0287 | 138.0 | 27600 | 1.2379 | 47.3887 | 37.1236 | 44.4965 | 44.946 | 18.9725 |
| 0.0287 | 139.0 | 27800 | 1.2413 | 47.2686 | 37.0526 | 44.4412 | 44.8908 | 18.9725 |
| 0.0275 | 140.0 | 28000 | 1.2436 | 47.1805 | 36.9982 | 44.2954 | 44.7762 | 18.9725 |
| 0.0275 | 141.0 | 28200 | 1.2419 | 47.3737 | 37.1899 | 44.5507 | 45.0069 | 18.9725 |
| 0.0275 | 142.0 | 28400 | 1.2420 | 47.3535 | 37.1088 | 44.4099 | 44.8821 | 18.9725 |
| 0.0275 | 143.0 | 28600 | 1.2417 | 47.3146 | 37.0719 | 44.3936 | 44.8605 | 18.9725 |
| 0.0275 | 144.0 | 28800 | 1.2416 | 47.2858 | 37.0775 | 44.4035 | 44.8692 | 18.9725 |
| 0.0277 | 145.0 | 29000 | 1.2418 | 47.3574 | 37.1278 | 44.4706 | 44.9182 | 18.9725 |
| 0.0277 | 146.0 | 29200 | 1.2423 | 47.4899 | 37.2542 | 44.5283 | 44.9664 | 18.9725 |
| 0.0277 | 147.0 | 29400 | 1.2426 | 47.3521 | 37.1389 | 44.434 | 44.8793 | 18.9725 |
| 0.0276 | 148.0 | 29600 | 1.2428 | 47.3361 | 37.1177 | 44.4202 | 44.8607 | 18.9725 |
| 0.0276 | 149.0 | 29800 | 1.2431 | 47.3633 | 37.1581 | 44.4518 | 44.8961 | 18.9725 |
| 0.0272 | 150.0 | 30000 | 1.2433 | 47.379 | 37.1581 | 44.4701 | 44.9076 | 18.9725 |
Framework versions
- Transformers 4.38.1
- Pytorch 2.1.2
- Datasets 2.1.0
- Tokenizers 0.15.2