Add evaluation results on the plain_text config and test split of launch/gov_report
Browse filesBeep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config and test split of the [launch/gov_report](https://huggingface.co/datasets/launch/gov_report) dataset by @nonchalant-nagavalli, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-launch__gov_report-plain_text-2fa37c-16136223).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=launch/gov_report).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=launch/gov_report).
README.md
CHANGED
@@ -416,6 +416,39 @@ model-index:
|
|
416 |
type: gen_len
|
417 |
value: 220.3747
|
418 |
verified: true
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
419 |
---
|
420 |
|
421 |
# long-t5-tglobal-base-16384 + BookSum
|
|
|
416 |
type: gen_len
|
417 |
value: 220.3747
|
418 |
verified: true
|
419 |
+
- task:
|
420 |
+
type: summarization
|
421 |
+
name: Summarization
|
422 |
+
dataset:
|
423 |
+
name: launch/gov_report
|
424 |
+
type: launch/gov_report
|
425 |
+
config: plain_text
|
426 |
+
split: test
|
427 |
+
metrics:
|
428 |
+
- name: ROUGE-1
|
429 |
+
type: rouge
|
430 |
+
value: 37.4438
|
431 |
+
verified: true
|
432 |
+
- name: ROUGE-2
|
433 |
+
type: rouge
|
434 |
+
value: 8.2907
|
435 |
+
verified: true
|
436 |
+
- name: ROUGE-L
|
437 |
+
type: rouge
|
438 |
+
value: 17.6893
|
439 |
+
verified: true
|
440 |
+
- name: ROUGE-LSUM
|
441 |
+
type: rouge
|
442 |
+
value: 33.7141
|
443 |
+
verified: true
|
444 |
+
- name: loss
|
445 |
+
type: loss
|
446 |
+
value: 2.5776000022888184
|
447 |
+
verified: true
|
448 |
+
- name: gen_len
|
449 |
+
type: gen_len
|
450 |
+
value: 214.9692
|
451 |
+
verified: true
|
452 |
---
|
453 |
|
454 |
# long-t5-tglobal-base-16384 + BookSum
|