Add evaluation results on the plain_text config and test split of launch/gov_report
Browse filesBeep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config and test split of the [launch/gov_report](https://huggingface.co/datasets/launch/gov_report) dataset by @nonchalant-nagavalli, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-launch__gov_report-plain_text-2fa37c-16136227).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=launch/gov_report).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=launch/gov_report).
README.md
CHANGED
@@ -417,6 +417,39 @@ model-index:
|
|
417 |
type: gen_len
|
418 |
value: 64.1807
|
419 |
verified: true
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
420 |
---
|
421 |
|
422 |
# README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
|
|
|
417 |
type: gen_len
|
418 |
value: 64.1807
|
419 |
verified: true
|
420 |
+
- task:
|
421 |
+
type: summarization
|
422 |
+
name: Summarization
|
423 |
+
dataset:
|
424 |
+
name: launch/gov_report
|
425 |
+
type: launch/gov_report
|
426 |
+
config: plain_text
|
427 |
+
split: test
|
428 |
+
metrics:
|
429 |
+
- name: ROUGE-1
|
430 |
+
type: rouge
|
431 |
+
value: 23.7438
|
432 |
+
verified: true
|
433 |
+
- name: ROUGE-2
|
434 |
+
type: rouge
|
435 |
+
value: 5.501
|
436 |
+
verified: true
|
437 |
+
- name: ROUGE-L
|
438 |
+
type: rouge
|
439 |
+
value: 13.8132
|
440 |
+
verified: true
|
441 |
+
- name: ROUGE-LSUM
|
442 |
+
type: rouge
|
443 |
+
value: 20.4615
|
444 |
+
verified: true
|
445 |
+
- name: loss
|
446 |
+
type: loss
|
447 |
+
value: 2.6383883953094482
|
448 |
+
verified: true
|
449 |
+
- name: gen_len
|
450 |
+
type: gen_len
|
451 |
+
value: 64.9085
|
452 |
+
verified: true
|
453 |
---
|
454 |
|
455 |
# README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
|