Commit
•
4b12bce
1
Parent(s):
a4b5e57
Add evaluation results on the plain_text config and test split of launch/gov_report (#11)
Browse files- Add evaluation results on the plain_text config and test split of launch/gov_report (79fa43bcc04d70abcc04427f3af02e401bc6ee92)
Co-authored-by: Evaluation Bot <[email protected]>
README.md
CHANGED
@@ -416,6 +416,39 @@ model-index:
|
|
416 |
type: gen_len
|
417 |
value: 220.3747
|
418 |
verified: true
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
419 |
---
|
420 |
|
421 |
# long-t5-tglobal-base-16384 + BookSum
|
|
|
416 |
type: gen_len
|
417 |
value: 220.3747
|
418 |
verified: true
|
419 |
+
- task:
|
420 |
+
type: summarization
|
421 |
+
name: Summarization
|
422 |
+
dataset:
|
423 |
+
name: launch/gov_report
|
424 |
+
type: launch/gov_report
|
425 |
+
config: plain_text
|
426 |
+
split: test
|
427 |
+
metrics:
|
428 |
+
- name: ROUGE-1
|
429 |
+
type: rouge
|
430 |
+
value: 37.4438
|
431 |
+
verified: true
|
432 |
+
- name: ROUGE-2
|
433 |
+
type: rouge
|
434 |
+
value: 8.2907
|
435 |
+
verified: true
|
436 |
+
- name: ROUGE-L
|
437 |
+
type: rouge
|
438 |
+
value: 17.6893
|
439 |
+
verified: true
|
440 |
+
- name: ROUGE-LSUM
|
441 |
+
type: rouge
|
442 |
+
value: 33.7141
|
443 |
+
verified: true
|
444 |
+
- name: loss
|
445 |
+
type: loss
|
446 |
+
value: 2.5776000022888184
|
447 |
+
verified: true
|
448 |
+
- name: gen_len
|
449 |
+
type: gen_len
|
450 |
+
value: 214.9692
|
451 |
+
verified: true
|
452 |
---
|
453 |
|
454 |
# long-t5-tglobal-base-16384 + BookSum
|