lewtun HF staff commited on
Commit
79fa43b
1 Parent(s): a4b5e57

Add evaluation results on the plain_text config and test split of launch/gov_report

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config and test split of the [launch/gov_report](https://huggingface.co/datasets/launch/gov_report) dataset by @nonchalant-nagavalli, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-launch__gov_report-plain_text-2fa37c-16136223).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=launch/gov_report).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=launch/gov_report).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -416,6 +416,39 @@ model-index:
416
  type: gen_len
417
  value: 220.3747
418
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
419
  ---
420
 
421
  # long-t5-tglobal-base-16384 + BookSum
 
416
  type: gen_len
417
  value: 220.3747
418
  verified: true
419
+ - task:
420
+ type: summarization
421
+ name: Summarization
422
+ dataset:
423
+ name: launch/gov_report
424
+ type: launch/gov_report
425
+ config: plain_text
426
+ split: test
427
+ metrics:
428
+ - name: ROUGE-1
429
+ type: rouge
430
+ value: 37.4438
431
+ verified: true
432
+ - name: ROUGE-2
433
+ type: rouge
434
+ value: 8.2907
435
+ verified: true
436
+ - name: ROUGE-L
437
+ type: rouge
438
+ value: 17.6893
439
+ verified: true
440
+ - name: ROUGE-LSUM
441
+ type: rouge
442
+ value: 33.7141
443
+ verified: true
444
+ - name: loss
445
+ type: loss
446
+ value: 2.5776000022888184
447
+ verified: true
448
+ - name: gen_len
449
+ type: gen_len
450
+ value: 214.9692
451
+ verified: true
452
  ---
453
 
454
  # long-t5-tglobal-base-16384 + BookSum