lewtun HF staff commited on
Commit
87bff21
1 Parent(s): 4913950

Add evaluation results on the plain_text config and test split of launch/gov_report

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config and test split of the [launch/gov_report](https://huggingface.co/datasets/launch/gov_report) dataset by @nonchalant-nagavalli, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-launch__gov_report-plain_text-2fa37c-16136227).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=launch/gov_report).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=launch/gov_report).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -417,6 +417,39 @@ model-index:
417
  type: gen_len
418
  value: 64.1807
419
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
420
  ---
421
 
422
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
 
417
  type: gen_len
418
  value: 64.1807
419
  verified: true
420
+ - task:
421
+ type: summarization
422
+ name: Summarization
423
+ dataset:
424
+ name: launch/gov_report
425
+ type: launch/gov_report
426
+ config: plain_text
427
+ split: test
428
+ metrics:
429
+ - name: ROUGE-1
430
+ type: rouge
431
+ value: 23.7438
432
+ verified: true
433
+ - name: ROUGE-2
434
+ type: rouge
435
+ value: 5.501
436
+ verified: true
437
+ - name: ROUGE-L
438
+ type: rouge
439
+ value: 13.8132
440
+ verified: true
441
+ - name: ROUGE-LSUM
442
+ type: rouge
443
+ value: 20.4615
444
+ verified: true
445
+ - name: loss
446
+ type: loss
447
+ value: 2.6383883953094482
448
+ verified: true
449
+ - name: gen_len
450
+ type: gen_len
451
+ value: 64.9085
452
+ verified: true
453
  ---
454
 
455
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2