lewtun HF staff commited on
Commit
28df785
1 Parent(s): 1561c72

Add evaluation results on the y config and test split of big_patent

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the y config and test split of the [big_patent](https://huggingface.co/datasets/big_patent) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-big_patent-y-7d0862-15806177).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=big_patent).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=big_patent).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -351,6 +351,39 @@ model-index:
351
  type: gen_len
352
  value: 48.5987
353
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
354
  ---
355
 
356
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
 
351
  type: gen_len
352
  value: 48.5987
353
  verified: true
354
+ - task:
355
+ type: summarization
356
+ name: Summarization
357
+ dataset:
358
+ name: big_patent
359
+ type: big_patent
360
+ config: y
361
+ split: test
362
+ metrics:
363
+ - name: ROUGE-1
364
+ type: rouge
365
+ value: 34.7848
366
+ verified: true
367
+ - name: ROUGE-2
368
+ type: rouge
369
+ value: 9.7549
370
+ verified: true
371
+ - name: ROUGE-L
372
+ type: rouge
373
+ value: 22.228
374
+ verified: true
375
+ - name: ROUGE-LSUM
376
+ type: rouge
377
+ value: 28.0389
378
+ verified: true
379
+ - name: loss
380
+ type: loss
381
+ value: 1.7787292003631592
382
+ verified: true
383
+ - name: gen_len
384
+ type: gen_len
385
+ value: 71.6372
386
+ verified: true
387
  ---
388
 
389
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2