lewtun HF staff commited on
Commit
79a024d
1 Parent(s): 8f402ca

Add evaluation results on the y config and test split of big_patent

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the y config and test split of the [big_patent](https://huggingface.co/datasets/big_patent) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-big_patent-y-7d0862-15806176).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=big_patent).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=big_patent).

Files changed (1) hide show
  1. README.md +34 -1
README.md CHANGED
@@ -5,7 +5,7 @@ tags:
5
  - booksum
6
  - long-document
7
  - long-form
8
- license:
9
  - apache-2.0
10
  - bsd-3-clause
11
  datasets:
@@ -350,6 +350,39 @@ model-index:
350
  type: gen_len
351
  value: 162.3588
352
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
353
  ---
354
 
355
  # long-t5-tglobal-base-16384 + BookSum
 
5
  - booksum
6
  - long-document
7
  - long-form
8
+ license:
9
  - apache-2.0
10
  - bsd-3-clause
11
  datasets:
 
350
  type: gen_len
351
  value: 162.3588
352
  verified: true
353
+ - task:
354
+ type: summarization
355
+ name: Summarization
356
+ dataset:
357
+ name: big_patent
358
+ type: big_patent
359
+ config: y
360
+ split: test
361
+ metrics:
362
+ - name: ROUGE-1
363
+ type: rouge
364
+ value: 34.7641
365
+ verified: true
366
+ - name: ROUGE-2
367
+ type: rouge
368
+ value: 7.8744
369
+ verified: true
370
+ - name: ROUGE-L
371
+ type: rouge
372
+ value: 19.9826
373
+ verified: true
374
+ - name: ROUGE-LSUM
375
+ type: rouge
376
+ value: 29.208
377
+ verified: true
378
+ - name: loss
379
+ type: loss
380
+ value: 2.8316469192504883
381
+ verified: true
382
+ - name: gen_len
383
+ type: gen_len
384
+ value: 132.7475
385
+ verified: true
386
  ---
387
 
388
  # long-t5-tglobal-base-16384 + BookSum