pszemraj autoevaluator HF staff commited on
Commit
d07f228
1 Parent(s): 1561c72

Add evaluation results on the y config and test split of big_patent (#6)

Browse files

- Add evaluation results on the y config and test split of big_patent (28df7857ae6da33f486feeb7c80d22353c6ceeb7)


Co-authored-by: Evaluation Bot <[email protected]>

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -351,6 +351,39 @@ model-index:
351
  type: gen_len
352
  value: 48.5987
353
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
354
  ---
355
 
356
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
 
351
  type: gen_len
352
  value: 48.5987
353
  verified: true
354
+ - task:
355
+ type: summarization
356
+ name: Summarization
357
+ dataset:
358
+ name: big_patent
359
+ type: big_patent
360
+ config: y
361
+ split: test
362
+ metrics:
363
+ - name: ROUGE-1
364
+ type: rouge
365
+ value: 34.7848
366
+ verified: true
367
+ - name: ROUGE-2
368
+ type: rouge
369
+ value: 9.7549
370
+ verified: true
371
+ - name: ROUGE-L
372
+ type: rouge
373
+ value: 22.228
374
+ verified: true
375
+ - name: ROUGE-LSUM
376
+ type: rouge
377
+ value: 28.0389
378
+ verified: true
379
+ - name: loss
380
+ type: loss
381
+ value: 1.7787292003631592
382
+ verified: true
383
+ - name: gen_len
384
+ type: gen_len
385
+ value: 71.6372
386
+ verified: true
387
  ---
388
 
389
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2