pszemraj autoevaluator HF staff commited on
Commit
50e43a7
1 Parent(s): 8f402ca

Add evaluation results on the y config and test split of big_patent (#9)

Browse files

- Add evaluation results on the y config and test split of big_patent (79a024d2a00751e55c226adc400492cbbbb8cd83)


Co-authored-by: Evaluation Bot <[email protected]>

Files changed (1) hide show
  1. README.md +34 -1
README.md CHANGED
@@ -5,7 +5,7 @@ tags:
5
  - booksum
6
  - long-document
7
  - long-form
8
- license:
9
  - apache-2.0
10
  - bsd-3-clause
11
  datasets:
@@ -350,6 +350,39 @@ model-index:
350
  type: gen_len
351
  value: 162.3588
352
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
353
  ---
354
 
355
  # long-t5-tglobal-base-16384 + BookSum
 
5
  - booksum
6
  - long-document
7
  - long-form
8
+ license:
9
  - apache-2.0
10
  - bsd-3-clause
11
  datasets:
 
350
  type: gen_len
351
  value: 162.3588
352
  verified: true
353
+ - task:
354
+ type: summarization
355
+ name: Summarization
356
+ dataset:
357
+ name: big_patent
358
+ type: big_patent
359
+ config: y
360
+ split: test
361
+ metrics:
362
+ - name: ROUGE-1
363
+ type: rouge
364
+ value: 34.7641
365
+ verified: true
366
+ - name: ROUGE-2
367
+ type: rouge
368
+ value: 7.8744
369
+ verified: true
370
+ - name: ROUGE-L
371
+ type: rouge
372
+ value: 19.9826
373
+ verified: true
374
+ - name: ROUGE-LSUM
375
+ type: rouge
376
+ value: 29.208
377
+ verified: true
378
+ - name: loss
379
+ type: loss
380
+ value: 2.8316469192504883
381
+ verified: true
382
+ - name: gen_len
383
+ type: gen_len
384
+ value: 132.7475
385
+ verified: true
386
  ---
387
 
388
  # long-t5-tglobal-base-16384 + BookSum