pszemraj autoevaluator HF staff commited on
Commit
b3657ae
1 Parent(s): be91696

Add evaluation results on the kmfoda--booksum config of kmfoda/booksum (#4)

Browse files

- Add evaluation results on the kmfoda--booksum config of kmfoda/booksum (d1011b19b6cfee89bc84010b04ffd9d078649326)


Co-authored-by: Evaluation Bot <[email protected]>

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -242,6 +242,39 @@ model-index:
242
  type: gen_len
243
  value: 81.4964
244
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
245
  ---
246
 
247
  # long-t5-tglobal-base-16384 + BookSum
 
242
  type: gen_len
243
  value: 81.4964
244
  verified: true
245
+ - task:
246
+ type: summarization
247
+ name: Summarization
248
+ dataset:
249
+ name: kmfoda/booksum
250
+ type: kmfoda/booksum
251
+ config: kmfoda--booksum
252
+ split: test
253
+ metrics:
254
+ - name: ROUGE-1
255
+ type: rouge
256
+ value: 36.2047
257
+ verified: true
258
+ - name: ROUGE-2
259
+ type: rouge
260
+ value: 6.0472
261
+ verified: true
262
+ - name: ROUGE-L
263
+ type: rouge
264
+ value: 16.616
265
+ verified: true
266
+ - name: ROUGE-LSUM
267
+ type: rouge
268
+ value: 33.172
269
+ verified: true
270
+ - name: loss
271
+ type: loss
272
+ value: .nan
273
+ verified: true
274
+ - name: gen_len
275
+ type: gen_len
276
+ value: 248.7994
277
+ verified: true
278
  ---
279
 
280
  # long-t5-tglobal-base-16384 + BookSum