autoevaluator HF staff commited on
Commit
319c277
1 Parent(s): 5373dc3

Add evaluation results on the samsum config and test split of samsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the samsum config and test split of the [samsum](https://huggingface.co/datasets/samsum) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-samsum-samsum-417ba9-2386774735).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +34 -1
README.md CHANGED
@@ -7,7 +7,40 @@ metrics:
7
  - rouge
8
  model-index:
9
  - name: summarization_mlsum
10
- results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  datasets:
12
  - ARTeLab/mlsum-it
13
  ---
 
7
  - rouge
8
  model-index:
9
  - name: summarization_mlsum
10
+ results:
11
+ - task:
12
+ type: summarization
13
+ name: Summarization
14
+ dataset:
15
+ name: samsum
16
+ type: samsum
17
+ config: samsum
18
+ split: test
19
+ metrics:
20
+ - name: ROUGE-1
21
+ type: rouge
22
+ value: 14.0255
23
+ verified: true
24
+ - name: ROUGE-2
25
+ type: rouge
26
+ value: 3.2328
27
+ verified: true
28
+ - name: ROUGE-L
29
+ type: rouge
30
+ value: 12.2979
31
+ verified: true
32
+ - name: ROUGE-LSUM
33
+ type: rouge
34
+ value: 13.1072
35
+ verified: true
36
+ - name: loss
37
+ type: loss
38
+ value: 2.0128023624420166
39
+ verified: true
40
+ - name: gen_len
41
+ type: gen_len
42
+ value: 18.9939
43
+ verified: true
44
  datasets:
45
  - ARTeLab/mlsum-it
46
  ---