autoevaluator HF staff commited on
Commit
b055823
1 Parent(s): f0ee7a8

Add evaluation results on the samsum config and train split of samsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the samsum config and train split of the [samsum](https://huggingface.co/datasets/samsum) dataset by @samuelallen123, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-samsum-samsum-61187c-1532155205).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -71,6 +71,39 @@ model-index:
71
  type: gen_len
72
  value: 45.928
73
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
74
  ---
75
  Trained on Samsum train split.
76
 
 
71
  type: gen_len
72
  value: 45.928
73
  verified: true
74
+ - task:
75
+ type: summarization
76
+ name: Summarization
77
+ dataset:
78
+ name: samsum
79
+ type: samsum
80
+ config: samsum
81
+ split: train
82
+ metrics:
83
+ - name: ROUGE-1
84
+ type: rouge
85
+ value: 54.933
86
+ verified: true
87
+ - name: ROUGE-2
88
+ type: rouge
89
+ value: 31.7965
90
+ verified: true
91
+ - name: ROUGE-L
92
+ type: rouge
93
+ value: 47.0057
94
+ verified: true
95
+ - name: ROUGE-LSUM
96
+ type: rouge
97
+ value: 51.2027
98
+ verified: true
99
+ - name: loss
100
+ type: loss
101
+ value: 1.130684494972229
102
+ verified: true
103
+ - name: gen_len
104
+ type: gen_len
105
+ value: 23.7989
106
+ verified: true
107
  ---
108
  Trained on Samsum train split.
109