lewtun HF staff commited on
Commit
565d930
1 Parent(s): 8f4812c

Add evaluation results on the 3.0.0 config of cnn_dailymail

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@sysresearch101

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-cnn_dailymail-3ca4a8a7-12855711).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -75,6 +75,39 @@ model-index:
75
  type: gen_len
76
  value: 18.7755
77
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
78
  ---
79
 
80
  # T5-large Summarization Model Trained on the XSUM Dataset
 
75
  type: gen_len
76
  value: 18.7755
77
  verified: true
78
+ - task:
79
+ type: summarization
80
+ name: Summarization
81
+ dataset:
82
+ name: cnn_dailymail
83
+ type: cnn_dailymail
84
+ config: 3.0.0
85
+ split: train
86
+ metrics:
87
+ - name: ROUGE-1
88
+ type: rouge
89
+ value: 17.7078
90
+ verified: true
91
+ - name: ROUGE-2
92
+ type: rouge
93
+ value: 3.3446
94
+ verified: true
95
+ - name: ROUGE-L
96
+ type: rouge
97
+ value: 12.8664
98
+ verified: true
99
+ - name: ROUGE-LSUM
100
+ type: rouge
101
+ value: 15.6724
102
+ verified: true
103
+ - name: loss
104
+ type: loss
105
+ value: 3.786738157272339
106
+ verified: true
107
+ - name: gen_len
108
+ type: gen_len
109
+ value: 18.8385
110
+ verified: true
111
  ---
112
 
113
  # T5-large Summarization Model Trained on the XSUM Dataset