autoevaluator HF staff commited on
Commit
7c130d0
1 Parent(s): c474ac4

Add evaluation results on the 3.0.0 config and test split of cnn_dailymail

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the 3.0.0 config and test split of the [cnn_dailymail](https://huggingface.co/datasets/cnn_dailymail) dataset by

@https

://huggingface.co/Sini, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-cnn_dailymail-3.0.0-e26065-64936145531).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=cnn_dailymail).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=cnn_dailymail).

Files changed (1) hide show
  1. README.md +44 -2
README.md CHANGED
@@ -1,10 +1,52 @@
1
  ---
2
  language: en
3
  license: apache-2.0
4
- datasets:
5
- - cnn_dailymail
6
  tags:
7
  - summarization
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
 
10
  # Roberta2Roberta_L-24_cnn_daily_mail EncoderDecoder model
 
1
  ---
2
  language: en
3
  license: apache-2.0
 
 
4
  tags:
5
  - summarization
6
+ datasets:
7
+ - cnn_dailymail
8
+ model-index:
9
+ - name: google/roberta2roberta_L-24_cnn_daily_mail
10
+ results:
11
+ - task:
12
+ type: summarization
13
+ name: Summarization
14
+ dataset:
15
+ name: cnn_dailymail
16
+ type: cnn_dailymail
17
+ config: 3.0.0
18
+ split: test
19
+ metrics:
20
+ - type: rouge
21
+ value: 39.9291
22
+ name: ROUGE-1
23
+ verified: true
24
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjY4MDQ5Y2FlODI4MWQ5ZjI1ZTBhYTI2YmYzOWZhYWQ0OGUzNWMwM2I0Mzg4NzhlM2ViZjIwMDg5YjQ2MzkwMCIsInZlcnNpb24iOjF9.IsWXyAwnkjkqh5RigKVhkjuMS9v-E3_cKQpwi6zAvNAVTk9yOnnybPlHqTU7vQjUv3_PhcHN1heVmVv_pUwoAw
25
+ - type: rouge
26
+ value: 18.4707
27
+ name: ROUGE-2
28
+ verified: true
29
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZWE0NzhhMmQxMWFmN2QwZWY2ZjdiMWQ4MmVmNTg5NzNlZGJhYjU5YTJlOTk5Nzc1OWIzOTUxODEwNzg5Mzk3NCIsInZlcnNpb24iOjF9.G9wU_BHvnk12ZUvqHAK7w1OQJS2Xbewj8wxo8d4IT4XM11KlETd-RewotGPvQCwudCtxijk81Rrlmp5_TqkAAg
30
+ - type: rouge
31
+ value: 28.8109
32
+ name: ROUGE-L
33
+ verified: true
34
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTNkZmJiYjU3N2U4NTRjZmExNGM4ZDE5YjA5NmMxYTgzMmFkNzMwN2IwOWIwYjgzOTdiNWEwYzdlYjI0MWNiNCIsInZlcnNpb24iOjF9.8_LAyFq9TEYHXuBYrMt4AHVzJyGoJf3oYHZHYwpdclASfp6RqXoOX_78JbWFVyhybjBzTvx7EwcdbJDsedu2CA
35
+ - type: rouge
36
+ value: 31.669
37
+ name: ROUGE-LSUM
38
+ verified: true
39
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMjc4YmMyODM3ODFmYTI3NzE3Y2ExNjBkNGI1MzFkYmU4MjQ3M2JkYTc0YTBlY2NhYzY1YzFjNTE3OWQwMzY4NiIsInZlcnNpb24iOjF9.M3JqWkQR3nK5WP6g2y7ZJHEi5YyFZIQm8lDEyHn5eoHcV_mx88i3QvV3kq7_Fpa0Z3gJgWwDwpFGfe-g1L5aCw
40
+ - type: loss
41
+ value: 3.880310297012329
42
+ name: loss
43
+ verified: true
44
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYThmYjU5ZTU0ZGRiNDNhYmJmNTJmZDljYzEwNjRjOTlhNWExMTRhNTQ0NmE1MGNiYWQxYmNiMTAwNTkyM2NiMCIsInZlcnNpb24iOjF9.AOBeynJktEwdcRpMI5su6h0MdtcLSz2W6KAugnRR11-2MLfMDshVssBEKKAOrSi5YDVXnhJ3KIdf2XcJ_u1bAg
45
+ - type: gen_len
46
+ value: 67.699
47
+ name: gen_len
48
+ verified: true
49
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjhhOGJjOGM1NTBjNzBmMWQ4YWYzNDZlYzBhMWI4YzUxNTJhMjdlMTljYjRiYzFhMzc0Nzc5NmVhZjk3YWRkZiIsInZlcnNpb24iOjF9.KuOC2SeCEi5DhO6KSlRyYGCJJ4iJVoRkhRdy3zT-GR8v4HEvXk4KLt1_LPDjw-bjZlbPXduHkdcJIJUWLOuTCg
50
  ---
51
 
52
  # Roberta2Roberta_L-24_cnn_daily_mail EncoderDecoder model