autoevaluator HF staff commited on
Commit
3111a9b
1 Parent(s): 1d02f91

Add evaluation results on the default config and train split of medical_questions_pairs

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config and train split of the [medical_questions_pairs](https://huggingface.co/datasets/medical_questions_pairs) dataset by @halmj, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-medical_questions_pairs-default-d0c070-68078145610).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=medical_questions_pairs).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=medical_questions_pairs).

Files changed (1) hide show
  1. README.md +40 -1
README.md CHANGED
@@ -10,7 +10,46 @@ metrics:
10
  base_model: gsarti/it5-base
11
  model-index:
12
  - name: summarization_ilpost
13
- results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  ---
15
 
16
  # summarization_ilpost
 
10
  base_model: gsarti/it5-base
11
  model-index:
12
  - name: summarization_ilpost
13
+ results:
14
+ - task:
15
+ type: summarization
16
+ name: Summarization
17
+ dataset:
18
+ name: medical_questions_pairs
19
+ type: medical_questions_pairs
20
+ config: default
21
+ split: train
22
+ metrics:
23
+ - type: rouge
24
+ value: 12.5087
25
+ name: ROUGE-1
26
+ verified: true
27
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTk1NzM4NjEyYjlkOWQ3Yzk0NjNiNDYzZjIwNDZkYWFlYzJlNTA4ZThiNjEzYWQzZWVjYzVmNTYyNjlhMjgzOCIsInZlcnNpb24iOjF9.v6mtEtzUqnUfSBwZu-vXDJmuVGvj4IvSgUFjdWy1RX9ShaC0TtNZJ20W4zjrEZ26Xmk7uqC51hK5ya6kx11WDQ
28
+ - type: rouge
29
+ value: 3.6796
30
+ name: ROUGE-2
31
+ verified: true
32
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMWQ4YWRmZGVjZTk5YTdjYzZhNzNkZDBmOTRmMzVmODY4OGU4MjI5OTdmZGQ3MTRjNDBmYTBkMTE0MzQ4ZDQ5YSIsInZlcnNpb24iOjF9.Ux7-ReB2i0MLurwxzzOmIi6dGUCUeZNYXgnGX4f8MTVJBMeMFMRFsG3Im1j0-DnpIxuvXETc8J6eZ5PR_5nIAg
33
+ - type: rouge
34
+ value: 11.0954
35
+ name: ROUGE-L
36
+ verified: true
37
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjRkZTYyYjRhNTNlMThkZjI3ZmE3MmNlOTFiMmQ0MGRhMTE3ZWM5ODk1OWRkZThiYTFiNDg5MjE2ODVhM2QyNyIsInZlcnNpb24iOjF9.yucLivteb6CxBBMZ1gydBhiWPBzwL2Ga9OS37z0o0tuPSWHjbsZtoVTzrHuJcjH-kwnR_QNA1AWokSf9grs4BQ
38
+ - type: rouge
39
+ value: 11.5897
40
+ name: ROUGE-LSUM
41
+ verified: true
42
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDI4ZmYxOWQzOTcyNGIyMWM2NGU4MzM0ZWI1MjRkN2ExNzFmNDFlNzI4ZTI4M2NkYzY5MmQ4MDgxZjhjMDExMyIsInZlcnNpb24iOjF9.riA7X5EfOrBirLWMyOYS5UWReNAm1sjrAPihNuW4lx0IzKdafZ3bUJrH1QNojae5p_XP8AyU8yygZ7TQgN2gBw
43
+ - type: loss
44
+ value: 3.0159499645233154
45
+ name: loss
46
+ verified: true
47
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzhmYzJlMWYwYTM2OGFlNjQ2YjkxYWI1YzNkOTRjMjI0NGQ2ZTNhYjUzN2RhMDQxMjI1NWUyYjgwNTYzN2RkNiIsInZlcnNpb24iOjF9.I_CHEnSn61amBXNSOqBXSkGL09fvRv700bHyC41vNowaBUNtO5vOabRfhYi0IuPmsEI8eh_IEVrwNpbTgdtlAg
48
+ - type: gen_len
49
+ value: 18.9961
50
+ name: gen_len
51
+ verified: true
52
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOWU5NDBkZDMyNWJjN2NkYWEyNGZjOGY5MDQyOTVmN2I5MTVhMTk0N2I5YjIxZjI4YmY0MmRmZmU3YWIzMGRiYSIsInZlcnNpb24iOjF9.GC80tSpC8-wSuuzGc8wG9iDeSZ6CU1gdczoLiYEFdz-JfCrZa82UGr0EHXTzbaPKjb2Di1MyeH77hygu5BJpCQ
53
  ---
54
 
55
  # summarization_ilpost