uukuguy leaderboard-pr-bot commited on
Commit
b1de043
1 Parent(s): d4260b7

Adding Evaluation Results (#1)

Browse files

- Adding Evaluation Results (5acf6ad83b897b1019745b6ea60a207eed00ba79)


Co-authored-by: Open LLM Leaderboard PR Bot <[email protected]>

Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -110,3 +110,17 @@ Mistral 7B is a pretrained base model and therefore does not have any moderation
110
  ## The Mistral AI Team
111
 
112
  Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.`
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
110
  ## The Mistral AI Team
111
 
112
  Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.`
113
+
114
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
115
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_uukuguy__speechless-mistral-dolphin-orca-platypus-samantha-7b)
116
+
117
+ | Metric | Value |
118
+ |-----------------------|---------------------------|
119
+ | Avg. | 53.34 |
120
+ | ARC (25-shot) | 64.33 |
121
+ | HellaSwag (10-shot) | 84.4 |
122
+ | MMLU (5-shot) | 63.72 |
123
+ | TruthfulQA (0-shot) | 52.52 |
124
+ | Winogrande (5-shot) | 78.37 |
125
+ | GSM8K (5-shot) | 21.38 |
126
+ | DROP (3-shot) | 8.66 |