leaderboard-pr-bot commited on
Commit
5acf6ad
1 Parent(s): d4260b7

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -110,3 +110,17 @@ Mistral 7B is a pretrained base model and therefore does not have any moderation
110
  ## The Mistral AI Team
111
 
112
  Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.`
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
110
  ## The Mistral AI Team
111
 
112
  Albert Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, William El Sayed.`
113
+
114
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
115
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_uukuguy__speechless-mistral-dolphin-orca-platypus-samantha-7b)
116
+
117
+ | Metric | Value |
118
+ |-----------------------|---------------------------|
119
+ | Avg. | 53.34 |
120
+ | ARC (25-shot) | 64.33 |
121
+ | HellaSwag (10-shot) | 84.4 |
122
+ | MMLU (5-shot) | 63.72 |
123
+ | TruthfulQA (0-shot) | 52.52 |
124
+ | Winogrande (5-shot) | 78.37 |
125
+ | GSM8K (5-shot) | 21.38 |
126
+ | DROP (3-shot) | 8.66 |