Commit
•
a96b712
1
Parent(s):
f537e10
Adding Evaluation Results
Browse filesThis is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr
The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.
If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions
README.md
CHANGED
|
@@ -225,4 +225,17 @@ GGUF Quants: https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B-GGUF
|
|
| 225 |
title={Hermes-3-Llama-3.1-8B},
|
| 226 |
author={"Teknium", "theemozilla", "Chen Guang", "interstellarninja", "karan4d", "huemin_art"}
|
| 227 |
}
|
| 228 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 225 |
title={Hermes-3-Llama-3.1-8B},
|
| 226 |
author={"Teknium", "theemozilla", "Chen Guang", "interstellarninja", "karan4d", "huemin_art"}
|
| 227 |
}
|
| 228 |
+
```
|
| 229 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
|
| 230 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_NousResearch__Hermes-3-Llama-3.1-8B)
|
| 231 |
+
|
| 232 |
+
| Metric |Value|
|
| 233 |
+
|-------------------|----:|
|
| 234 |
+
|Avg. |20.28|
|
| 235 |
+
|IFEval (0-Shot) |34.88|
|
| 236 |
+
|BBH (3-Shot) |32.88|
|
| 237 |
+
|MATH Lvl 5 (4-Shot)| 7.10|
|
| 238 |
+
|GPQA (0-shot) | 8.28|
|
| 239 |
+
|MuSR (0-shot) |13.92|
|
| 240 |
+
|MMLU-PRO (5-shot) |24.60|
|
| 241 |
+
|