Update README.md
Browse files
README.md
CHANGED
@@ -17,6 +17,23 @@ ramonda-monarch-7b is a merge of the following models using [LazyMergekit](https
|
|
17 |
* [liminerity/Omningotex-7b-slerp](https://huggingface.co/liminerity/Omningotex-7b-slerp)
|
18 |
* [yleo/OgnoMonarch-7B](https://huggingface.co/yleo/OgnoMonarch-7B)
|
19 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
20 |
## 🧩 Configuration
|
21 |
|
22 |
```yaml
|
|
|
17 |
* [liminerity/Omningotex-7b-slerp](https://huggingface.co/liminerity/Omningotex-7b-slerp)
|
18 |
* [yleo/OgnoMonarch-7B](https://huggingface.co/yleo/OgnoMonarch-7B)
|
19 |
|
20 |
+
# 🏆 Benchmarks
|
21 |
+
|
22 |
+
### Open LLM Leaderboard
|
23 |
+
| Model | Average | ARC_easy | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K | ARC_challenge |
|
24 |
+
|------------------------|--------:|-----:|----------:|-----:|-----------:|-----------:|------:|--------:|
|
25 |
+
| mayacinka/ramonda-monarch-7b | / | 86.91 | 87.45 | 61.97 | / | 81.61 | /| 68.26 |
|
26 |
+
|
27 |
+
### MMLU
|
28 |
+
| Groups |Version|Filter|n-shot|Metric|Value | |Stderr|
|
29 |
+
|------------------|-------|------|------|------|-----:|---|-----:|
|
30 |
+
|mmlu |N/A |none | 0|acc |0.6197|± |0.0039|
|
31 |
+
| - humanities |N/A |none |None |acc |0.5762|± |0.0067|
|
32 |
+
| - other |N/A |none |None |acc |0.6936|± |0.0080|
|
33 |
+
| - social_sciences|N/A |none |None |acc |0.7192|± |0.0079|
|
34 |
+
| - stem |N/A |none |None |acc |0.5147|± |0.0085|
|
35 |
+
|
36 |
+
|
37 |
## 🧩 Configuration
|
38 |
|
39 |
```yaml
|