mayacinka commited on
Commit
bc50f3e
1 Parent(s): d36a01d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -17,6 +17,23 @@ ramonda-monarch-7b is a merge of the following models using [LazyMergekit](https
17
  * [liminerity/Omningotex-7b-slerp](https://huggingface.co/liminerity/Omningotex-7b-slerp)
18
  * [yleo/OgnoMonarch-7B](https://huggingface.co/yleo/OgnoMonarch-7B)
19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  ## 🧩 Configuration
21
 
22
  ```yaml
 
17
  * [liminerity/Omningotex-7b-slerp](https://huggingface.co/liminerity/Omningotex-7b-slerp)
18
  * [yleo/OgnoMonarch-7B](https://huggingface.co/yleo/OgnoMonarch-7B)
19
 
20
+ # 🏆 Benchmarks
21
+
22
+ ### Open LLM Leaderboard
23
+ | Model | Average | ARC_easy | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K | ARC_challenge |
24
+ |------------------------|--------:|-----:|----------:|-----:|-----------:|-----------:|------:|--------:|
25
+ | mayacinka/ramonda-monarch-7b | / | 86.91 | 87.45 | 61.97 | / | 81.61 | /| 68.26 |
26
+
27
+ ### MMLU
28
+ | Groups |Version|Filter|n-shot|Metric|Value | |Stderr|
29
+ |------------------|-------|------|------|------|-----:|---|-----:|
30
+ |mmlu |N/A |none | 0|acc |0.6197|± |0.0039|
31
+ | - humanities |N/A |none |None |acc |0.5762|± |0.0067|
32
+ | - other |N/A |none |None |acc |0.6936|± |0.0080|
33
+ | - social_sciences|N/A |none |None |acc |0.7192|± |0.0079|
34
+ | - stem |N/A |none |None |acc |0.5147|± |0.0085|
35
+
36
+
37
  ## 🧩 Configuration
38
 
39
  ```yaml