Triangle104
commited on
Commit
•
ca6d424
1
Parent(s):
241b296
Update README.md
Browse files
README.md
CHANGED
@@ -109,6 +109,29 @@ model-index:
|
|
109 |
This model was converted to GGUF format from [`nbeerbower/Hermes2-Gutenberg2-Mistral-7B`](https://huggingface.co/nbeerbower/Hermes2-Gutenberg2-Mistral-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
110 |
Refer to the [original model card](https://huggingface.co/nbeerbower/Hermes2-Gutenberg2-Mistral-7B) for more details on the model.
|
111 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
112 |
## Use with llama.cpp
|
113 |
Install llama.cpp through brew (works on Mac and Linux)
|
114 |
|
|
|
109 |
This model was converted to GGUF format from [`nbeerbower/Hermes2-Gutenberg2-Mistral-7B`](https://huggingface.co/nbeerbower/Hermes2-Gutenberg2-Mistral-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
110 |
Refer to the [original model card](https://huggingface.co/nbeerbower/Hermes2-Gutenberg2-Mistral-7B) for more details on the model.
|
111 |
|
112 |
+
---
|
113 |
+
Model details:
|
114 |
+
-
|
115 |
+
Hermes2-Gutenberg2-Mistral-7B
|
116 |
+
|
117 |
+
NousResearch/Hermes-2-Pro-Mistral-7B finetuned on jondurbin/gutenberg-dpo-v0.1 and nbeerbower/gutenberg2-dpo.
|
118 |
+
Method
|
119 |
+
|
120 |
+
ORPO tuned with 2x RTX 3090 for 3 epochs.
|
121 |
+
Open LLM Leaderboard Evaluation Results
|
122 |
+
|
123 |
+
Detailed results can be found here
|
124 |
+
Metric Value
|
125 |
+
Avg. 19.35
|
126 |
+
IFEval (0-Shot) 37.21
|
127 |
+
BBH (3-Shot) 28.91
|
128 |
+
MATH Lvl 5 (4-Shot) 5.66
|
129 |
+
GPQA (0-shot) 5.26
|
130 |
+
MuSR (0-shot) 16.92
|
131 |
+
MMLU-PRO (5-shot) 22.14
|
132 |
+
|
133 |
+
---
|
134 |
+
|
135 |
## Use with llama.cpp
|
136 |
Install llama.cpp through brew (works on Mac and Linux)
|
137 |
|