Nekochu commited on
Commit
3a9bfdb
1 Parent(s): cc9e363

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -178,4 +178,10 @@ C. taucht die Nadel in Tinte und zeichnet mit dem Bleistift ein Motiv auf ihr Be
178
 
179
  Note: Output from inference [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory) (and exl2-8bpw). Source question: [mayflowergmbh/intel_orca_dpo_pairs_de](https://huggingface.co/datasets/mayflowergmbh/intel_orca_dpo_pairs_de)
180
 
181
- </details>
 
 
 
 
 
 
 
178
 
179
  Note: Output from inference [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory) (and exl2-8bpw). Source question: [mayflowergmbh/intel_orca_dpo_pairs_de](https://huggingface.co/datasets/mayflowergmbh/intel_orca_dpo_pairs_de)
180
 
181
+ </details>
182
+
183
+ Eval [MMLU-Pro](https://github.com/chigkim/Ollama-MMLU-Pro).
184
+ | Model | overall | biology | business | chemistry | computer science | economics | engineering | health | history | law | math | philosophy | physics | psychology | other |
185
+ |----------------------------------|---------|---------|----------|-----------|------------------|-----------|-------------|--------|---------|------|-------|------------|---------|------------|-------|
186
+ | **Llama-3.1-8B-Instruct-exl2-8bpw-h8** | 37.61 | 60.81 | 37.26 | 32.86 | 38.78 | 46.33 | 23.32 | 45.48 | 39.90 | 21.62 | 38.86 | 34.67 | 28.79 | 50.63 | 44.26 |
187
+ | **Llama-3.1-8B-German-ORPO-8.0bpw-h8-exl2** | 44.96 | 63.74 | 49.68 | 36.93 | 48.29 | 55.81 | 28.59 | 52.81 | 45.67 | 30.79 | 45.08 | 40.48 | 39.03 | 60.90 | 48.38 |