leaderboard-pr-bot commited on
Commit
89bb09a
1 Parent(s): f67de5c

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +21 -8
README.md CHANGED
@@ -1,6 +1,8 @@
1
  ---
 
 
2
  license: cc-by-nc-4.0
3
- base_model: google/gemma-2b-it
4
  tags:
5
  - generated_from_trainer
6
  - axolotl
@@ -11,15 +13,13 @@ tags:
11
  - gpt4
12
  - synthetic data
13
  - distillation
14
- model-index:
15
- - name: gemma-2b-openhermes
16
- results: []
17
  datasets:
18
  - mlabonne/chatml-OpenHermes2.5-dpo-binarized-alpha
19
- language:
20
- - en
21
- library_name: transformers
22
  pipeline_tag: text-generation
 
 
 
23
  ---
24
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
25
  should probably proofread and complete it, then remove this comment. -->
@@ -280,4 +280,17 @@ special_tokens:
280
  - Tokenizers 0.15.0
281
  - axolotl: 0.4.0
282
 
283
- [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
  license: cc-by-nc-4.0
5
+ library_name: transformers
6
  tags:
7
  - generated_from_trainer
8
  - axolotl
 
13
  - gpt4
14
  - synthetic data
15
  - distillation
 
 
 
16
  datasets:
17
  - mlabonne/chatml-OpenHermes2.5-dpo-binarized-alpha
18
+ base_model: google/gemma-2b-it
 
 
19
  pipeline_tag: text-generation
20
+ model-index:
21
+ - name: gemma-2b-openhermes
22
+ results: []
23
  ---
24
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
25
  should probably proofread and complete it, then remove this comment. -->
 
280
  - Tokenizers 0.15.0
281
  - axolotl: 0.4.0
282
 
283
+ [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
284
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
285
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_abideen__gemma-2b-openhermes)
286
+
287
+ | Metric |Value|
288
+ |---------------------------------|----:|
289
+ |Avg. |42.78|
290
+ |AI2 Reasoning Challenge (25-Shot)|43.94|
291
+ |HellaSwag (10-Shot) |62.74|
292
+ |MMLU (5-Shot) |37.62|
293
+ |TruthfulQA (0-shot) |45.83|
294
+ |Winogrande (5-shot) |60.93|
295
+ |GSM8k (5-shot) | 5.61|
296
+