Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Commit
2db3366
1 Parent(s): 1fe9494

Adding Evaluation Results (#3)

Browse files

- Adding Evaluation Results (86c01ab43446e12e6db694f8a7876a89ff59b492)


Co-authored-by: Open LLM Leaderboard PR Bot <[email protected]>

Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -19,4 +19,17 @@ https://huggingface.co/TheBloke/PuddleJumper-13B-V2-GGUF
19
 
20
  https://huggingface.co/TheBloke/PuddleJumper-13B-V2-AWQ
21
 
22
- https://huggingface.co/TheBloke/PuddleJumper-13B-V2-GPTQ
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
  https://huggingface.co/TheBloke/PuddleJumper-13B-V2-AWQ
21
 
22
+ https://huggingface.co/TheBloke/PuddleJumper-13B-V2-GPTQ
23
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
24
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_totally-not-an-llm__PuddleJumper-13b-V2)
25
+
26
+ | Metric | Value |
27
+ |-----------------------|---------------------------|
28
+ | Avg. | 49.69 |
29
+ | ARC (25-shot) | 57.0 |
30
+ | HellaSwag (10-shot) | 81.06 |
31
+ | MMLU (5-shot) | 58.3 |
32
+ | TruthfulQA (0-shot) | 52.66 |
33
+ | Winogrande (5-shot) | 72.45 |
34
+ | GSM8K (5-shot) | 3.64 |
35
+ | DROP (3-shot) | 22.74 |