abhinand leaderboard-pr-bot commited on
Commit
46d68c9
1 Parent(s): 77591fc

Adding Evaluation Results (#2)

Browse files

- Adding Evaluation Results (dc0d425f85628e1583d8c300a4669190a7f4e46f)


Co-authored-by: Open LLM Leaderboard PR Bot <[email protected]>

Files changed (1) hide show
  1. README.md +18 -5
README.md CHANGED
@@ -1,12 +1,12 @@
1
  ---
 
 
 
 
2
  base_model: abhinand/malayalam-llama-pt-v0
3
  model-index:
4
  - name: malayalam-llama-instruct-v0.1
5
  results: []
6
- license: llama2
7
- language:
8
- - en
9
- - ml
10
  ---
11
 
12
  # Malayalam LLaMA 7B Instruct v0.1
@@ -173,4 +173,17 @@ If you use this model or any of the the Tamil-Llama related work in your researc
173
  }
174
  ```
175
 
176
- We hope this model serves as a valuable tool in your NLP toolkit and look forward to seeing the advancements it will enable in the understanding and generation of the Tamil language.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ - ml
5
+ license: llama2
6
  base_model: abhinand/malayalam-llama-pt-v0
7
  model-index:
8
  - name: malayalam-llama-instruct-v0.1
9
  results: []
 
 
 
 
10
  ---
11
 
12
  # Malayalam LLaMA 7B Instruct v0.1
 
173
  }
174
  ```
175
 
176
+ We hope this model serves as a valuable tool in your NLP toolkit and look forward to seeing the advancements it will enable in the understanding and generation of the Tamil language.
177
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
178
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_abhinand__malayalam-llama-7b-instruct-v0.1)
179
+
180
+ | Metric |Value|
181
+ |---------------------------------|----:|
182
+ |Avg. |39.69|
183
+ |AI2 Reasoning Challenge (25-Shot)|37.20|
184
+ |HellaSwag (10-Shot) |67.81|
185
+ |MMLU (5-Shot) |23.12|
186
+ |TruthfulQA (0-shot) |47.11|
187
+ |Winogrande (5-shot) |62.90|
188
+ |GSM8k (5-shot) | 0.00|
189
+