xaviviro leaderboard-pr-bot commited on
Commit
adee1d5
1 Parent(s): edd1cbf

Adding Evaluation Results (#1)

Browse files

- Adding Evaluation Results (c3b0b3682e30257f51446e2139d9a290c5b57a38)


Co-authored-by: Open LLM Leaderboard PR Bot <[email protected]>

Files changed (1) hide show
  1. README.md +24 -13
README.md CHANGED
@@ -1,26 +1,23 @@
1
  ---
 
 
 
 
2
  license: apache-2.0
3
- base_model: projecte-aina/FLOR-6.3B
4
- datasets:
5
- - xaviviro/oasst2_ca_gpt
6
  tags:
7
  - finetune
8
  - chatml
9
  - gpt4
10
  - catalan
 
 
 
 
 
11
  model-index:
12
  - name: FLOR-6.3B-xat
13
  results: []
14
- library_name: transformers
15
- widget:
16
- - text: |
17
- <|im_start|>user
18
- Qui va ser Isaac Newton?<|im_end|>
19
- <|im_start|>assistant
20
- language:
21
- - ca
22
- - en
23
- - es
24
  ---
25
 
26
  # FLOR-6.3B-xat
@@ -39,3 +36,17 @@ FLOR-6.3B-xat usa **ChatML** com a prompt template:
39
  Qui va ser Isaac Newton?<|im_end|>
40
  <|im_start|>assistant\n
41
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - ca
4
+ - en
5
+ - es
6
  license: apache-2.0
7
+ library_name: transformers
 
 
8
  tags:
9
  - finetune
10
  - chatml
11
  - gpt4
12
  - catalan
13
+ datasets:
14
+ - xaviviro/oasst2_ca_gpt
15
+ base_model: projecte-aina/FLOR-6.3B
16
+ widget:
17
+ - text: "<|im_start|>user\n Qui va ser Isaac Newton?<|im_end|>\n<|im_start|>assistant\n"
18
  model-index:
19
  - name: FLOR-6.3B-xat
20
  results: []
 
 
 
 
 
 
 
 
 
 
21
  ---
22
 
23
  # FLOR-6.3B-xat
 
36
  Qui va ser Isaac Newton?<|im_end|>
37
  <|im_start|>assistant\n
38
  ```
39
+
40
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
41
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_xaviviro__FLOR-6.3B-xat)
42
+
43
+ | Metric |Value|
44
+ |---------------------------------|----:|
45
+ |Avg. |38.23|
46
+ |AI2 Reasoning Challenge (25-Shot)|38.65|
47
+ |HellaSwag (10-Shot) |63.76|
48
+ |MMLU (5-Shot) |26.54|
49
+ |TruthfulQA (0-shot) |37.96|
50
+ |Winogrande (5-shot) |62.43|
51
+ |GSM8k (5-shot) | 0.00|
52
+