macadeliccc
commited on
Commit
•
fd51ae6
1
Parent(s):
0219ef0
Update README.md
Browse files
README.md
CHANGED
@@ -16,19 +16,38 @@ This model follows the chatML chat template.
|
|
16 |
|
17 |
## Evaluations
|
18 |
|
|
|
|
|
|
|
|
|
19 |
----Benchmark Complete----
|
20 |
-
+ 2024-01-
|
21 |
-
+ Time taken:
|
22 |
+ Prompt Format: ChatML
|
23 |
+ Model: macadeliccc/SOLAR-10.7b-Instruct-dpo
|
24 |
-
+ Score (v2): 72.
|
25 |
-
+ Parseable:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
26 |
---------------
|
27 |
Batch completed
|
28 |
-
Time taken:
|
29 |
---------------
|
30 |
|
31 |
|
|
|
32 |
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
33 |
|---------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
34 |
|[SOLAR-10.7b-Instruct-dpo](https://huggingface.co/macadeliccc/SOLAR-10.7b-Instruct-dpo)| 47.57| 74.3| 72.73| 45.76| 60.09|
|
|
|
16 |
|
17 |
## Evaluations
|
18 |
|
19 |
+
### EQ Bench comparison with base model
|
20 |
+
|
21 |
+
These scores are the average of 3 iterations.
|
22 |
+
|
23 |
----Benchmark Complete----
|
24 |
+
+ 2024-01-25 04:41:01
|
25 |
+
+ Time taken: 236.1 mins
|
26 |
+ Prompt Format: ChatML
|
27 |
+ Model: macadeliccc/SOLAR-10.7b-Instruct-dpo
|
28 |
+
+ Score (v2): 72.79
|
29 |
+
+ Parseable: 165.67
|
30 |
+
---------------
|
31 |
+
Batch completed
|
32 |
+
Time taken: 236.1 mins
|
33 |
+
---------------
|
34 |
+
|
35 |
+
as compared to the original model:
|
36 |
+
|
37 |
+
----Benchmark Complete----
|
38 |
+
+ 2024-01-25 08:45:02
|
39 |
+
+ Time taken: 244.0 mins
|
40 |
+
+ Prompt Format: ChatML
|
41 |
+
+ Model: [upstage/SOLAR-10.7B-Instruct-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0)
|
42 |
+
+ Score (v2): 71.03
|
43 |
+
+ Parseable: 165.67
|
44 |
---------------
|
45 |
Batch completed
|
46 |
+
Time taken: 480.1 mins
|
47 |
---------------
|
48 |
|
49 |
|
50 |
+
|
51 |
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
52 |
|---------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
53 |
|[SOLAR-10.7b-Instruct-dpo](https://huggingface.co/macadeliccc/SOLAR-10.7b-Instruct-dpo)| 47.57| 74.3| 72.73| 45.76| 60.09|
|