Update README.md
Browse files
README.md
CHANGED
@@ -8,6 +8,12 @@ This model is the Mistral-7b model finetuned for 1k steps with a combined lm los
|
|
8 |
|
9 |
(update: not very good)
|
10 |
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
### use
|
12 |
```python
|
13 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
8 |
|
9 |
(update: not very good)
|
10 |
|
11 |
+
| model | avg | arc | hellaswag | mmlu | truthfulqa | winogrande | gsm8k |
|
12 |
+
| --- | --- | --- | --- | --- | --- | --- | --- |
|
13 |
+
| apricot-wildflower-20 | 59.74 | 59.64 | 81.76 | 63.38 | 41.76 | 77.9 | 33.97 |
|
14 |
+
| mistralai/Mistral-7B-v0.1 | 60.97 | 59.98 | 83.31 | 64.16 | 42.15 | 78.37 | 37.83 |
|
15 |
+
|
16 |
+
|
17 |
### use
|
18 |
```python
|
19 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|