Update README.md
Browse files
README.md
CHANGED
@@ -13,6 +13,14 @@ tags:
|
|
13 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
14 |
|
15 |
## Merge Details
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
### Merge Method
|
17 |
|
18 |
This model was merged using the SLERP merge method.
|
|
|
13 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
14 |
|
15 |
## Merge Details
|
16 |
+
|
17 |
+
v1.1 was based on *approximately* the same steps as v1, but based on the abliterated version of Qwen-Instruct.
|
18 |
+
|
19 |
+
Presuming this dealt some damage, this version heals it with the middle layers of v1.
|
20 |
+
It's still less 'refusal-censored' than v1, though be sure to calibrate the system prompt appropriately for the use case.
|
21 |
+
EQ-bench testing had some syntax issues still but tested at 76.1336 (with Qwen prompt that I plan on removing).
|
22 |
+
Not too bad given at least half of it's been through abliteration and DPO.
|
23 |
+
|
24 |
### Merge Method
|
25 |
|
26 |
This model was merged using the SLERP merge method.
|