Update README.md
Browse files
README.md
CHANGED
@@ -36,7 +36,7 @@ Use at your own risk.
|
|
36 |
This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method,
|
37 |
using [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) as a base.
|
38 |
|
39 |
-
The value for `density` are from
|
40 |
and the weight was randomly generated and then assigned to the models,
|
41 |
with priority (of using the bigger weight) to `NeuralHermes`, `OpenOrca`, and `neural-chat`.
|
42 |
The models themselves are chosen by "vibes".
|
|
|
36 |
This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method,
|
37 |
using [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) as a base.
|
38 |
|
39 |
+
The value for `density` are from [this blogpost](https://huggingface.co/blog/mlabonne/merge-models),
|
40 |
and the weight was randomly generated and then assigned to the models,
|
41 |
with priority (of using the bigger weight) to `NeuralHermes`, `OpenOrca`, and `neural-chat`.
|
42 |
The models themselves are chosen by "vibes".
|