farhananis005
commited on
Commit
•
d650220
1
Parent(s):
25f1a3d
Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,8 @@ base_model:
|
|
15 |
|
16 |
# Llama-3-8b-pygmalion-2-7b-v1
|
17 |
|
18 |
-
Tried merging LLAMA 2 and LLAMA 3. This model does not provide and legible
|
|
|
19 |
* [winglian/Llama-3-8b-64k-PoSE](https://huggingface.co/winglian/Llama-3-8b-64k-PoSE)
|
20 |
* [PygmalionAI/pygmalion-2-7b](https://huggingface.co/PygmalionAI/pygmalion-2-7b)
|
21 |
|
|
|
15 |
|
16 |
# Llama-3-8b-pygmalion-2-7b-v1
|
17 |
|
18 |
+
Tried merging LLAMA 2 and LLAMA 3. This model does not provide and legible output.
|
19 |
+
Llama-3-8b-pygmalion-2-7b-v1 is a Mixture of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
20 |
* [winglian/Llama-3-8b-64k-PoSE](https://huggingface.co/winglian/Llama-3-8b-64k-PoSE)
|
21 |
* [PygmalionAI/pygmalion-2-7b](https://huggingface.co/PygmalionAI/pygmalion-2-7b)
|
22 |
|