farhananis005
commited on
Commit
•
25f1a3d
1
Parent(s):
dfb0efc
Update README.md
Browse files
README.md
CHANGED
@@ -15,10 +15,10 @@ base_model:
|
|
15 |
|
16 |
# Llama-3-8b-pygmalion-2-7b-v1
|
17 |
|
18 |
-
|
19 |
* [winglian/Llama-3-8b-64k-PoSE](https://huggingface.co/winglian/Llama-3-8b-64k-PoSE)
|
20 |
* [PygmalionAI/pygmalion-2-7b](https://huggingface.co/PygmalionAI/pygmalion-2-7b)
|
21 |
-
|
22 |
|
23 |
## 🧩 Configuration
|
24 |
|
|
|
15 |
|
16 |
# Llama-3-8b-pygmalion-2-7b-v1
|
17 |
|
18 |
+
Tried merging LLAMA 2 and LLAMA 3. This model does not provide and legible outputLlama-3-8b-pygmalion-2-7b-v1 is a Mixture of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
19 |
* [winglian/Llama-3-8b-64k-PoSE](https://huggingface.co/winglian/Llama-3-8b-64k-PoSE)
|
20 |
* [PygmalionAI/pygmalion-2-7b](https://huggingface.co/PygmalionAI/pygmalion-2-7b)
|
21 |
+
|
22 |
|
23 |
## 🧩 Configuration
|
24 |
|