Update README.md
Browse files
README.md
CHANGED
@@ -13,27 +13,8 @@ tags:
|
|
13 |
# Herplete-LLM-Llama-3.1-8b
|
14 |
|
15 |
|
16 |
-
Herplete-LLM-Llama-3.1-8b is a
|
17 |
-
* [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B)
|
18 |
-
* [Replete-AI/Replete-LLM-V2-Llama-3.1-8b](https://huggingface.co/Replete-AI/Replete-LLM-V2-Llama-3.1-8b)
|
19 |
|
20 |
-
## 🧩 Configuration
|
21 |
-
|
22 |
-
```yaml
|
23 |
-
models:
|
24 |
-
- model: NousResearch/Hermes-3-Llama-3.1-8B
|
25 |
-
parameters:
|
26 |
-
weight: 1
|
27 |
-
- model: Replete-AI/Replete-LLM-V2-Llama-3.1-8b
|
28 |
-
parameters:
|
29 |
-
weight: 1
|
30 |
-
merge_method: ties
|
31 |
-
base_model: rombodawg/Meta-Llama-3.1-8B-reuploaded
|
32 |
-
parameters:
|
33 |
-
normalize: true
|
34 |
-
int8_mask: true
|
35 |
-
dtype: bfloat16
|
36 |
-
```
|
37 |
You can find the continuous finetuning method here:
|
38 |
|
39 |
https://docs.google.com/document/d/1OjbjU5AOz4Ftn9xHQrX3oFQGhQ6RDUuXQipnQ9gn6tU/edit?usp=sharing
|
|
|
13 |
# Herplete-LLM-Llama-3.1-8b
|
14 |
|
15 |
|
16 |
+
Herplete-LLM-Llama-3.1-8b is a continuous finetuned model of from Replete-AI/Replete-LLM-V2-Llama-3.1-8b using Lora extracted from Hermes-3-Llama-3.1-8B.
|
|
|
|
|
17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
You can find the continuous finetuning method here:
|
19 |
|
20 |
https://docs.google.com/document/d/1OjbjU5AOz4Ftn9xHQrX3oFQGhQ6RDUuXQipnQ9gn6tU/edit?usp=sharing
|