Etherll commited on
Commit
06c2df2
1 Parent(s): 5243dfc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -20
README.md CHANGED
@@ -13,27 +13,8 @@ tags:
13
  # Herplete-LLM-Llama-3.1-8b
14
 
15
 
16
- Herplete-LLM-Llama-3.1-8b is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
17
- * [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B)
18
- * [Replete-AI/Replete-LLM-V2-Llama-3.1-8b](https://huggingface.co/Replete-AI/Replete-LLM-V2-Llama-3.1-8b)
19
 
20
- ## 🧩 Configuration
21
-
22
- ```yaml
23
- models:
24
- - model: NousResearch/Hermes-3-Llama-3.1-8B
25
- parameters:
26
- weight: 1
27
- - model: Replete-AI/Replete-LLM-V2-Llama-3.1-8b
28
- parameters:
29
- weight: 1
30
- merge_method: ties
31
- base_model: rombodawg/Meta-Llama-3.1-8B-reuploaded
32
- parameters:
33
- normalize: true
34
- int8_mask: true
35
- dtype: bfloat16
36
- ```
37
  You can find the continuous finetuning method here:
38
 
39
  https://docs.google.com/document/d/1OjbjU5AOz4Ftn9xHQrX3oFQGhQ6RDUuXQipnQ9gn6tU/edit?usp=sharing
 
13
  # Herplete-LLM-Llama-3.1-8b
14
 
15
 
16
+ Herplete-LLM-Llama-3.1-8b is a continuous finetuned model of from Replete-AI/Replete-LLM-V2-Llama-3.1-8b using Lora extracted from Hermes-3-Llama-3.1-8B.
 
 
17
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
  You can find the continuous finetuning method here:
19
 
20
  https://docs.google.com/document/d/1OjbjU5AOz4Ftn9xHQrX3oFQGhQ6RDUuXQipnQ9gn6tU/edit?usp=sharing