saishf commited on
Commit
6f1ad86
1 Parent(s): 2f34a50

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -52
README.md CHANGED
@@ -1,52 +1,56 @@
1
- ---
2
- base_model:
3
- - Undi95/Meta-Llama-3-8B-Instruct-hf
4
- - ResplendentAI/RP_Format_QuoteAsterisk_Llama3
5
- - Undi95/Meta-Llama-3-8B-Instruct-hf
6
- - ResplendentAI/Smarts_Llama3
7
- - Undi95/Meta-Llama-3-8B-Instruct-hf
8
- - ResplendentAI/Luna_Llama3
9
- - Undi95/Meta-Llama-3-8B-Instruct-hf
10
- - ResplendentAI/BlueMoon_Llama3
11
- - openlynn/Llama-3-Soliloquy-8B-v2
12
- - Undi95/Meta-Llama-3-8B-Instruct-hf
13
- - ResplendentAI/Aura_Llama3
14
- library_name: transformers
15
- tags:
16
- - mergekit
17
- - merge
18
-
19
- ---
20
- # merge
21
-
22
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
23
-
24
- ## Merge Details
25
- ### Merge Method
26
-
27
- This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [openlynn/Llama-3-Soliloquy-8B-v2](https://huggingface.co/openlynn/Llama-3-Soliloquy-8B-v2) as a base.
28
-
29
- ### Models Merged
30
-
31
- The following models were included in the merge:
32
- * [Undi95/Meta-Llama-3-8B-Instruct-hf](https://huggingface.co/Undi95/Meta-Llama-3-8B-Instruct-hf) + [ResplendentAI/RP_Format_QuoteAsterisk_Llama3](https://huggingface.co/ResplendentAI/RP_Format_QuoteAsterisk_Llama3)
33
- * [Undi95/Meta-Llama-3-8B-Instruct-hf](https://huggingface.co/Undi95/Meta-Llama-3-8B-Instruct-hf) + [ResplendentAI/Smarts_Llama3](https://huggingface.co/ResplendentAI/Smarts_Llama3)
34
- * [Undi95/Meta-Llama-3-8B-Instruct-hf](https://huggingface.co/Undi95/Meta-Llama-3-8B-Instruct-hf) + [ResplendentAI/Luna_Llama3](https://huggingface.co/ResplendentAI/Luna_Llama3)
35
- * [Undi95/Meta-Llama-3-8B-Instruct-hf](https://huggingface.co/Undi95/Meta-Llama-3-8B-Instruct-hf) + [ResplendentAI/BlueMoon_Llama3](https://huggingface.co/ResplendentAI/BlueMoon_Llama3)
36
- * [Undi95/Meta-Llama-3-8B-Instruct-hf](https://huggingface.co/Undi95/Meta-Llama-3-8B-Instruct-hf) + [ResplendentAI/Aura_Llama3](https://huggingface.co/ResplendentAI/Aura_Llama3)
37
-
38
- ### Configuration
39
-
40
- The following YAML configuration was used to produce this model:
41
-
42
- ```yaml
43
- models:
44
- - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Aura_Llama3
45
- - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Smarts_Llama3
46
- - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Luna_Llama3
47
- - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/BlueMoon_Llama3
48
- - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
49
- merge_method: model_stock
50
- base_model: openlynn/Llama-3-Soliloquy-8B-v2
51
- dtype: float16
52
- ```
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Undi95/Meta-Llama-3-8B-Instruct-hf
4
+ - ResplendentAI/RP_Format_QuoteAsterisk_Llama3
5
+ - Undi95/Meta-Llama-3-8B-Instruct-hf
6
+ - ResplendentAI/Smarts_Llama3
7
+ - Undi95/Meta-Llama-3-8B-Instruct-hf
8
+ - ResplendentAI/Luna_Llama3
9
+ - Undi95/Meta-Llama-3-8B-Instruct-hf
10
+ - ResplendentAI/BlueMoon_Llama3
11
+ - openlynn/Llama-3-Soliloquy-8B-v2
12
+ - Undi95/Meta-Llama-3-8B-Instruct-hf
13
+ - ResplendentAI/Aura_Llama3
14
+ library_name: transformers
15
+ tags:
16
+ - mergekit
17
+ - merge
18
+
19
+ ---
20
+ # merge
21
+
22
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
23
+
24
+ ## Merge Details
25
+ This is quite an interesting model, it's fun so far.
26
+ But quite harsh, so if that's something you don't like, this model isn't for you :3
27
+ it's an attempt at loosely recreating [ResplendentAI/SOVL_Llama3_8B](https://huggingface.co/ResplendentAI/SOVL_Llama3_8B) but trying to keep it smarter, with the lovely [openlynn/Llama-3-Soliloquy-8B-v2](https://huggingface.co/openlynn/Llama-3-Soliloquy-8B-v2) holding it together.
28
+ I'm personally enjoying this model, it's different than most llama-3 models.
29
+ ### Merge Method
30
+
31
+ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [openlynn/Llama-3-Soliloquy-8B-v2](https://huggingface.co/openlynn/Llama-3-Soliloquy-8B-v2) as a base.
32
+
33
+ ### Models Merged
34
+
35
+ The following models were included in the merge:
36
+ * [Undi95/Meta-Llama-3-8B-Instruct-hf](https://huggingface.co/Undi95/Meta-Llama-3-8B-Instruct-hf) + [ResplendentAI/RP_Format_QuoteAsterisk_Llama3](https://huggingface.co/ResplendentAI/RP_Format_QuoteAsterisk_Llama3)
37
+ * [Undi95/Meta-Llama-3-8B-Instruct-hf](https://huggingface.co/Undi95/Meta-Llama-3-8B-Instruct-hf) + [ResplendentAI/Smarts_Llama3](https://huggingface.co/ResplendentAI/Smarts_Llama3)
38
+ * [Undi95/Meta-Llama-3-8B-Instruct-hf](https://huggingface.co/Undi95/Meta-Llama-3-8B-Instruct-hf) + [ResplendentAI/Luna_Llama3](https://huggingface.co/ResplendentAI/Luna_Llama3)
39
+ * [Undi95/Meta-Llama-3-8B-Instruct-hf](https://huggingface.co/Undi95/Meta-Llama-3-8B-Instruct-hf) + [ResplendentAI/BlueMoon_Llama3](https://huggingface.co/ResplendentAI/BlueMoon_Llama3)
40
+ * [Undi95/Meta-Llama-3-8B-Instruct-hf](https://huggingface.co/Undi95/Meta-Llama-3-8B-Instruct-hf) + [ResplendentAI/Aura_Llama3](https://huggingface.co/ResplendentAI/Aura_Llama3)
41
+
42
+ ### Configuration
43
+
44
+ The following YAML configuration was used to produce this model:
45
+
46
+ ```yaml
47
+ models:
48
+ - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Aura_Llama3
49
+ - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Smarts_Llama3
50
+ - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/Luna_Llama3
51
+ - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/BlueMoon_Llama3
52
+ - model: Undi95/Meta-Llama-3-8B-Instruct-hf+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
53
+ merge_method: model_stock
54
+ base_model: openlynn/Llama-3-Soliloquy-8B-v2
55
+ dtype: float16
56
+ ```