Steelskull commited on
Commit
2678704
1 Parent(s): dbe4d2e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -10
README.md CHANGED
@@ -5,19 +5,20 @@ tags:
5
  - merge
6
 
7
  ---
8
- # merge_final
9
 
10
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
11
 
12
  ## Merge Details
13
- ### Merge Method
14
 
15
- This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using /workspace/merge2 as a base.
 
 
 
16
 
17
- ### Models Merged
18
 
19
- The following models were included in the merge:
20
- * /workspace/merge
21
 
22
  ### Configuration
23
 
@@ -25,13 +26,13 @@ The following YAML configuration was used to produce this model:
25
 
26
  ```yaml
27
 
28
- base_model: /workspace/merge2
29
  models:
30
- - model: /workspace/merge
31
  parameters:
32
  weight: [0.22, 0.113, 0.113, 0.113, 0.113, 0.113]
33
  density: 0.61
34
- - model: /workspace/merge2
35
  parameters:
36
  weight: [0.22, 0.113, 0.113, 0.113, 0.113, 0.113]
37
  density: 0.61
 
5
  - merge
6
 
7
  ---
8
+ # Steelskull/Etheria-55b-v0.1
9
 
10
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/RAhrbktyyVQxOR1np-9L2.png)
11
 
12
  ## Merge Details
 
13
 
14
+ An attempt to make a functional goliath style merge to create a [Etheria] 55b-200k with two yi-34b-200k models.
15
+
16
+ This is a merge of both VerA and VerB of Etheria-55b (There numbers were surprisingly good), I then created a sacrificial 55B out of the most performant yi-34b-200k Model
17
+ and performed a Dare_ties merge and equalize the model into its current state.
18
 
19
+ ### Merge Method
20
 
21
+ This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using Merged-Etheria-55b as a base.
 
22
 
23
  ### Configuration
24
 
 
26
 
27
  ```yaml
28
 
29
+ base_model: Merged-Etheria-55b
30
  models:
31
+ - model: Sacr-Etheria-55b
32
  parameters:
33
  weight: [0.22, 0.113, 0.113, 0.113, 0.113, 0.113]
34
  density: 0.61
35
+ - model: Merged-Etheria-55b
36
  parameters:
37
  weight: [0.22, 0.113, 0.113, 0.113, 0.113, 0.113]
38
  density: 0.61