aipib commited on
Commit
ab22acc
1 Parent(s): 44c3446

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -20
README.md CHANGED
@@ -16,26 +16,6 @@ karasu-slerp1 is a merge of the following models using [LazyMergekit](https://co
16
  * [yuiseki/karasu-sake-qa-v0.1](https://huggingface.co/yuiseki/karasu-sake-qa-v0.1)
17
  * [lightblue/karasu-1.1B](https://huggingface.co/lightblue/karasu-1.1B)
18
 
19
- ## 🧩 Configuration
20
-
21
- ```yaml
22
- slices:
23
- - sources:
24
- - model: yuiseki/karasu-sake-qa-v0.1
25
- layer_range: [0, 22]
26
- - model: lightblue/karasu-1.1B
27
- layer_range: [0, 22]
28
- merge_method: slerp
29
- base_model: lightblue/karasu-1.1B
30
- parameters:
31
- t:
32
- - filter: self_attn
33
- value: [0, 0.5, 0.3, 0.7, 1]
34
- - filter: mlp
35
- value: [1, 0.5, 0.7, 0.3, 0]
36
- - value: 0.5
37
- dtype: bfloat16
38
- ```
39
 
40
  ## 💻 Usage
41
 
 
16
  * [yuiseki/karasu-sake-qa-v0.1](https://huggingface.co/yuiseki/karasu-sake-qa-v0.1)
17
  * [lightblue/karasu-1.1B](https://huggingface.co/lightblue/karasu-1.1B)
18
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
  ## 💻 Usage
21