Mohamed6900 commited on
Commit
d971cfe
1 Parent(s): b2c6186

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - lazymergekit
7
+ - mlabonne/NeuralHermes-2.5-Mistral-7B
8
+ - mistralai/Mistral-7B-Instruct-v0.2
9
+ ---
10
+
11
+ # mido
12
+
13
+ mido is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
14
+ * [mlabonne/NeuralHermes-2.5-Mistral-7B](https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B)
15
+ * [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
16
+
17
+ ## 🧩 Configuration
18
+
19
+ ```yaml
20
+
21
+ models:
22
+ - model: mistralai/Mistral-7B-Instruct-v0.2
23
+ # no parameters necessary for base model
24
+ - model: mlabonne/NeuralHermes-2.5-Mistral-7B
25
+ parameters:
26
+ density: 0.5
27
+ weight: 0.5
28
+ - model: mistralai/Mistral-7B-Instruct-v0.2
29
+ parameters:
30
+ density: 0.5
31
+ weight: 0.3
32
+ merge_method: ties
33
+ base_model: mistralai/Mistral-7B-v0.1
34
+ parameters:
35
+ normalize: true
36
+ dtype: float16
37
+
38
+ ```