bnjmnmarie commited on
Commit
fb9c16c
1 Parent(s): 02777fb

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ tags:
6
+ - merge
7
+ library_name: transformers
8
+ ---
9
+
10
+ # Model Card for Model ID
11
+
12
+ This is a mixture of experts created with [mergekit](https://github.com/cg123/mergekit) and based on [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1).
13
+ ## Model Details
14
+
15
+ ### Model Description
16
+
17
+ <!-- Provide a longer summary of what this model is. -->
18
+
19
+
20
+
21
+ - **Developed by:** [The Kaitchup](https://kaitchup.substack.com/)
22
+ - **Model type:** Causal
23
+ - **Language(s) (NLP):** English
24
+ - **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
25
+
26
+ ### Model Sources
27
+
28
+ Created with mergekit with this configuration:
29
+ ```
30
+ models:
31
+ - model: mncai/mistral-7b-dpo-v5
32
+ # no parameters necessary for base model
33
+ - model: kaitchup/Mayonnaise-4in1-02
34
+ parameters:
35
+ density: 0.5
36
+ weight: 0.3
37
+ - model: BarryFutureman/NeuralTurdusVariant1-7B
38
+ parameters:
39
+ density: 0.5
40
+ weight: 0.5
41
+ merge_method: ties
42
+ base_model: mncai/mistral-7b-dpo-v5
43
+ parameters:
44
+ normalize: true
45
+ dtype: float16
46
+ ```