Kooten commited on
Commit
50fdfde
1 Parent(s): 6825281

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ ---
5
+ # NeverSleep/MiquMaid-v2-70B-DPO Imatrix GGUF
6
+
7
+ ## Description
8
+ Imatrix GGUF quants of [NeverSleep/MiquMaid-v2-70B](https://huggingface.co/NeverSleep/MiquMaid-v2-70B)
9
+
10
+ ## Other quants:
11
+
12
+ EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v2-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v2-70B-3bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v2-70B-2.4bpw-exl2)
13
+
14
+ [2bit Imatrix GGUF](https://huggingface.co/Kooten/MiquMaid-v2-70B-Imatrix-GGUF): [IQ2-XS](), [IQ2-XXS](), [IQ3-XXS]()
15
+
16
+ ## Prompt format: NsChatml
17
+ ```
18
+ <|im_system|>
19
+ {sysprompt}<|im_end|>
20
+ <|im_user|>
21
+ {input}<|im_end|>
22
+ <|im_bot|>
23
+ {output}<|im_end|>
24
+ ```
25
+
26
+ ## Contact
27
+ Kooten on discord
28
+
29
+ [ko-fi.com/kooten](https://ko-fi.com/kooten)