larenspear commited on
Commit
198d6e1
1 Parent(s): fbcb2ad

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: 01-ai/Yi-1.5-6B
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ license: apache-2.0
7
+ quantized_by: larenspear
8
+ ---
9
+ ## About
10
+
11
+ GGUF Quantizations of https://huggingface.co/01-ai/Yi-1.5-6B
12
+
13
+ ## Provided Quantizations
14
+
15
+ | Link | Type |
16
+ |:-----|:-----|
17
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q2_k.gguf) | Q2_K |
18
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q3_k_s.gguf) | Q3_K_S |
19
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q3_k_m.gguf) | Q3_K_M |
20
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q3_k_l.gguf) | Q3_K_L |
21
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q4_0.gguf) | Q4_0 |
22
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q4_k_s.gguf) | Q4_K_S |
23
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q4_k_m.gguf) | Q4_K_M |
24
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q5_0.gguf) | Q5_0 |
25
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q5_k_s.gguf) | Q5_K_S |
26
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q5_k_m.gguf) | Q5_K_M |
27
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q6_k.gguf) | Q6_K |
28
+ | [GGUF](https://huggingface.co/larenspear/Yi-1.5-6B-Chat-GGUF/resolve/main/yi-1.5-6b-chat-q8_0.gguf) | Q8_0 |
29
+
30
+ In a circular citation, I borrowed the format of this file from https://huggingface.co/mradermacher/copy_of_wildjailbreak_13-GGUF.
31
+
32
+ <!-- end -->