legraphista
commited on
Commit
β’
6708ebc
1
Parent(s):
4440da0
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -65,14 +65,14 @@ Link: [here](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat
|
|
65 |
| [Qwen2.5-Coder-1.5B-Instruct.Q8_0.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q8_0.gguf) | Q8_0 | 1.65GB | β
Available | βͺ Static | π¦ No
|
66 |
| [Qwen2.5-Coder-1.5B-Instruct.Q6_K.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q6_K.gguf) | Q6_K | 1.27GB | β
Available | βͺ Static | π¦ No
|
67 |
| [Qwen2.5-Coder-1.5B-Instruct.Q4_K.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q4_K.gguf) | Q4_K | 986.05MB | β
Available | π’ IMatrix | π¦ No
|
68 |
-
| Qwen2.5-Coder-1.5B-Instruct.Q3_K | Q3_K |
|
69 |
| Qwen2.5-Coder-1.5B-Instruct.Q2_K | Q2_K | - | β³ Processing | π’ IMatrix | -
|
70 |
|
71 |
|
72 |
### All Quants
|
73 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
74 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
75 |
-
| Qwen2.5-Coder-1.5B-Instruct.BF16 | BF16 |
|
76 |
| Qwen2.5-Coder-1.5B-Instruct.FP16 | F16 | - | β³ Processing | βͺ Static | -
|
77 |
| [Qwen2.5-Coder-1.5B-Instruct.Q8_0.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q8_0.gguf) | Q8_0 | 1.65GB | β
Available | βͺ Static | π¦ No
|
78 |
| [Qwen2.5-Coder-1.5B-Instruct.Q6_K.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q6_K.gguf) | Q6_K | 1.27GB | β
Available | βͺ Static | π¦ No
|
@@ -82,7 +82,7 @@ Link: [here](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat
|
|
82 |
| Qwen2.5-Coder-1.5B-Instruct.Q4_K_S | Q4_K_S | - | β³ Processing | π’ IMatrix | -
|
83 |
| Qwen2.5-Coder-1.5B-Instruct.IQ4_NL | IQ4_NL | - | β³ Processing | π’ IMatrix | -
|
84 |
| Qwen2.5-Coder-1.5B-Instruct.IQ4_XS | IQ4_XS | - | β³ Processing | π’ IMatrix | -
|
85 |
-
| Qwen2.5-Coder-1.5B-Instruct.Q3_K | Q3_K |
|
86 |
| Qwen2.5-Coder-1.5B-Instruct.Q3_K_L | Q3_K_L | - | β³ Processing | π’ IMatrix | -
|
87 |
| Qwen2.5-Coder-1.5B-Instruct.Q3_K_S | Q3_K_S | - | β³ Processing | π’ IMatrix | -
|
88 |
| Qwen2.5-Coder-1.5B-Instruct.IQ3_M | IQ3_M | - | β³ Processing | π’ IMatrix | -
|
|
|
65 |
| [Qwen2.5-Coder-1.5B-Instruct.Q8_0.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q8_0.gguf) | Q8_0 | 1.65GB | β
Available | βͺ Static | π¦ No
|
66 |
| [Qwen2.5-Coder-1.5B-Instruct.Q6_K.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q6_K.gguf) | Q6_K | 1.27GB | β
Available | βͺ Static | π¦ No
|
67 |
| [Qwen2.5-Coder-1.5B-Instruct.Q4_K.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q4_K.gguf) | Q4_K | 986.05MB | β
Available | π’ IMatrix | π¦ No
|
68 |
+
| [Qwen2.5-Coder-1.5B-Instruct.Q3_K.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q3_K.gguf) | Q3_K | 824.18MB | β
Available | π’ IMatrix | π¦ No
|
69 |
| Qwen2.5-Coder-1.5B-Instruct.Q2_K | Q2_K | - | β³ Processing | π’ IMatrix | -
|
70 |
|
71 |
|
72 |
### All Quants
|
73 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
74 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
75 |
+
| [Qwen2.5-Coder-1.5B-Instruct.BF16.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.BF16.gguf) | BF16 | 3.09GB | β
Available | βͺ Static | π¦ No
|
76 |
| Qwen2.5-Coder-1.5B-Instruct.FP16 | F16 | - | β³ Processing | βͺ Static | -
|
77 |
| [Qwen2.5-Coder-1.5B-Instruct.Q8_0.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q8_0.gguf) | Q8_0 | 1.65GB | β
Available | βͺ Static | π¦ No
|
78 |
| [Qwen2.5-Coder-1.5B-Instruct.Q6_K.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q6_K.gguf) | Q6_K | 1.27GB | β
Available | βͺ Static | π¦ No
|
|
|
82 |
| Qwen2.5-Coder-1.5B-Instruct.Q4_K_S | Q4_K_S | - | β³ Processing | π’ IMatrix | -
|
83 |
| Qwen2.5-Coder-1.5B-Instruct.IQ4_NL | IQ4_NL | - | β³ Processing | π’ IMatrix | -
|
84 |
| Qwen2.5-Coder-1.5B-Instruct.IQ4_XS | IQ4_XS | - | β³ Processing | π’ IMatrix | -
|
85 |
+
| [Qwen2.5-Coder-1.5B-Instruct.Q3_K.gguf](https://huggingface.co/legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct.Q3_K.gguf) | Q3_K | 824.18MB | β
Available | π’ IMatrix | π¦ No
|
86 |
| Qwen2.5-Coder-1.5B-Instruct.Q3_K_L | Q3_K_L | - | β³ Processing | π’ IMatrix | -
|
87 |
| Qwen2.5-Coder-1.5B-Instruct.Q3_K_S | Q3_K_S | - | β³ Processing | π’ IMatrix | -
|
88 |
| Qwen2.5-Coder-1.5B-Instruct.IQ3_M | IQ3_M | - | β³ Processing | π’ IMatrix | -
|