legraphista
commited on
Commit
β’
d36510f
1
Parent(s):
6cadad1
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -69,7 +69,7 @@ Link: [here](https://huggingface.co/legraphista/Phi-3.5-mini-instruct-IMat-GGUF/
|
|
69 |
### All Quants
|
70 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
71 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
72 |
-
| Phi-3.5-mini-instruct.BF16 | BF16 |
|
73 |
| Phi-3.5-mini-instruct.FP16 | F16 | - | β³ Processing | βͺ Static | -
|
74 |
| [Phi-3.5-mini-instruct.Q8_0.gguf](https://huggingface.co/legraphista/Phi-3.5-mini-instruct-IMat-GGUF/blob/main/Phi-3.5-mini-instruct.Q8_0.gguf) | Q8_0 | 4.06GB | β
Available | βͺ Static | π¦ No
|
75 |
| [Phi-3.5-mini-instruct.Q6_K.gguf](https://huggingface.co/legraphista/Phi-3.5-mini-instruct-IMat-GGUF/blob/main/Phi-3.5-mini-instruct.Q6_K.gguf) | Q6_K | 3.14GB | β
Available | βͺ Static | π¦ No
|
|
|
69 |
### All Quants
|
70 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
71 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
72 |
+
| [Phi-3.5-mini-instruct.BF16.gguf](https://huggingface.co/legraphista/Phi-3.5-mini-instruct-IMat-GGUF/blob/main/Phi-3.5-mini-instruct.BF16.gguf) | BF16 | 7.64GB | β
Available | βͺ Static | π¦ No
|
73 |
| Phi-3.5-mini-instruct.FP16 | F16 | - | β³ Processing | βͺ Static | -
|
74 |
| [Phi-3.5-mini-instruct.Q8_0.gguf](https://huggingface.co/legraphista/Phi-3.5-mini-instruct-IMat-GGUF/blob/main/Phi-3.5-mini-instruct.Q8_0.gguf) | Q8_0 | 4.06GB | β
Available | βͺ Static | π¦ No
|
75 |
| [Phi-3.5-mini-instruct.Q6_K.gguf](https://huggingface.co/legraphista/Phi-3.5-mini-instruct-IMat-GGUF/blob/main/Phi-3.5-mini-instruct.Q6_K.gguf) | Q6_K | 3.14GB | β
Available | βͺ Static | π¦ No
|