More qunt models
#1
by
mtasic85
- opened
Can you upload q4_k_m and q8_0 models?
I quantized both versions locally and did not have much trouble.
Can you upload q4_k_m and q8_0 models?
I quantized both versions locally and did not have much trouble.