Spaces:
Running
on
A10G
Running
on
A10G
Support Q2 imatrix quants
#95
by
Dampfinchen
- opened
hello,
I've noticed GGUF my Repo doesn't support Q2 quants for imatrix. This is a shame because those do especially benefit from it. Any plan to add Q2_K and IQ2_XXS with imatrix support?
Thanks!