Support Q2 imatrix quants

#95
by Dampfinchen - opened

hello,

I've noticed GGUF my Repo doesn't support Q2 quants for imatrix. This is a shame because those do especially benefit from it. Any plan to add Q2_K and IQ2_XXS with imatrix support?

Thanks!

Sign up or log in to comment