pretty good

#1
by McUH - opened

Thanks for your work with these enhancements. CommandR 35B remains one of the best to run on 24GB VRAM with offload. And trying this IQ4_XS 200xq quant - it performs very well in roleplay. While I did not do any comprehensive tests, it does indeed seem like improvement over previous IQ4_XS's of this model.

Owner

Thank you for your feedback.
It really helps with tuning and future X quants.

Sign up or log in to comment