ikawrakow

/

various-2bit-sota-gguf

like 80

Hello mr. Ivan!

Can I ask you to convert NousCapybara 34b to "alternative" GGUF formats,
I think alternative Qs that you make works a bit better and faster.
I think NousCapybara 34b is a top model for it's size, really smart, close to 70b.

It will be great if you can do most "optimized" Qs - Q5_K_S, Q4_K_S, Q3_K_M, Q2_K.

Thank you in advance!