Thank you for K_L quants!
#1
by
notafraud
- opened
Hi! Just wanted to say thank you for k_l quants, I use them primarily nowadays (mostly q4_k_l and q5_k_l), they seem to give better prompt adherence than typical quants. It's still worth using higher quants (i.e. q5_k_l works better than q4_k_l), but there's definitely an improvement over respective k_m variants.