More quant types

#2
by Wubbbi - opened

Could we get iq2-s and iq2-m too please? iq2-m is running perfect on my GPU and i wouldn't mind iq2-s :3 Thank you so much!

@Wubbbi The new quants have been added, enjoy!

@Wubbbi The new quants have been added, enjoy!

Thank you so much! Very kind <3

Can you add iq1s quant? Thanks!

@vonjack the new quant has been uploaded!

@vonjack the new quant has been uploaded!

Thank you!

Sign up or log in to comment