AWQ and GPTQ plz

#11
by Parkerlambert123 - opened

AWQ and GPTQ plz

Hi,
Will start today 😆

GPTQ plz

I thought AWQ was faster with the same quality than GPTQ, is there another reason to use GPTQ?

Because we use v100 gpu for inference,not support AWQ.

That's a very good reason! I see if I can do this by GPTQ.

Sign up or log in to comment