GPTQ version

#1
by FrankWu - opened

Can anyone provide a GPTQ version?

01-ai org

modelscope community provided one with their SWIFT framework, although I didn't try out myself.
https://www.modelscope.cn/models/tclf90/Yi-1.5-34B-Chat-16K-GPTQ-Int3/summary

lorinma changed discussion status to closed

Sign up or log in to comment