GPTQ quantisation parameter request
#2
by
musicurgy
- opened
Can we get a GPTQ quant of this model with 4bit, no group size, act order true?
Thanks for all effort you put into this.
Oh wow that was meant to be the main one
Hang on I must have misconfigured this, let me check
Damn yeah that was a mistake, on 70B I normally do no group size + act-order True as the main GPTQ.
I will do that now. It'll probably take a couple of hours
musicurgy
changed discussion status to
closed