Hugging Face's logo

TheBloke
/
chronos-33b-GPTQ

Text Generation
Transformers
Safetensors
PyTorch
llama
chatbot
storywriting
text-generation-inference
4-bit precision
gptq
Model card Files Community
1
New discussion

Is there any chance of getting this into a 4bit quantized (GPTQ as well?) version?
#1 opened over 1 year ago by cleverest