bartowski

/

Qwen2.5-Math-72B-Instruct-GGUF

like 2

Hi thank you for this GGUF! I would like to run it in vllm, thus I wonder whether there will be GPTQ/AWQ quantization in the future?

EDIT: Oh I see it seems you only quantize to format GGUF... Then I wonder whether there will be some future plans to also quantize to GPTQ/AWQ