Llama-Guard-3-8B-Q8-GPTQ / quantize_config.json

Commit History

AutoGPTQ model for meta-llama/Llama-Guard-3-8B: 8bits, gr128, desc_act=True
6a9ced6
verified

ktoprakucar commited on