opt-125m-GPTQ-4bit-g128 / quantize_config.json

Commit History

AutoGPTQ model for facebook/opt-125m: 4bits, gr128, desc_act=False
c5e68d3
verified

iproskurina commited on