shuttleai
/

shuttle-2.5-mini-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

shuttle-2.5-mini-GPTQ-Int4 / quantize_config.json

Commit History

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True

f2ab490
verified

xtristan commited on Jul 27