shuttleai
/

shuttle-2.5-mini-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

shuttle-2.5-mini-GPTQ-Int4 / gptq_model-4bit-128g.safetensors

Commit History

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True

f2ab490
verified

xtristan commited on Jul 27