Hugging Face's logo

shuttleai
/
shuttle-2.5-mini-GPTQ-Int4

Text Generation
Transformers
Safetensors
mistral
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
shuttle-2.5-mini-GPTQ-Int4 / config.json

Commit History

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True
f2ab490
verified

xtristan commited on