shuttleai
/

shuttle-2.5-mini-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

shuttle-2.5-mini-GPTQ-Int4

Commit History

Tokenizers

264c792
verified

xtristan commited on Jul 27

Upload model.safetensors.index.json with huggingface_hub

c12ece0
verified

xtristan commited on Jul 27

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True

f2ab490
verified

xtristan commited on Jul 27

initial commit

0c749a5
verified

xtristan commited on Jul 27