shuttleai
/

shuttle-2.5-mini-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

shuttle-2.5-mini-GPTQ-Int4

1 contributor

History: 2 commits

xtristan's picture

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True

f2ab490 verified 4 months ago

.gitattributes

1.52 kB

initial commit 4 months ago
config.json

988 Bytes

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True 4 months ago
gptq_model-4bit-128g.safetensors

8.36 GB
LFS

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True 4 months ago
quantize_config.json

265 Bytes

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True 4 months ago