shuttleai
/

shuttle-2.5-mini-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

shuttle-2.5-mini-GPTQ-Int4

1 contributor

History: 5 commits

xtristan's picture

Create README.md

31dd7f5 verified 4 months ago

.gitattributes

1.52 kB

initial commit 4 months ago
README.md

2.56 kB

Create README.md 4 months ago
config.json

988 Bytes

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True 4 months ago
gptq_model-4bit-128g.safetensors

8.36 GB
LFS

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True 4 months ago
model.safetensors.index.json

187 kB

Upload model.safetensors.index.json with huggingface_hub 4 months ago
quantize_config.json

265 Bytes

AutoGPTQ model for shuttleai/shuttle-2.5-mini: 4bits, gr128, desc_act=True 4 months ago
special_tokens_map.json

552 Bytes

Tokenizers 4 months ago
tokenizer.json

9.26 MB

Tokenizers 4 months ago
tokenizer_config.json

178 kB

Tokenizers 4 months ago