altomek
/

shuttle-2.5-mini-8bpw-EXL2

8-bit precision

Model card Files Files and versions Community

Edit model card

shuttle-2.5-mini

ExLlamav2 8 bpw quants of https://huggingface.co/shuttleai/shuttle-2.5-mini

Downloads last month: 2

Inference API

Inference API (serverless) has been turned off for this model.

Model tree for altomek/shuttle-2.5-mini-8bpw-EXL2

Base model

shuttleai/shuttle-2.5-mini

Quantized

this model