iproskurina
/

Mistral-7B-v0.3-gptq-3bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mistral-7B-v0.3-gptq-3bit / quantize_config.json

Commit History

AutoGPTQ model for mistralai/Mistral-7B-v0.3: 3bits, gr128, desc_act=False

125d947
verified

iproskurina commited on Sep 25