pseelam
/

Mistral-7B-Instruct-v0.3-AutoGPTQ

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-AutoGPTQ / README.md

Commit History

Use llama.cpp(convert.py) to run inference on this model

5c5b2b2
verified

pseelam commited on Jul 23