pseelam
/

Mistral-7B-Instruct-v0.3-AutoGPTQ

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-AutoGPTQ

2 contributors

History: 3 commits

pseelam's picture

Use llama.cpp(convert.py) to run inference on this model

5c5b2b2 verified 4 months ago