TheBloke
/

Mistral-7B-OpenOrca-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Mistral-7B-OpenOrca-GPTQ

3 contributors

History: 10 commits

TheBloke's picture

jlzhou's picture

fix: quantize param in TGI example (#8)

bbedaae about 1 year ago