TheBloke
/

manticore-13b-chat-pyg-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

manticore-13b-chat-pyg-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support

923f272

TheBloke commited on Aug 21, 2023

Create quantize_config.json

08d7fc6

TheBloke commited on Jun 8, 2023