stan-hua
/

Phi-3-small-7B-Instruct-GPTQ-4bit

Text Generation

4-bit precision

Model card Files Files and versions Community

Phi-3-small-7B-Instruct-GPTQ-4bit / generation_config.json

Commit History

GPTQ model for microsoft/Phi-3-small-8k-instruct: {'bits': 4, 'dataset': 'c4', 'group_size': 128, 'desc_act': False}

5d6c698
verified

stan-hua commited on Jun 7