GPTQ model for microsoft/Phi-3-small-8k-instruct: {'bits': 4, 'dataset': 'c4', 'group_size': 128, 'desc_act': False}

5d6c698

verified

stan-hua commited on Jun 7