InternLMGPTQForCausalLM hasn't fused attention module yet, will skip inject fused attention. InternLMGPTQForCausalLM hasn't fused mlp module yet, will skip inject fused mlp.
#2 opened about 1 year ago
by
11011Free
TypeError: internlm isn't supported yet
1
#1 opened over 1 year ago
by
yuxuan2022