Run Infer the fine-tuned model, then display error

#12
by hongbaoai - opened

File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1688, in getattr
raise AttributeError(f"'{type(self).name}' object has no attribute '{name}'")
AttributeError: 'LlamaAttention' object has no attribute 'apply_qkv'

image.png

Thanks for your question! However, it seems that the model you used is not our fine-tuned model? Despite that, you could try to use the code we provide in the usage part. Remember to ensure that the Llama3-8B-Chinese-Chat model you use is after the commit id d96a030dcd8a9143e217cfd77fec6228e69c07c3. Thank you very much!

shenzhi-wang changed discussion status to closed

Sign up or log in to comment