Getting 'wrong number of tensors' error on loading the model

#2
by RazielAU - opened

I keep getting the following error when trying to load the model, I've tried downloading two different versions, so it's not just a bad download, error message as below:
llama_model_load: error loading model: done_getting_tensors: wrong number of tensors; expected 724, got 723

I've tried updating Oobabooga just to see if it would make a difference, but it's up to date. With that said, I don't know if they've updated all the appropriate libraries yet. Is this a matter of waiting for a software update on the Oobabooga side, or am I doing something wrong?

"llama.cpp error: 'done_getting_tensors: wrong number of tensors; expected 292, got 291'"
up llama.cpp >= 3482 (e54c35e4)
This issue has been resolved.
LM Studio 0.2.29 now supports

@aifeifei798 Awesome, if I got you correctly, you're saying it's a case of software needing to be updated, and LM Studio has been updated for Llama 3.1.

RazielAU changed discussion status to closed

Sign up or log in to comment