error

#1
by mirek190 - opened

llama_model_load: error loading model: check_tensor_dims: tensor 'blk.0.attn_q.weight' has wrong shape; expected 5120, 5120, got 5120, 4096, 1, 1
llama_load_model_from_file: failed to load model
llama_init_from_gpt_params: error: failed to load model 'models/new3/Mistral-Nemo-Instruct-2407.Q8_00.gguf'
main: error: unable to load model

Sign up or log in to comment