Failed to load model - Apple Silicon M1

#1
by Roronin - opened

I tried to use it on MacBook Pro with Apple Silicon M1 but failed

  • LM Studio:
    LM Studio Failed to load model
    Error message
    "llama.cpp error: 'error loading model vocabulary: unknown pre-tokenizer type: 'refact''"

  • llama.cpp:
    llama_model_load: error loading model: done_getting_tensors: wrong number of tensors; expected 578, got 470

https://github.com/ggerganov/llama.cpp/issues/7116 Still waiting for support in llama.cpp.

YorkieOH10 changed discussion status to closed

Sign up or log in to comment