failed GGML_ASSERT for vocab (GGUF with Llama.cpp)

#2
by newsletter - opened

I'm running into a failed assert when using Llama.cpp and the Q6 GGUF quant I created:
GGML_ASSERT: D:\a\LLamaSharp\LLamaSharp\llama.cpp:4443: vocab.id_to_token.size() == vocab.token_to_id.size()

Is there an easy fix like editing the tokenizer.json?

Sign up or log in to comment