GGUF conversion assistance?

by FiditeNemini - opened Jul 10

Jul 10

Hiya. I've been trying to port this and dolphin-vision to GGUF and am having a bit of a block. I'm running into an error NotImplementedError: Architecture 'BunnyQwenForCausalLM' not supported! I think I know where to add it in the llama.cpp code, but don't have the right parameters to set. Could you perhaps give me a pointer or two?

mahiatlinux

Jul 10

@FiditeNemini The creator, @qnguyen3 , is working on it I think.

FiditeNemini

Jul 10

Thanks.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment