unsloth

/

Llama-3.2-3B-Instruct-GGUF

like 25

Follow

Unsloth AI 495

Hi !
Would you please upload 11b instruct gguf?

thanks in advance

Hey so currently you aren't able to run vision models via GGUF because llama.cpp doesn't support it so there's not really a point in doing so. But will update you when it happens

What about llama-llava-cli?
How much code change does it need to support llama 3.2?

What about llama-llava-cli?
How much code change does it need to support llama 3.2?

I think Llava works already. A lot of code changes will be needed to run Llama 3.2 Vision models. You can contribute to the llama.cpp repo if you'd like to help! :)

We will however make it available to work in Unsloth soon however hopefully.