Convert to GGUF model

#9
by Wangderful - opened

Has anyone tried to convert the trained model to GGUF model format? It needs to GGUF model: the vision model and the proejctor model. How to covert to two models? Does anyone has any ideas?

@Wangderful there are already gguf versions
https://huggingface.co/cjpais/llava-1.6-mistral-7b-gguf

I woudn't recommend it too much since llava 1.6 is pretty old. Try using llava next interleave or internvl2. Both are great options.

@YaTharThShaRma999 Thank you very much! I will try the lava next interleave. Could you please clarify what internvl2 is? Is that the LLaVA-NeXT-Video shown in the github repository? But it seems the code is not available now.

Sign up or log in to comment