GGUF version?

#9
by shtirlic - opened

Is there GGUF version somewhere?

I guess not

no ggufs yet

There are GGUFs for medium and mini, but small is still WIP as it needs implementation.
See https://github.com/ggerganov/llama.cpp/issues/7439

@LeeStott
@hardikmodi

Can you please push your team to support small and vision on llama.cpp?

nguyenbh changed discussion status to closed

Sign up or log in to comment