Can anyone make ggml 4bit version of this?

#5
by Sosaka - opened

Can anyone convert it to ggml and quantize to 4bit? 🥺

This model is not loading.

Sign up or log in to comment