Can anyone make ggml 4bit version of this?
#5
by
Sosaka
- opened
Can anyone convert it to ggml and quantize to 4bit? 🥺
This model is not loading.
Can anyone convert it to ggml and quantize to 4bit? 🥺
This model is not loading.