GGUF version please

by HR1777 - opened Apr 30

HR1777

Apr 30

Could you please release the GGUF version of this model too?

Owner May 1

•

Hi, I've uploaded the GGUF model (Q8 and Q4_K_M) here. Quantizing llm for the first time, let me know if it works for you.

HR1777

May 1

Thank you so much. I am downloading them now.

HR1777 changed discussion status to closed May 1

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment