gguf weight ?
#2
by
wukongai
- opened
Could any expert please help to create the gguf quantified weights for this model? I would be very grateful!
...still waiting for gglm ...
@senseable made a q4_k_m.gguf
https://huggingface.co/senseable/MoMo-70B-lora-1.8.6-DPO-gguf
@wukongai I'm uploading Q5 and Q6 bits splits now, will probably take over an hour in total
Great job! You’ve worked hard! Thank you both for your excellent work!