A good 7B quant
#1
by
aaha
- opened
@MaziyarPanahi One request - Could you also quant the Samantha westlake that has been released? https://huggingface.co/cognitivecomputations/samantha-1.1-westlake-7b
Thanks!
Hi
@aaha
Sure, here are the quant models for samantha-1.1-westlake-7b:
- GGUF: https://huggingface.co/MaziyarPanahi/samantha-1.1-westlake-7b-GGUF
- AWQ: https://huggingface.co/MaziyarPanahi/samantha-1.1-westlake-7b-AWQ
- GPTQ: https://huggingface.co/MaziyarPanahi/samantha-1.1-westlake-7b-GPTQ
I love the models coming out of cognitivecomputations! :)