Hi, thank you for creating this amazing model.Would you mind updating the GGUF models to the latest version? This way I can compare the 8-bit and 4-bit performance to the original fp16. Thanks again!
· Sign up or log in to comment
