I am loading the Q_4_M model on Koboldcpp latest version
disable mmquse flashattention
Thank you !
· Sign up or log in to comment