IQ3_XXS is more suitable for 16G RAM device so if you like to create a IQ3_XXS quant?
Ohh, that's due to a typo in my quantization script (XSS instead of XXS).Will do!
Edit:Done!
· Sign up or log in to comment