| Qwen2.5-14B-Instruct | |
| Quant Size (MB) PPL Size (%) Accuracy (%) PPL error rate | |
| IQ1_S 3441 22.0082 0.16818 | |
| IQ1_M 3693 15.0790 0.11060 | |
| IQ2_XXS 4114 9.6047 0.06625 | |
| IQ2_XS 4487 8.3649 0.05574 | |
| IQ2_S 4772 8.1942 0.05480 | |
| IQ2_M 5109 7.7261 0.05177 | |
| Q2_K_S 5148 8.0641 0.05490 | |
| Q2_K 5504 7.6005 0.05146 | |
| IQ3_XXS 5672 6.9285 0.04547 | |
| IQ3_XS 6088 6.7210 0.04329 | |
| Q3_K_S 6352 6.8697 0.04576 | |
| IQ3_S 6383 6.6246 0.04285 | |
| IQ3_M 6597 6.6359 0.04256 | |
| Q3_K_M 7000 6.5281 0.04300 | |
| Q3_K_L 7558 6.4323 0.04211 | |
| IQ4_XS 7744 6.2005 0.04022 | |
| Q4_0 8149 6.2928 0.04095 | |
| IQ4_NL 8154 6.2080 0.04032 | |
| Q4_K_S 8177 6.1630 0.03976 | |
| Q4_K_M 8572 6.1311 0.03957 | |
| Q4_1 8958 6.1674 0.03981 | |
| Q5_K_S 9791 6.0411 0.03886 | |
| Q5_0 9817 6.0504 0.03895 | |
| Q5_K_M 10023 6.0389 0.03888 | |
| Q5_1 10625 6.0366 0.03885 | |