perplexity.md

Qwen2.5-14B-Instruct
Quant	Size (MB)	PPL	Size (%)	Accuracy (%)	PPL error rate
IQ1_S	3441	22.0082			0.16818
IQ1_M	3693	15.0790			0.11060
IQ2_XXS	4114	9.6047			0.06625
IQ2_XS	4487	8.3649			0.05574
IQ2_S	4772	8.1942			0.05480
IQ2_M	5109	7.7261			0.05177
Q2_K_S	5148	8.0641			0.05490
Q2_K	5504	7.6005			0.05146
IQ3_XXS	5672	6.9285			0.04547
IQ3_XS	6088	6.7210			0.04329
Q3_K_S	6352	6.8697			0.04576
IQ3_S	6383	6.6246			0.04285
IQ3_M	6597	6.6359			0.04256
Q3_K_M	7000	6.5281			0.04300
Q3_K_L	7558	6.4323			0.04211
IQ4_XS	7744	6.2005			0.04022
Q4_0	8149	6.2928			0.04095
IQ4_NL	8154	6.2080			0.04032
Q4_K_S	8177	6.1630			0.03976
Q4_K_M	8572	6.1311			0.03957
Q4_1	8958	6.1674			0.03981
Q5_K_S	9791	6.0411			0.03886
Q5_0	9817	6.0504			0.03895
Q5_K_M	10023	6.0389			0.03888
Q5_1	10625	6.0366			0.03885