Commit
•
78b6e56
1
Parent(s):
ff72f89
Upload perplexity.md
Browse files- perplexity.md +28 -0
perplexity.md
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
Qwen2.5-14B-Instruct
|
| 3 |
+
Quant Size (MB) PPL Size (%) Accuracy (%) PPL error rate
|
| 4 |
+
IQ1_S 3441 22.0082 0.16818
|
| 5 |
+
IQ1_M 3693 15.0790 0.11060
|
| 6 |
+
IQ2_XXS 4114 9.6047 0.06625
|
| 7 |
+
IQ2_XS 4487 8.3649 0.05574
|
| 8 |
+
IQ2_S 4772 8.1942 0.05480
|
| 9 |
+
IQ2_M 5109 7.7261 0.05177
|
| 10 |
+
Q2_K_S 5148 8.0641 0.05490
|
| 11 |
+
Q2_K 5504 7.6005 0.05146
|
| 12 |
+
IQ3_XXS 5672 6.9285 0.04547
|
| 13 |
+
IQ3_XS 6088 6.7210 0.04329
|
| 14 |
+
Q3_K_S 6352 6.8697 0.04576
|
| 15 |
+
IQ3_S 6383 6.6246 0.04285
|
| 16 |
+
IQ3_M 6597 6.6359 0.04256
|
| 17 |
+
Q3_K_M 7000 6.5281 0.04300
|
| 18 |
+
Q3_K_L 7558 6.4323 0.04211
|
| 19 |
+
IQ4_XS 7744 6.2005 0.04022
|
| 20 |
+
Q4_0 8149 6.2928 0.04095
|
| 21 |
+
IQ4_NL 8154 6.2080 0.04032
|
| 22 |
+
Q4_K_S 8177 6.1630 0.03976
|
| 23 |
+
Q4_K_M 8572 6.1311 0.03957
|
| 24 |
+
Q4_1 8958 6.1674 0.03981
|
| 25 |
+
Q5_K_S 9791 6.0411 0.03886
|
| 26 |
+
Q5_0 9817 6.0504 0.03895
|
| 27 |
+
Q5_K_M 10023 6.0389 0.03888
|
| 28 |
+
Q5_1 10625 6.0366 0.03885
|