DeusImperator
commited on
Commit
•
faeafcd
1
Parent(s):
6a8bd51
Upload README.md
Browse files
README.md
CHANGED
@@ -25,7 +25,7 @@ model-index:
|
|
25 |
|
26 |
This is a 4.6bpw EXL2 quant of [EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2](https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2)
|
27 |
|
28 |
-
This quant was made using exllamav2-0.3
|
29 |
|
30 |
I tested this quant shortly in some random RPs (including ones over 8-12k context) and it seems to work fine.
|
31 |
|
|
|
25 |
|
26 |
This is a 4.6bpw EXL2 quant of [EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2](https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2)
|
27 |
|
28 |
+
This quant was made using exllamav2-0.2.3 with default dataset and slightly extended quantization sample length (4k instead of default 2k).
|
29 |
|
30 |
I tested this quant shortly in some random RPs (including ones over 8-12k context) and it seems to work fine.
|
31 |
|