Update README.md
Browse files
README.md
CHANGED
|
@@ -56,7 +56,7 @@ This repo contains AWQ model files for [VAGO solutions's SauerkrautLM Mixtral 8X
|
|
| 56 |
|
| 57 |
**MIXTRAL AWQ**
|
| 58 |
|
| 59 |
-
This is a Mixtral AWQ model. With a slightly better quantisation
|
| 60 |
|
| 61 |
For AutoAWQ inference, please install AutoAWQ 0.1.8 or later.
|
| 62 |
|
|
|
|
| 56 |
|
| 57 |
**MIXTRAL AWQ**
|
| 58 |
|
| 59 |
+
This is a Mixtral AWQ model. With a slightly better 4-bit quantisation with a group size of 32 compared to TheBoke's AWQ quant with gs 128.
|
| 60 |
|
| 61 |
For AutoAWQ inference, please install AutoAWQ 0.1.8 or later.
|
| 62 |
|