Upload README.md
Browse files
README.md
CHANGED
@@ -92,7 +92,7 @@ You are a helpful, respectful and honest assistant. Always answer as helpfully a
|
|
92 |
<!-- README_AWQ.md-provided-files start -->
|
93 |
## Provided files and AWQ parameters
|
94 |
|
95 |
-
For my first release of AWQ models, I am releasing 128g models only. I will consider adding 32g as well if there is interest, and once I have done perplexity and evaluation comparisons.
|
96 |
|
97 |
Models are released as sharded safetensors files.
|
98 |
|
|
|
92 |
<!-- README_AWQ.md-provided-files start -->
|
93 |
## Provided files and AWQ parameters
|
94 |
|
95 |
+
For my first release of AWQ models, I am releasing 128g models only. I will consider adding 32g as well if there is interest, and once I have done perplexity and evaluation comparisons, but at this time 32g models are still not fully tested with AutoAWQ and vLLM.
|
96 |
|
97 |
Models are released as sharded safetensors files.
|
98 |
|