TheBloke commited on
Commit
420b445
1 Parent(s): 9fd536a

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -92,7 +92,7 @@ You are a helpful, respectful and honest assistant. Always answer as helpfully a
92
  <!-- README_AWQ.md-provided-files start -->
93
  ## Provided files and AWQ parameters
94
 
95
- For my first release of AWQ models, I am releasing 128g models only. I will consider adding 32g as well if there is interest, and once I have done perplexity and evaluation comparisons.
96
 
97
  Models are released as sharded safetensors files.
98
 
 
92
  <!-- README_AWQ.md-provided-files start -->
93
  ## Provided files and AWQ parameters
94
 
95
+ For my first release of AWQ models, I am releasing 128g models only. I will consider adding 32g as well if there is interest, and once I have done perplexity and evaluation comparisons, but at this time 32g models are still not fully tested with AutoAWQ and vLLM.
96
 
97
  Models are released as sharded safetensors files.
98