Hugging Face's logo

TheBloke
/
baichuan-7B-GPTQ

Text Generation
Transformers
Safetensors
baichuan
custom_code
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
4
TheBloke commited on
Commit
4ea20c1
•
1 Parent(s): 1621bec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -115,7 +115,7 @@ print(tokenizer.decode(pred.cpu()[0], skip_special_tokens=True))
115
  This will work only with [AutoGPTQ using LaaZa's PR](https://github.com/PanQiWei/AutoGPTQ/pull/164).
116
 
117
  * `gptq_model-4bit-128g.safetensors`
118
- * Works only with AutoGPTQ, using PR.
119
  * Requires `trust_remote_code`.
120
  * Works with text-generation-webui, but not yet with one-click-installers unless you manually re-compile AutoGPTQ.
121
  * Parameters: Groupsize = 128. Act Order / desc_act = False.
 
115
  This will work only with [AutoGPTQ using LaaZa's PR](https://github.com/PanQiWei/AutoGPTQ/pull/164).
116
 
117
  * `gptq_model-4bit-128g.safetensors`
118
+ * Works only with AutoGPTQ, currently requiring using [LaaZa's PR](https://github.com/PanQiWei/AutoGPTQ/pull/164).
119
  * Requires `trust_remote_code`.
120
  * Works with text-generation-webui, but not yet with one-click-installers unless you manually re-compile AutoGPTQ.
121
  * Parameters: Groupsize = 128. Act Order / desc_act = False.