seonglae
/

opt-125m-4bit-gptq

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

seonglae commited on Jul 8, 2023

Commit

00f146a

•

1 Parent(s): 8a914b1

docs: notify inference from hugginf face workability

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -2,4 +2,6 @@
 license: mit
 tags:
 - auto-gptq
----

 license: mit
 tags:
 - auto-gptq
+---
+This model should use [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ) so inference from Hugging face might not working