This is a GPTQ 4-bit version of [WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b](https://huggingface.co/Monero/WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b)

Quanitized using commit `df77083` of GPTA-for-LLaMa with the following settings: 
```wikitext2 --wbits 4 --true-sequential --act-order --save_safetensors```

Tested in oobabooga using the GPTQ triton branch. No guarantees on compatibility.

---
license: other
---

{}
transformers pytorch llama text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

This is a GPTQ 4-bit version of WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b

Quanitized using commit 'df77083' of GPTA-for-LLaMa with the following settings: 


Tested in oobabooga using the GPTQ triton branch. No guarantees on compatibility.

---
license: other
---

TAGS
#transformers #pytorch #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
