4-bit GPTQ quantization of [VicUnlocked-alpaca-65b](https://huggingface.co/Aeala/VicUnlocked-alpaca-65b-QLoRA)

**Important Note**: While this is trained on a cleaned ShareGPT dataset like Vicuna used, this was trained in the *Alpaca* format, so prompting should be something like:

```
### Instruction:

<prompt> (without the <>)

### Response:
```
{}
transformers llama text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

4-bit GPTQ quantization of VicUnlocked-alpaca-65b

Important Note: While this is trained on a cleaned ShareGPT dataset like Vicuna used, this was trained in the *Alpaca* format, so prompting should be something like:


TAGS
#transformers #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
