---
tags:
- llama
- alpaca
- mix
- gptq
- quant
---
GPTQ 4 bit 128 groupsize quantization of https://huggingface.co/digitous/13B-HyperMantis