---
license: mit
tags:
- auto-gptq
---

This model should use [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ) so inference from Hugging face might not working