---
license: unknown
language:
- en
---
I have converted the thing in GPTQ-v2

Group size 128 for one

Act order for another

and neither for a third

Let's see how many I upload. 
I am also converting it to GGML right now to see if it runs on CPU.