README.md

---
license: cc-by-nc-4.0
---

# Noromaid-13b-v0.3 2bit QUIP#

## Description
QUIP quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)

I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and with all applications running as usual my vram usage is just above 6gigs, so it's tiny.

## Other quants:
EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2)


## Prompt Format
### Silly Tavern Preset
[Instruct template](https://files.catbox.moe/nzygwn.json)

[Context template](https://files.catbox.moe/l5hguf.json)

### Alpaca:
```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Input:
{input}

### Response:

```

## Contact
Kooten on discord