metadata
license: cc-by-nc-4.0
Noromaid-13b-v0.3 2bit QUIP#
Description
QUIP quant of NeverSleep/Noromaid-13b-v0.3
I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and with all applications running as usual my vram usage is just above 6gigs, so it's tiny.
Other quants:
Prompt Format
Silly Tavern Preset
Alpaca:
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Input:
{input}
### Response:
Contact
Kooten on discord