Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ license: cc-by-nc-4.0
|
|
7 |
## Description
|
8 |
QUIP quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)
|
9 |
|
10 |
-
I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and with all applications running as usual my vram usage is just above 6gigs so it's tiny.
|
11 |
|
12 |
## Other quants:
|
13 |
EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2)
|
|
|
7 |
## Description
|
8 |
QUIP quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)
|
9 |
|
10 |
+
I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and with all applications running as usual my vram usage is just above 6gigs, so it's tiny.
|
11 |
|
12 |
## Other quants:
|
13 |
EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2)
|