Kooten commited on
Commit
cf4ac52
1 Parent(s): 17076b4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -7,7 +7,7 @@ license: cc-by-nc-4.0
7
  ## Description
8
  QUIP quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)
9
 
10
- I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and with all applications running as usual my vram usage is just above 6gigs so it's tiny.
11
 
12
  ## Other quants:
13
  EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2)
 
7
  ## Description
8
  QUIP quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)
9
 
10
+ I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and with all applications running as usual my vram usage is just above 6gigs, so it's tiny.
11
 
12
  ## Other quants:
13
  EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2)