Commit
•
3d96af0
1
Parent(s):
cf9fed4
Update README.md
Browse files
README.md
CHANGED
|
@@ -25,7 +25,7 @@ This repository includes the quantized models for the [meow](https://huggingface
|
|
| 25 |
|
| 26 |
## Current models
|
| 27 |
|
| 28 |
-
| exl2 BPW | Model Branch | Model Size | Minimum VRAM (4096 Context) |
|
| 29 |
|-|-|-|-|
|
| 30 |
| 2-Bit | main | 3.28 GB | 6GB GPU |
|
| 31 |
| 4-Bit | 4bit | 5.61 GB | 8GB GPU |
|
|
|
|
| 25 |
|
| 26 |
## Current models
|
| 27 |
|
| 28 |
+
| exl2 BPW | Model Branch | Model Size | Minimum VRAM (4096 Context, fp16 cache) |
|
| 29 |
|-|-|-|-|
|
| 30 |
| 2-Bit | main | 3.28 GB | 6GB GPU |
|
| 31 |
| 4-Bit | 4bit | 5.61 GB | 8GB GPU |
|