rahuldshetty commited on
Commit
4c1410f
1 Parent(s): a74d6bb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -14,6 +14,7 @@ GGUF Quantized version of [gemma-7b-it](https://huggingface.co/google/gemma-7b-i
14
  | Name | Quant method | Bits | Size | Use case |
15
  | ---- | ---- | ---- | ---- | ----- |
16
  | [gemma-7b-it-Q4_K_M.gguf](https://huggingface.co/rahuldshetty/gemma-7b-it-gguf-quantized/blob/main/gemma-7b-it-Q4_K_M.gguf) | Q4_K_M | 4 | 5.13 GB | medium, balanced quality - recommended |
 
17
 
18
 
19
  # Gemma Model Card (Taken from Official HF Repo)
 
14
  | Name | Quant method | Bits | Size | Use case |
15
  | ---- | ---- | ---- | ---- | ----- |
16
  | [gemma-7b-it-Q4_K_M.gguf](https://huggingface.co/rahuldshetty/gemma-7b-it-gguf-quantized/blob/main/gemma-7b-it-Q4_K_M.gguf) | Q4_K_M | 4 | 5.13 GB | medium, balanced quality - recommended |
17
+ | [gemma-7b-it-Q8_0.gguf](https://huggingface.co/rahuldshetty/gemma-7b-it-gguf-quantized/blob/main/gemma-7b-it-Q8_0.gguf) | Q8_0 | 8 | 9.08 GB | very large, extremely low quality loss - not recommended |
18
 
19
 
20
  # Gemma Model Card (Taken from Official HF Repo)