Commit
•
43a4a0c
1
Parent(s):
0d92d86
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,6 +7,8 @@ This is setup for a Windows machine with 8GB of VRAM, assuming use with an NVIDI
|
|
| 7 |
|
| 8 |
Your `imatrix.txt` is expected to be located inside the `imatrix` folder. Included file is considered a good option, [this discussion](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384) is where it came from.
|
| 9 |
|
|
|
|
|
|
|
| 10 |
**Requirements:**
|
| 11 |
- Python 3.11
|
| 12 |
- `pip install huggingface_hub`
|
|
|
|
| 7 |
|
| 8 |
Your `imatrix.txt` is expected to be located inside the `imatrix` folder. Included file is considered a good option, [this discussion](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384) is where it came from.
|
| 9 |
|
| 10 |
+
Adjust `quantization_options` in **line 133**.
|
| 11 |
+
|
| 12 |
**Requirements:**
|
| 13 |
- Python 3.11
|
| 14 |
- `pip install huggingface_hub`
|