rozek commited on
Commit
735431d
1 Parent(s): 723d438

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -109,7 +109,7 @@ python3 convert.py ../LLaMA-2-7B-32K-Instruct
109
  10. you are now ready to run the actual quantization, e.g., using<br>
110
  ```
111
  ./quantize ../LLaMA-2-7B-32K-Instruct/ggml-model-f16.gguf \
112
- ../LLaMA-2-7B-32K/LLaMA-2-7B-32K-Instruct-Q4_0.gguf Q4_0
113
  ```
114
  11. run any quantizations you need and stop the container when finished (the container will automatically
115
  be deleted but the generated files will remain available on your host computer)
 
109
  10. you are now ready to run the actual quantization, e.g., using<br>
110
  ```
111
  ./quantize ../LLaMA-2-7B-32K-Instruct/ggml-model-f16.gguf \
112
+ ../LLaMA-2-7B-32K-Instruct/LLaMA-2-7B-32K-Instruct-Q4_0.gguf Q4_0
113
  ```
114
  11. run any quantizations you need and stop the container when finished (the container will automatically
115
  be deleted but the generated files will remain available on your host computer)