Update README.md
Browse files
README.md
CHANGED
@@ -65,7 +65,7 @@ Compiling on Windows: developer cmp-nct notes: 'I personally compile it using VS
|
|
65 |
|
66 |
Once compiled you can then use `bin/falcon_main` just like you would use llama.cpp. For example:
|
67 |
```
|
68 |
-
bin/falcon_main -t 8 -ngl 100 -b 1 -m
|
69 |
```
|
70 |
|
71 |
You can specify `-ngl 100` regardles of your VRAM, as it will automatically detect how much VRAM is available to be used.
|
|
|
65 |
|
66 |
Once compiled you can then use `bin/falcon_main` just like you would use llama.cpp. For example:
|
67 |
```
|
68 |
+
bin/falcon_main -t 8 -ngl 100 -b 1 -m h2ogpt-falcon-40b.ggmlv3.q3_k.bin -p "What is a falcon?\n### Response:"
|
69 |
```
|
70 |
|
71 |
You can specify `-ngl 100` regardles of your VRAM, as it will automatically detect how much VRAM is available to be used.
|