Update README.md
Browse files
README.md
CHANGED
@@ -47,7 +47,7 @@ Compiling on Windows: developer cmp-nct notes: 'I personally compile it using VS
|
|
47 |
|
48 |
Once compiled you can then use `bin/falcon_main` just like you would use llama.cpp. For example:
|
49 |
```
|
50 |
-
bin/falcon_main -t 8 -ngl 100 -b 1 -m
|
51 |
```
|
52 |
|
53 |
You can specify `-ngl 100` regardles of your VRAM, as it will automatically detect how much VRAM is available to be used.
|
|
|
47 |
|
48 |
Once compiled you can then use `bin/falcon_main` just like you would use llama.cpp. For example:
|
49 |
```
|
50 |
+
bin/falcon_main -t 8 -ngl 100 -b 1 -m wizard-falcon40b.ggmlv3.q3_K_S.bin -p "What is a falcon?\n### Response:"
|
51 |
```
|
52 |
|
53 |
You can specify `-ngl 100` regardles of your VRAM, as it will automatically detect how much VRAM is available to be used.
|