Update README.md
Browse files
README.md
CHANGED
@@ -106,7 +106,7 @@ It is strongly recommended to use the text-generation-webui one-click-installers
|
|
106 |
|
107 |
ExLlama has now been updated to support Llama 2 70B, but you will need to update ExLlama to the latest version.
|
108 |
|
109 |
-
By default text-generation-webui installs a pre-compiled wheel for ExLlama. Until text-generation-webui updates to reflect the ExLlama changes - which hopefully won't be long - you must uninstall that and then
|
110 |
|
111 |
Note that this requires that your system is capable of compiling CUDA extensions, which may be an issue on Windows.
|
112 |
|
|
|
106 |
|
107 |
ExLlama has now been updated to support Llama 2 70B, but you will need to update ExLlama to the latest version.
|
108 |
|
109 |
+
By default text-generation-webui installs a pre-compiled wheel for ExLlama. Until text-generation-webui updates to reflect the ExLlama changes - which hopefully won't be long - you must uninstall that and then update ExLlama in the `text-generation-webui/repositories` directory. ExLlama will then compile its kernel on model load.
|
110 |
|
111 |
Note that this requires that your system is capable of compiling CUDA extensions, which may be an issue on Windows.
|
112 |
|