TheBloke commited on
Commit
0f75c61
1 Parent(s): f68a2b0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -106,7 +106,7 @@ It is strongly recommended to use the text-generation-webui one-click-installers
106
 
107
  ExLlama has now been updated to support Llama 2 70B, but you will need to update ExLlama to the latest version.
108
 
109
- By default text-generation-webui installs a pre-compiled wheel for ExLlama. Until text-generation-webui updates to reflect the ExLlama changes - which hopefully won't be long - you must uninstall that and then clone ExLlama into the `text-generation-webui/repositories` directory. ExLlama will then compile its kernel on model load.
110
 
111
  Note that this requires that your system is capable of compiling CUDA extensions, which may be an issue on Windows.
112
 
 
106
 
107
  ExLlama has now been updated to support Llama 2 70B, but you will need to update ExLlama to the latest version.
108
 
109
+ By default text-generation-webui installs a pre-compiled wheel for ExLlama. Until text-generation-webui updates to reflect the ExLlama changes - which hopefully won't be long - you must uninstall that and then update ExLlama in the `text-generation-webui/repositories` directory. ExLlama will then compile its kernel on model load.
110
 
111
  Note that this requires that your system is capable of compiling CUDA extensions, which may be an issue on Windows.
112