Upload README.md
Browse files
README.md
CHANGED
@@ -77,7 +77,7 @@ Multiple quantisation parameters are provided, to allow you to choose the best o
|
|
77 |
|
78 |
Each separate quant is in a different branch. See below for instructions on fetching from different branches.
|
79 |
|
80 |
-
All GPTQ files are made with AutoGPTQ.
|
81 |
|
82 |
<details>
|
83 |
<summary>Explanation of GPTQ parameters</summary>
|
@@ -128,7 +128,7 @@ It is strongly recommended to use the text-generation-webui one-click-installers
|
|
128 |
6. In the **Model** dropdown, choose the model you just downloaded: `OpenBuddy-Llama2-13B-v11.1-GPTQ`
|
129 |
7. The model will automatically load, and is now ready for use!
|
130 |
8. If you want any custom settings, set them and then click **Save settings for this model** followed by **Reload the Model** in the top right.
|
131 |
-
* Note that you do not need to set GPTQ parameters any more. These are set automatically from the file `quantize_config.json`.
|
132 |
9. Once you're ready, click the **Text Generation tab** and enter a prompt to get started!
|
133 |
<!-- README_GPTQ.md-text-generation-webui end -->
|
134 |
|
|
|
77 |
|
78 |
Each separate quant is in a different branch. See below for instructions on fetching from different branches.
|
79 |
|
80 |
+
All recent GPTQ files are made with AutoGPTQ, and all files in non-main branches are made with AutoGPTQ. Files in the `main` branch which were uploaded before August 2023 were made with GPTQ-for-LLaMa.
|
81 |
|
82 |
<details>
|
83 |
<summary>Explanation of GPTQ parameters</summary>
|
|
|
128 |
6. In the **Model** dropdown, choose the model you just downloaded: `OpenBuddy-Llama2-13B-v11.1-GPTQ`
|
129 |
7. The model will automatically load, and is now ready for use!
|
130 |
8. If you want any custom settings, set them and then click **Save settings for this model** followed by **Reload the Model** in the top right.
|
131 |
+
* Note that you do not need to and should not set manual GPTQ parameters any more. These are set automatically from the file `quantize_config.json`.
|
132 |
9. Once you're ready, click the **Text Generation tab** and enter a prompt to get started!
|
133 |
<!-- README_GPTQ.md-text-generation-webui end -->
|
134 |
|