Update README.md
Browse files
README.md
CHANGED
@@ -8,10 +8,8 @@ license: other
|
|
8 |
- **[Large Context Size (~18k)](https://i.ibb.co/tLLGLNc/image.jpg)**
|
9 |
- **[4-Bit Quantization](https://arxiv.org/pdf/2210.17323.pdf)**
|
10 |
## Composition
|
11 |
-
Manticore-13b-Landmark-GPTQ is a
|
12 |
-
- [Manticore-13B](https://huggingface.co/
|
13 |
-
- [Manticore-13B-Landmark-QLoRA](https://huggingface.co/Honkware/Manticore-13b-Landmark-QLoRA)
|
14 |
-
- [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ)
|
15 |
## Using [Oobabooga](https://github.com/oobabooga/text-generation-webui)
|
16 |
- Trust Remote Code - **(Enabled)**
|
17 |
- Add the bos_token to the beginning of prompts - **(Disabled)**
|
|
|
8 |
- **[Large Context Size (~18k)](https://i.ibb.co/tLLGLNc/image.jpg)**
|
9 |
- **[4-Bit Quantization](https://arxiv.org/pdf/2210.17323.pdf)**
|
10 |
## Composition
|
11 |
+
Manticore-13b-Landmark-GPTQ is a 4-bit quantization of:
|
12 |
+
- [Manticore-13B-Landmark](https://huggingface.co/Honkware/Manticore-13b-Landmark)
|
|
|
|
|
13 |
## Using [Oobabooga](https://github.com/oobabooga/text-generation-webui)
|
14 |
- Trust Remote Code - **(Enabled)**
|
15 |
- Add the bos_token to the beginning of prompts - **(Disabled)**
|