Commit
•
66213a8
1
Parent(s):
3913b0b
Add presets reminder.
Browse files
README.md
CHANGED
|
@@ -15,6 +15,8 @@ language:
|
|
| 15 |
|
| 16 |
# **GGUF-Imatrix quantizations for [dreamgen/opus-v1.2-7b](https://huggingface.co/dreamgen/opus-v1.2-7b/).**
|
| 17 |
|
|
|
|
|
|
|
| 18 |
# What does "Imatrix" mean?
|
| 19 |
|
| 20 |
It stands for **Importance Matrix**, a technique used to improve the quality of quantized models.
|
|
|
|
| 15 |
|
| 16 |
# **GGUF-Imatrix quantizations for [dreamgen/opus-v1.2-7b](https://huggingface.co/dreamgen/opus-v1.2-7b/).**
|
| 17 |
|
| 18 |
+
It's **important to use their [Presets for SillyTavern](https://huggingface.co/dreamgen/opus-v1.2-7b/tree/main/configs/silly_tavern/)** due the peculiar prompt formatting of this model.
|
| 19 |
+
|
| 20 |
# What does "Imatrix" mean?
|
| 21 |
|
| 22 |
It stands for **Importance Matrix**, a technique used to improve the quality of quantized models.
|