Update README.md
Browse filesClarification and sysprompt update
README.md
CHANGED
@@ -12,13 +12,15 @@ license: apache-2.0
|
|
12 |
# Magnolia-v1-12B
|
13 |
|
14 |
This repo contains a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
|
|
15 |
Instruct was added in at low weight in order to increase the steerability of the model;
|
16 |
safety has consequently been reinforced.
|
17 |
|
18 |
Tested at temperature 0.7 and minP 0.01, with ChatML prompting.
|
19 |
|
20 |
-
Mistral Nemo models tend to have repetition issues in general. For this model at least,
|
21 |
```
|
|
|
22 |
Ensure that all punctuation rules are adhered to without the introduction of spurious intervening spaces.
|
23 |
Avoid redundant phrasing and maintain forward narrative progression by utilizing varied sentence structure, alternative word choices, and active voice.
|
24 |
Employ descriptive details judiciously, ensuring they serve a purpose in advancing the story or revealing character or touching upon setting.
|
|
|
12 |
# Magnolia-v1-12B
|
13 |
|
14 |
This repo contains a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
15 |
+
The base is a merge of two models trained for variety in text generation.
|
16 |
Instruct was added in at low weight in order to increase the steerability of the model;
|
17 |
safety has consequently been reinforced.
|
18 |
|
19 |
Tested at temperature 0.7 and minP 0.01, with ChatML prompting.
|
20 |
|
21 |
+
Mistral Nemo models tend to have repetition issues in general. For this model at least, various issues can be mitigated somewhat with additional sysprompting, e.g.:
|
22 |
```
|
23 |
+
No passage shall exceed 10 lines of text, with turns limited to a maximum of 5 lines per speaker to ensure snappy and engaging dialog and action.
|
24 |
Ensure that all punctuation rules are adhered to without the introduction of spurious intervening spaces.
|
25 |
Avoid redundant phrasing and maintain forward narrative progression by utilizing varied sentence structure, alternative word choices, and active voice.
|
26 |
Employ descriptive details judiciously, ensuring they serve a purpose in advancing the story or revealing character or touching upon setting.
|