lmstudio-community/WizardLM-2-7B-GGUF · do as you say, not as you do?

Apr 16

Then, set the system prompt to whatever you'd like (check the recommended one below), and set the following values:

System Message Suffix: '\n\n'
User Message Prefix: 'USER:'
User Message Suffix: '\nASSISTANT:'

Under the hood, the model will see a prompt that's formatted like so:
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to > the user's questions.
USER:{prompt}
ASSISTANT: </s>

you SAY: system message\n\n

you DO: system message\n

bartowski

LM Studio Community org Apr 16

You're right, it should be the one that's in the prompt template, I'll fix that thanks!

bartowski

LM Studio Community org Apr 16

@cognitivetech

According to others (https://huggingface.co/alpindale/WizardLM-2-8x22B/discussions/4) the chat template should actually be

{system_prompt} USER: {prompt} ASSISTANT: </s>

Updating model card again, let me know if it has any different results