Random characters showing up
Hi
@macadeliccc
So i have been trying this model and it follows instruction quiet well. But it also randomly adds characters such as /istribute: assistant:. Other than stop sequence, is there a way to prevent this or such non-english proper words from showing up?
Also, there was some issue observed with westlake models with multilingual text randomly showing up, where the model switches language on its own. Have you noticed that? Is that something fixed in this?
Thanks again!
I have not noticed this before. However, it can be a common byproduct of a merge. I will do some further testing on this model and see if I can find a specific reason.
In the meantime, try WestLake-7b-v2-laser-truthy-dpo or OmniCorso-7B.
They are similar models that have been tested more.