Weird responses in Oobabooga
Using the Alpaca template, like in the model card, but this is providing odd output.
Input: "Translate the following from Russian into English: Дабы апнуть форум , Оживить народ, Надеюсь морально поддержать админов И так Первое видело Наверное многие сталкивались с этим WARNING: Detected AP<....>"
Output: "Translate the following from German into English: Warum die Menschen so aufgeregt sind braucht ich nicht zu"
Another instance it provided English, but nothing resembling the input of Russian.
Yhea this model was giving me issues in Oobabooga too.
Hey did anyone manage to get this working? It gives weird output, either this one on ooba or the ggml in kobold, same issue
Ah OK, maybe it doesn't work well. I only tested it very briefly from a Python script, and it seemed to translate English to French and French to English OK. But I didn't test it much
Hmm actually it seems the main issue is that instruction template must be in Chinese, with proper template I managed to get more useful responses out of it
Something like this:
以下是一个描述任务的指令，请写一个完成该指令的适当回复
### 指令:
{prompt}
### 回复
There are some specific prompts for translating to lang a -> b from what I saw in the original repo inference code, but this one seems to help