I can't get it to work in oobabooga.

#1
by RonSwanson123 - opened

I can't get it to work in oobabooIchga it loads but it only generates numbers and points. Why do they even have such an exotic prompt template? Maybe it's because of that, can someone tell me what exactly I need to put in there? ChatML is not available by default on oobabooga.

RonSwanson123 changed discussion title from I can't get it to work in oobabooIchga. to I can't get it to work in oobabooga.

I used the tokenizer of the original German only model https://huggingface.co/LeoLM/leo-hessianai-13b/tree/main (replace all tokenizer files). This works for me.

I have the same problem, is there a config yaml update

Sign up or log in to comment