Prompt format correct?
#1
by
Yuma42
- opened
The original model doesn't have "<|begin_of_text|>" in it's prompt format according to it's model card.
My template comes from interpreting the template in tokenizer_config.json, which appends the bos_token
It's probably that you shouldn't manually include it and it will get included by itself
If you see a second <|begin_of_text|> show up, then yeah it probably shouldn't be included (and I can remove it, but not all tools will necessarily append it)
"you shouldn't manually include it "
Ah ok than I did that correct in that case.