add chat template jinja in tokenizer.json
#4
by
Jaykumaran17
- opened
Hi team,
I'm trying to finetune but not getting desired result with the chat jinja template ,i tried based on chat format mentioned in model card.So update tokenizer.chat_template with jinja
Thanks
Jaykumaran17
changed discussion status to
closed
Jaykumaran17
changed discussion status to
open
Hi, before digging into the above, can you share more details about your training regime? How many rows of data? How many epochs? What is your learning rate strategy? If you're fine-tuning the base mode, these should impact your final output more than the template you use.
Added in my PR: https://huggingface.co/Deci/DeciLM-7B-instruct/discussions/5
Can also be added manually but you want to add it to tokenizer_config.json, not tokenizer.json.
Added chat template in the tokenizer_config, thanks for the heads up :)