Issue with the model running
#2
by
pligor
- opened
Many thanks for providing this model.
We got this from the technical team of runpod.io:
"""
From my testing it looks like the issue is with model missing CHAT_TEMPLATE in it's config.
Without it the endpoint would output "As of transformers v4.44, default chat template is no longer allowed, so you must provide a chat template if the tokenizer does not define one".
"""
Could you fix it ?