Model answers in Chinese by default.
#3
by
the-french-artist
- opened
You must add a system prompt to make sure the model answers in English.
Otherwise, it seems to default to Chinese.
sys_instruct = 'You are an helpful assistant. Answer in English only.'
with torch.cuda.amp.autocast():
response, history = model.chat(tokenizer, query=query, image=image, history=[], do_sample=False, meta_instruction=sys_instruct)