We also evaluated the toxicity score of Real Toxicity Prompt data in English. The results are showed in Table 5. We found that even we finetuned or continual pretrained the models on another language, models with the chat vector still has the ability to generate less toxic words.