In this work, we present a novel approach to imbue LLMs with chat capabilities in a new language. Through continual pre-training and the integration of the chat vector into an English-based PLM, the model acquires the ability of instruction following and aligning with human skills, including generating safe responses and multi-turn dialogue. In contrast to the current approach involving CP, SFT, and Human Preference Training, our method entails solely CP and straightforward arithmetic operations, significantly reducing the cost of aligning models with human preferences.