where \(\theta_{chat\_new}\) is the weights of the resulting model, \(\theta_{CP}\) is the continue pre-trained model mentioned in 3.1. With such simple addition, the model not only obtains the ability to understand and follow instructions in the target language but is also aligned with specified criteria such as helpfulness and harmlessness.