To enhance the model's understanding and generation capabilities in the target language, we begin by initializing a model with a pre-trained model and then proceed to pre-train the model with the target language corpora. Similar to typical pre-training, we employ the Causal Language Modeling task to continue the pre-training of the base model. In this task, the model is required to predict the next token based on the input token sequence.