For the training of the model variants, we utilized two distinct codebases: Axolot7 for the initial pre-training phase and LLaMA-Factory8(hiyouga, 2023) for subsequent fine-tuning. These codebases provided a strong and reliable base for our training process.