For Supervised Fine-Tuning (SFT), we used both Chinese and English data. The Chinese data consisted of the full set from CQIA (Bai et al., 2024) and OL-CC, as well as high-quality data sampled from COIG-PC (Zhang et al., 2023). The English data was sampled from the OpenHermesPreferences dataset (Huang et al., 2024). The total amount of Chinese data comprised 105K pairs of instruction data, with English data adjusted to different ratios based on the volume of Chinese data. The ratios were \(1:1,2:1,4:1,\) and \(8:1\), along with configurations that included only Chinese data and only English data. Each set of experiments was trained for 3 epochs, with specific experimental results shown in Table 12.