**Decay Stage.** We use a mixture of the pretraining data and high-quality SFT data. For the specific annealing form of the WSD scheduler, we employ exponential annealing, i.e. \(f(s-T)=\times 0.5^{(s-S)/T}\), in which \(T\) is set to be 5000 steps (20B tokens).