**Improvements Compared with SFT.** The results presented in Tab. 1 illustrate that our approach improves performance no matter whether augmentation data is used, demonstrating effectiveness across datasets of varying quality and under two different base models. Notably, this enhancement is most significant in simpler or smaller datasets where the available useful signals in the data may be limited. Our approach demonstrates enhancements in the performance of the MAMnoTH dataset, which incorporates Program-of-Thought Data. This suggests that our method remains effective and is not adversely affected by the inclusion of programming tasks.