**Results.** Our experiments yield the following insights: 1. In terms of the placement of noise, we find that masking partial reasoning steps in the target yields the best performance when compared to introducing noise across all tokens or specifically within the question. 2. We observe that introducing more huge noise to remove the original semantic is advantageous. Specifically, setting \(\tau=100\) for Scheduled Sampling and \(a=1000\) for NEFTune enhances the model's performance. In contrast, the strategy of replacing synonyms, with \(\tau=1,2\) in Scheduled Sampling, does not surpass the effectiveness of random replacement.