To improve the reasoning ability, most training methods focus on acquiring supervised signals obtained through costly means, such as human annotation (Liao et al., 2024), generation of larger models (Yu et al., 2023; Luo et al., 2023; Liu et al., 2023; Yue et al., 2023), or self-sampling (Yuan et al., 2023; Singh et al., 2023; Wang et al., 2023; Zelikman et al., 2022). These methods depend on these signals to direct learning towards a specific trajectory by precisely outlining the reasoning process. In contrast, our method illustrates that an entirely different approach is equally effective. Instead of requiring more precise guidance to direct the generative process, our technique achieves comparable results by introducing random noises into the input. For reasoning tasks, which are generally considered to require precise understanding, we find that the method of incorporating noise into the reasoning steps is surprisingly effective, indicating that the model might have enhanced its performance through a denoising process. Our approach stands out for its simplicity and effectiveness, offering a feasible alternative to the more complex and resource-intensive methods.