In the area of Natural Language Processing (NLP), an extensive range of data augmentation techniques has been introduced for diverse applications, such as translation, summarization, and dialogue (Chen et al., 2023b; Fadaee et al., 2017; Xie et al., 2016; Lample et al., 2017; Guo et al., 2020a; Xie et al., 2022; Wang et al., 2018). The noise-based strategies commonly involve the integration of random continuous noise (Cheng et al., 2018; Jain et al., 2023; Kedzie and McKeown, 2019), token dropout (Xie et al., 2016; Gal and Ghahramani, 2015), token swapping (Wei and Zou, 2019), and more advanced mixup strategies (Guo et al., 2020b; Xie et al., 2022). Recently, in the context of regularization for LLMs, Jain et al. (2023) has demonstrated that the application of continuous noise across all tokens during the instruction tuning can significantly improve the length and detail of the generated responses. However, this technique does not improve the reasoning ability. We adopt the discrete token noise through token dropout (Xie et al., 2016; Gal and Ghahramani, 2015) to reasoning tasks, finding that it works well, which may complement the dependency-rich structure characteristic of reasoning data.