during training to mask potential shortcuts, encouraging the model to build up more connections to more robust features, such as information from questions and earlier, less error-prone steps. We maintain the mathematical question unmasked, assuming it is error-free, to prompt the model to comprehend the question while leveraging the provided premises. Empirical evidence shows that masking parts of the questions does not improve performance. However, we find that even though we do not mask the questions, MFT is still able to handle the noise in the questions well (see Tab. 5). For balancing the model's exploration of unmasked premises and exploitation of the familiar premises, we employ a conservative linear warmup strategy over several epochs for stability. It Allows the model to first see a more complete context, then gradually increase the masking to ensure the stability of the loss value during training.