First, _we propose a simple and effective Masked thought Fine-Tuning (MFT) method for improving language model reasoning._ The implementation of our method is simple: it requires only the substitution of specific tokens with a [mask] in the chain of thought. This is done while maintaining the same procedures as the standard Supervised Fine-Tuning (SFT). With just this minor modification, a 5% increase in accuracy can be achieved when fine-tuning on the GSM8K dataset with Llama-2-7B [13], which yields results comparable to those obtained using a more complex data generation pipeline (see Tab.2). Moreover, this method exhibits good versatility and complements other data augmentation techniques well, allowing for seamless integration. Our experiments have demonstrated that by substituting SFT with our Masked Thought strategy, we can enhance accuracy by an average of 3% on the GSM8K dataset and by 1% on the MATH dataset across five different math datasets and two models (see Tab.1). Moreover, MFT demonstrates higher sample efficiency than SFT (see Fig.2).