We propose Masked thought Fine-Tuning as a regularization technique during fine-tuning. Our findings indicate that MFT not only boosts the reasoning performance but also improves the model's ability to capture long-distance dependencies. This study could pave the way for future research on regularization strategies for reasoning tasks and further exploration of the interplay between language dependency and reasoning capabilities.