in Fig. 6. Our experiments focus on the Alpaca dataset (Taori et al., 2023), a general instruction set with minimal mathematical reasoning content. The results reveal significant differences between the Alpaca and GSM8K datasets. Training with MFT using the Alpaca dataset does not alter dependency relationships, verifying our hypothesis. MFT enhances the model's ability to learn long-distance dependencies within the data. The absence of such dependencies in data renders MFT less effective. Additionally, we assess whether MFT could detrimentally influence the model's general conversational capabilities. According to the results presented in Appendix H, the scores of Alpaca-eval (Li et al., 2023) using both MFT and SFT were comparable.