Third, _we explore the underlying reasons for the effectiveness of our method by revealing its impact on learning dependencies._ By conducting both quantitative analyses and case studies, we observed that this method demonstrates an enhanced dependency on the initial mathematical questions and earlier steps. This suggests a possible reason: Instead of depending solely on the local information generated by the model itself from recent steps, which can lead to a higher likelihood of hallucination or misdirection as the sequence extends, our method utilizes more information from the problem statement and earlier steps. These sources are more reliable and less prone to errors. Consequently, this strategy might reduce the risk of misunderstanding the problem and inconsistencies in reasoning (refer to Secs. 2.2 and 3.4).