**Evaluation Dataset.** These datasets are mainly augmented from the training sets of GSM8K and MATH, and we test on the corresponding test sets. The GSM8K dataset sets aside 1,319 entries for testing, while the MATH dataset reserves 5,000 entries as a test set. We extract the final answers by specific templates (e.g., "the answer is") in the predicted reasoning paths following the scripts adopted by Yue et al. (2023); Yu et al. (2023). Subsequently, we calculate the ratio of predicted answers equal to the ground truth answers as the accuracy.