Reasoning Framework for Improving Mathematical CapabilityChain-of-thoughts Wei et al. (2022) encourages the LLMs perform multi-step reasoning by specific designed prompts and can improve reasoning performance. Based on this work, many subsequent works suggesting further improvements Fu et al. (2022); Zhang et al. (2022); Kojima et al. (2022). The above works focus primarily on how to improve performance through better prompt design or inference strategies without fine-tuning the model, whereas our work focuses on how to improve the model itself, and thus these approaches are complementary to ours.