To further enhance the capabilities of pre-trained Large Language Models(Touvron et al., 2023; Jiang et al., 2023; Achiam et al., 2023; Azerbaijan et al., 2023) on reasoning tasks, the primary strategies involve fine-tuning and various training-free post-processing techniques. The post-processing techniques include approaches like prompting(Wei et al., 2022; Fu et al., 2022; Kojima et al., 2022; Wang et al., 2023a), ensembling(Wang et al., 2022; Li et al., 2022), and reranking(Uesato et al., 2022; Cobbe et al., 2021). A unique technique specific to LLMs is to leverage the model's reasoning capabilities through prompting. This entails crafting zero-shot prompts(Kojima et al., 2022; Wang et al., 2023a) or designing a small set of demonstrations to facilitate in-context learning(Wei et al., 2022; Fu et al., 2022). Additionally, there are methods focused on designing intricate pipelines utilizing various rules or algorithms for enhanced reasoning. These methods include search(Yao et al., 2023; Besta et al., 2023), iterative feedback collection(Yao et al., 2022), and employing the Program-of-Thought approach for generating code solutions(Chen et al., 2022).