Wei et al. (2022) first propose chain-of-thought prompting (Few-shot CoT) by manually providing natural language form rationales to the demonstrations. To further ensure certainty in the reasoning process and reduce inconsistencies between reasoning path and answers, PAL Gao et al. (2023), PoT Chen et al. (2022) and NLEP Zhang et al. (2023) leverage programming language as annotated rationales, which transforms the problem-solving into an executable Python program. Meanwhile, to take both advantages of natural language and programming language and raise the confidence of reasoning output, MathPromter Imani et al. (2023) uses the zero-shot chain-of-thought prompting to generate multiple algebraic expressions or Python functions, which can verify each other and improve the reliability of results. Furthermore, since the reasoning complexity of samples in demonstrations, such as chains with more reasoning steps, results in performance improvement Fu et al. (2023) proposes complexity-based prompting, where voting among high-complexity rationales is performed to get the final answer.