Inconsistency is another major challenge in reasoning, Dua et al. (2022) iteratively uses previous reasoning results as prompts until the model gives a consistent answer. Paul et al. (2023) trains a critic model to provide structured feedback on the reasoning process. Self-Refine (Madaan et al., 2023) performs iterative self-feedback and refinement to alleviate errors in reasoning. Compared with Self-Refine, Reflexion (Shinn et al., 2023) introduces reinforcement learning for reflection, which additionally brings decision-making capability. Meanwhile, some work introduces backward reasoning (Yu et al., 2023) for verification. RCoT (Xue et al., 2023) reconstructs the question according to the reasoning chains, and its inconsistency with the original question exposes errors in the reasoning process. FOBAR (Jiang et al., 2023) and Self Verification (Weng et al., 2022) perform verification by deducing the conditions in the question from the answer. FOBAR infers the variables in the question, and Self Verification infers the conditions in the question. However, Huang et al. (2023) finds that LLMs struggle to self-correct without external feedback, and it could even lead to a performance decline.