Another technique is to improve the model's ability to correct errors and summarize historical experience. Self-Refine (Madaan et al., 2023) employs a unique approach where the output generated by the model is evaluated and provided with feedback using the same model. Reflexion (Shinn et al., 2023) enables the model to reflect on and rectify errors made in previous actions, resembles reinforcement learning in textual format, and involves dividing memory into long and short-term components. However, Reflexion cannot update the plan when an out-of-plan error occurs. AdaPlanner (Sun et al., 2023) introduces adaptive closed-loop plan refinement, which iterative refines the task plan based on the feedback of the environment. ISR-LLM (Zhou et al., 2023) combines Self-Refine with PDDL to achieve a better success rate in long-horizon sequential tasks. Meanwhile, LATS (Zhou et al., 2023) utilizes LM-based Monte Carlo Tree Search for a more flexible planning procedure.