**Internal Feedback.** The LLM itself can be utilized as a feedback provider. One straightforward way is to directly evaluate the quality of the generated plans through prompting. For example, RAP [447] evaluate the likelihood that each candidate plan can lead to task success, while Tree of Thoughts [527] proposes to vote across plans by making comparisons between them. Further, LLMs can provide feedback based on the intermediate results from the plan executor. For example, Reflexion [450] utilizes LLMs to transform sparse result signals (_e.g.,_ success or failure) into concrete text-based feedback (_e.g.,_ "_You should recommend comedies that the user mentions in the query instead of horror movies_") and stores this feedback in long-term memory for future planning.