\(\bullet\)_LLM-based approaches._ Due to the exceptional capacities of LLMs, an increasing number of studies directly leverage LLMs as prompt generator [471, 472, 473]. Specifically, APE [471] utilizes an LLM to generate initial prompts, then selects the best prompt with the highest accuracy, and finally improves the best candidate through an iterative Monte Carlo search method. Similarly, APO [472] instructs the LLM to generate text feedback on how to refine an old prompt into new improved prompts. However, their search in the prompt space might be inefficient without fully considering the whole refinement trace of previous prompts, thus potentially leading to sub-optimal results. Therefore, another study [473] incorporates the previous prompts with their scores to instruct LLMs for progressively generating better new prompts. However, these approaches still struggle in exploring the vast space of effective prompts. Inspired by human-like trial-and-error, prompt optimization is further formulated as a strategic planning problem [474] and uses Monte Carlo tree search to navigate the vast prompt space.