\(\bullet\)_Gradient-based approaches._ This kind of approaches aims to optimize the prompt search process by maximizing the output likelihood via gradient update [405, 464, 465, 466]. As a representative work, Auto-Prompt [405] proposes a gradient-guided method to greedly searches the optimal token for each position of the prompt, leveraging the gradient approximated by the change in the log-likelihood when replacing a prompt token with another candidate token from vocabulary. However, such a search process can be extremely expensive since it needs to evaluate each candidate token for each position of the prompt, leading to a number of additional forward passes. Therefore, improved gradient method [464] has been proposed by transforming discrete tokens into continuous embeddings and computing the gradient on continuous space during optimization.