of human alignment in AutoCoT. Although previous work solves the problem of manual annotating, demonstration selection can also significantly affect performance. Automate-CoT (Shum et al., 2023) employs reinforcement learning with a variance-reduced policy gradient strategy to estimate the significance of each example in a black-box language model, eliciting better demonstration selection. Similarly, Lu et al. (2023) proposes PromptPG, which utilizes policy gradient to learn to select demonstrations in tabular reasoning. Ye and Durrett (2023) initially uses two proxy metrics to evaluate each example and then searches over examples to find demonstrations that yield the best performance in a silver-labeled development set. Meanwhile, Pitis et al. (2023) proposes Boosted Promptg, a prompt ensembling way to improve the performance, which iteratively expands the examples when encountering the problem that the current demonstration is challenging to handle. Zou et al. (2023) introduce Meta-CoT, which automatically selects demonstrations based on the question category, eliminating the need for the task-specific prompt design.