Brown et al. (2020) finds that large-scale language models have excellent in-context learning (ICL) ability. ICL incorporates input-output demonstrations into the prompt text. With ICL, off-the-shelf LLMs can be employed without additional fine-tuning while achieving comparable performance. Nevertheless, this end-to-end approach tends to underperform when faced with complex reasoning tasks.