\(\bullet\)_Step-by-step reasoning_. For small language models, it is usually difficult to solve complex tasks that involve multiple reasoning steps, _e.g.,_ mathematical word problems. In contrast, with the chain-of-thought (CoT) prompting strategy [33], LLMs can solve such tasks by utilizing the prompting mechanism that involves intermediate reasoning steps for deriving the final answer. This ability is speculated to be potentially obtained by training on code [33, 47]. An empirical study [33] has shown that CoT prompting can bring performance gains (on arithmetic reasoning benchmarks) when applied to PaLM and LaMDA variants with a model size larger than 60B, while its advantage over the standard prompting becomes more evident when the model size exceeds 100B. Furthermore, the performance improvement with CoT prompting seems to be also varied for different tasks, _e.g.,_ GSM8K \(>\) MAWPS \(>\) SWAMP for PaLM [33].