\(\bullet\)_Complex reasoning_. For complex reasoning, we evaluate the comparison models on OpenbookQA [566], HelaSwag [582], and SocialIQA [581] for knowledge reasoning; Colored Objects [70] and Penguins in the Table [70] for symbolic reasoning; GSM8k [184] and MATH [364] for mathematical reasoning. We compute the _accuracy_ for OpenbookQA, HellaSwag, and SocialIQA; _solve rate_ for Colored Objects and Penguins in the Table; and _accuracy_ for GSM8k and MATH. For knowledge reasoning tasks, we evaluate the zero-shot performance, since they are all QA tasks that can be solved in a zero-shot setting. For complex symbolic reasoning and mathematical reasoning tasks, we leverage 3-shot in-context exemplars to better elicit LLMs to accomplish them. Following existing work [443, 33], we also utilize the chain-of-thought prompting strategy for better solving the mathematical reasoning tasks.