**Tasks and Datasets.** Next, we set up the evaluation tasks and datasets for the abilities discussed in Section 7.1 and Section 7.2. We mainly evaluate the zero-shot performance of LLMs on these datasets. For more complex tasks that are hard to be solved in the zero-shot manner (_e.g.,_ mathematical reasoning and tool manipulation), we mainly report the 3-shot performance, considering the context length limit of open-source models.