DatasetTo comprehensively understand how LLMs work with different abilities, we employ four different kinds of tasks including MGSM Shi et al. (2022) for reasoning task, XQuAD Artetxe et al. (2020) for NLU task, XLSum Hasan et al. (2021) for NLG task, and X-CSQA Lin et al. (2021) for knowledge question answering task. For XL-Sum, we randomly sample \(500\) data points from the whole test set for each language, while for other tasks, we employ the whole test set.