Footnote 1: This capacity might be underestimated by previous works due to using relatively small LMs or randomly initialized transformers, or lack of exhaustive training or instruction-tuning (Wang et al., 2021; Hu et al., 2023; Zhu and Li, 2023).