The overall evaluation results are in Table 4. Overall, on the mentioned datasets, we have several observations. (1) On average, MiniCPM-2.4B ranks the highest among all the SLMs. (2) MiniCPM-2.4B performs similarly to Mistral-7B-v0.1 in English but significantly outperforms Mistral-7B-v0.1 in Chinese. (3) MiniCPM-2.4B outperforms Llama2-13B except in MMLU, BBH, and HellaSwag, while MiniCPM-1.2B outperforms Llama2-7B except in HellaSwag. (4)Generally, BBH are harder for SLMs than LLMs compared to other knowledge oriented dataset, demonstrating that reasoning ability might be more dependent on model size than than knowledge. (5) Among SLMs, Phi-2 performance on par with MiniCPM on academic oriented datasets. This might be because their training data mostly involves text book style data that emphasize on educational and academic scenarios. Since our pre-training data is covers more distribution, we think MiniCPM is better at knowledge and ability coverage, which can bee seen in Appendix G.