Evaluation Datasets and MetricsOur evaluation encompasses a comprehensive suite of public benchmarks in both English and Chinese, leveraging an internal evaluation framework designed for robust assessment. These benchmarks include a diverse range of datasets catering to multiple disciplines and aspects of language understanding and reasoning, such as MMLU (Hendrycks et al., 2021), C-Eval (Huang et al., 2024), and CMMLU (Li et al., 2023). Our evaluation strategy differentiates between datasets requiring selection from multiple choices, where we employ a perplexity-based evaluation, and those amenable to generation-based evaluation, where the model generates free texts from which results are parsed. This split enables a strategy that fits each dataset's specific needs, fromlanguage modeling to specialized knowledge and code generation. The full details of the evaluation data are provided in Table 8.