Figure 6: Comparative performance trends of different language models over various training checkpoints, as fitted by the Eq.(1). (a) We present the CEval Score Trends, showing a consistent increase in performance with larger training data sizes. (b) We depict the CMMLU Score Trends, with a similar positive correlation between score and training size. (c) We illustrate the MMLU Score Trends, with all models demonstrating performance enhancements correlating with the scale of training data. Each graph plots individual data points for different versions of the models and overlays a curve fit to represent the scaling law’s predictive performance scaling.