On each line, each data point represents the performance and pre-training loss of the corresponding model pre-trained completely from scratch with the certain token count (and learning rate schedule). We can see that similar to the observations from Figure 1, the data points of different models sizes and training tokens largely fall on the same trending curves. In other words, _the LMs with the same pre-training loss regardless of token count and model size exhibit the same performance on the 12 downstream tasks_.