Figure 1: **The performance-vs-loss curves of 1.5B, 6B, and 32B models. Each data point is the loss (\(x\)-axis) and performance (\(y\)-axis) of the intermediate checkpoint of one of the three models.