In our experiments, the fitted relationship between loss and \(N\), \(D\) is shown in the contour plot of equal loss in Figure 10. The equation of fitted scaling law is shown in the first text box in each subplot. We can see that in all evaluation corpora, we have \(\beta<\alpha\). More specifically, on average, we have \(\alpha=0.29\), \(\beta=0.23,K^{2}=0.01,\eta=-0.10\). Since \(\alpha\) is slightly larger than \(\beta\), this result shows that as the computation scale, we should slightly emphasize more on data scaling than model scaling, which aligns with Hoffmann et al. (2022).