Estimating \(N_{c}\) and \(\alpha_{N}\).To estimate the two constant scalars, we can train a series of \(k\) models with various numbers of parameters (say, \(N=1M,10M,\ldots,10(k-1)M\)) on the _infinite training data_ until these models converge and obtain their final test losses. With these pairs of \((N_{0},L_{0}),\ldots,(N_{k-1},L_{k-1})\), we can obtain \(k\) equations in the form of \(\alpha_{N}\log N_{c}-\alpha_{N}\log N_{i}-L_{i}=0\big{|}_{i=0}^{k-1}\), which are linear w.r.t. \(\alpha_{N}\) and \(\log N_{c}\). \(N_{c}\) and \(\alpha_{N}\) can then be estimated by parametric fitting using linear regression. In practice, we find that setting \(k=7\) is sufficient for an accurate estimation.