Estimating \(S_{c}\) and \(\alpha_{S}\).Since the first term in Eq. 3.2 has been solved in Sec. 3.1, for any given model with \(N\) parameters, say \(N=1M\), we have \(L(1M,S)=C+\left(\frac{S_{c}}{S_{\min}}\right)^{\alpha_{S}}\), where \(C=\left(\frac{N_{c}}{1M}\right)^{\alpha_{N}}\) is a constant because each element in the equation is known. Now, if we can train the \(1M\)-parameter model with the _infinitely large batch size_ and an optimally set learning rate 6, many pairs of \((L,S_{\min})\) can be obtained. By taking the logarithm on both sizes of Eq. 3.2, we obtain equations which are linear to \(\alpha_{s}\) and \(\log S_{c}\). Again, we can estimate \(S_{c}\) and \(\alpha_{s}\) with linear regression.