Estimating \(B_{*}\) and \(\alpha_{B}\)In order to estimate \(B_{*}\) and \(\alpha_{B}\), we train a fixed-sized model with various batch sizes to generate \(k\) contour lines representing consistent loss values. We then use Equation 3.11 to fit these series of contour lines, yielding a set of \(k\) estimated pairs \((E_{min}^{1},S_{min}^{1}),\ldots,(E_{min}^{k},S_{min}^{k})\) (as shown in Figure 2 where \(k=5\) and \(N=10M\)). Note that Eq 3.11 is linear w.r.t. \(S_{min}\) and \(E_{min}\), so we could use linear regression to fit them and obtain the \(k\) pairs of \((E_{min},S_{min})\).