We also verified the validity of Equation 3.11 in our experiments (see an example in Figure 2). Putting this \(B_{\text{crit}}(L)\) back to Equation 3.11, we can have: When \(B=B_{\text{crit}}(L)\), we have \(S=2S_{min}\) and \(E=2E_{min}\), meaning that training with the critical batch size will cost twice the minimum number of steps and tokens necessary to reach a certain loss value \(L\).