where \(N(C)\) and \(S(C)\) are the optimal model size and number of training steps given a fixed computational budget \(C\). \(L\left(N\left(C\right),C,S(C)\right)\) is the final loss value with the chosen \(N(c),C\) and \(S(C)\). The detailed derivation can be found in Appendix B.1 of [13]. All the constant terms mentioned above are already known through the derivation steps described in Section 3, so we could directly estimate \(N(C)\) and \(S(C)\) from from our computational budget \(C\). Note that, as shown in Eq 5.1, the final loss is \(\alpha_{N}/\alpha_{S}\) more than the converged loss \(L(N,\infty)\). Therefore, optimally we should _NOT_ train the model until convergence, which contrasts with the current common practice.