From this equation, we can explain the emergent abilities observed in [47]: when model sizes are smaller than \(N_{0}\cdot\left(\eta-L_{\infty}\right)^{-1/\alpha_{N}}\), the normalized performance is zero. When model sizes exceed \(N_{0}\cdot\left(\eta-L_{\infty}\right)^{-1/\alpha_{N}}\), the increase in model size leads to a decrease of pre-training loss and an improvement in normalized performance.