In Figure 0(b), we fit a scaling law in the style of Hoffmann et al. (2022) on data points from models ranging from 410M parameters, only optimizing for model-related constants (\(A\) and \(\alpha\)) while reusing all other values (\(B=410.7\), \(\beta=0.28\), \(E=1.69\)). We recall the relation between parameter count \(N\) and token count \(T\) given in Hoffmann et al.