Our work further highlights the uncertainty about compute-optimal scaling. In our plotted range of compute-optimal scaling policies (see Figure 5), we find that our fitted model is consistent with a ratio of tokens to parameters between 4 and 40 at models train on 1e26 FLOP or more. Getting tighter estimates before running experiments of this magnitude would, in expectation, save a meaningful fraction of that amount of compute.