As for the concrete data-to-model ratio \(\frac{D_{opt}}{N_{opt}}\), we notice that there is a huge gap in compute optimal regime of between ours and Hoffmann et al. (2022) despite that the trend of \(\frac{D_{opt}}{N_{opt}}\), with compute \(C\) is aligned between ours and theirs. Specifically, the data size should be 192 times larger than the model size on average, as opposed to 20 times in Hoffmann et al. (2022). We note that this aligns with the observation in Section 4.3 and Figure 6.