It is conceivable that Hoffmann et al. used later intermediate loss values in the last (perhaps 15%) of each training run, which could have sidestepped this basic issue. However, if this is what they had done, then the intermediate loss values withing each training run would have been highly correlated with each other, prompting the need to cluster standard errors, rather than treat every data point as independent. Since there is no indication that Hoffmann et al. clustered their standard errors,6 we do not consider this possibility very credible.