To explain this apparent discrepancy, one possibility is that Hoffmann et al. might have used the intermediate loss values during each of the training runs to obtain a fit, rather than using only final loss values for each model trained. Since there were likely at least several hundred intermediate loss values per model in their dataset, in theory, this extra data could have provided them the hundreds of thousands of data points needed to obtain the extremely narrow confidence intervals they reported.