Footnote 4: A further possibility is that rather than using the final losses as per their description of Approach 3, they also used intermediate losses during training. If so, confidence intervals would be substantially narrower, but likely not by an order of magnitude if standard errors were appropriately clustered. Overall, we think this is unlikely to explain the tight intervals we see reported by Hoffman et al. (see Appendix A.2).