We report the ratios for samples according to the first 10,000 documents from our Pile validation set in Table 7. Note that there are some slight variations in the ratios compared with those reported in Gao et al. (2020), but most ratios are similar.