During development, we saved intermediary outputs from our pipeline for investigations and for ablations-intermediary outputs exist for about 5% of RefinedWeb. We did not keep intermediary outputs for the final production version of the dataset due to storage and resource constraints.