Computational Analysis.We run our algorithm on a single VM on the cloud with \(96\) cores and \(768\)GB of memory. Our algorithm is efficient, for example processing the Wiki-40B training set (\(3\) million examples containing \(4\)GB of text) in \(2.3\) minutes wall-clock time (\(2.1\) CPU-hours of work). The \(350\)GB C4 dataset takes under 12 hours (wall-clock) to build a suffix array; although we are still memory constrained and so this corresponds to \(\sim 1000\) CPU-hours. Once the suffix array has been constructed, it takes under an hour to deduplicate the C4 dataset.