On average with ExactSubstr, we remove more total content than with NearDup (despite ExactSubstr not removing any examples outright)--for example removing \(7.18\%\) of the tokens in C4. The exception is LM1B, where ExactSubstr removes \(8\times\) less data than NearDup. On investigation, we find this is due to the fact that LM1B documents are significantly shorter: \(90\%\) of all documents are under 50 tokens, and so are not even candidates for potential matches even if the entire sequence matched verbatim. We find that both NearDup and ExactSubstr remove similar content--\(77\%\) of the training examples that NearDup removes from C4 have at least one verbatim length-\(50\) match found by ExactSubstr.