Due to the diversity of possibilities in human language, it is rare for the same idea to be expressed identically in multiple documents unless one expression is derived from the other, or both are quoting from a shared source. This observation motivates deduplicating exact substrings. We call our approach ExactSubstr. When two examples \(x_{i}\) and \(x_{j}\) share a sufficiently long substring (that is, a substring for which \(x_{i}^{a.a.+k}=x_{j}^{b.b+k}\)), that substring is removed from one of them. Based on statistical analyses (SSB), we select \(k=50\) tokens as the minimum matching substring length.