where \(s_{i,j}\) is the Jaccard index between the two documents \(i\) and \(j\). For document pairs that were identified as potential matches, we computed their actual Jaccard index, and if that was above 0.8, we computed their edit similarity. Document pairs with edit similarity higher than 0.8 were identified as duplicates. After some experimentation, we chose to use \(b=20\), and \(r=450\), so \(k=9,000\), so as to make sure a collision at the desired Jaccard index threshold of 0.8 had a high probability of occurring.