Topics of Controversy: An Empirical Analysis of Web Censorship Lists
Z Weinberg, M Sharif, J Szurdi, N Christin - Proceedings on Privacy Enhancing …, 2017
... Common Crawl Finally, this is the closest available ap- proximation to an unbiased sample of the entire Web. The Common Crawl Foundation continuously operates a large-scale Web crawl and publishes the results [27]. Each crawl contains at least a billion pages. ...