1. A computer-implemented method for defining a web crawl space to be crawled, comprising: receiving a seed list including one or more seed names from a user, wherein each seed name represents a website; and in response to receiving the seed list, generating a web crawl space for the received seed list by generating one or more allow rules.