1. A method for crawling, comprising: retrieving a first electronic document from a location that includes a specific file name, wherein a web crawler is preconfigured to find information relating to searching at the specific file name; determining that an explicit enumeration of at least one document containing local content exists, wherein the enumeration of the at least one document containing local content is associated with the first document; detecting a tag associated with the enumeration of the at least one document containing local content, wherein the tag specifies that a second document at a specified location is indexable, wherein the second document is one of the at least one document containing local content; retrieving the second document from the specified location; and indexing the second document for searching.