1. A method for providing a training set to build a statistical relevancy scoring function to be used in a search engine, comprising: (a) identifying an initial set of hypertext documents as a training set of relevant documents; (b) identifying all hyperlinks included in each hypertext document of the training set identified and their associated anchortexts; (c) including the hypertext documents pointed to by the hyperlinks identified in (b) in the training set; and (d) including the anchortexts associated with the hyperlinks indentified in (b) in a lexicon.