1. A computer-implemented method comprising: receiving a query submitted by a user through a search query interface of a web page associated with a third party; analyzing content of the web page through which the user submitted the query; determining a topic associated with the third party based on analyzing the content of the web page through which the user submitted the query; storing, in a profile for the web page, data indicating the topic; receiving data identifying (i) documents that are responsive to the query and (ii) an information retrieval score for each of the documents; determining that one or more of the documents are associated with the topic indicated by the profile for the web page; and adjusting a respective information retrieval score for the one or more of the documents that are determined to be associated with the topic.