1. An information gathering system for optimizing searching comprising: a persistent storage storing data concerning entities, where each entity is stored according to a classification scheme that includes one or more predefined classifications; a data extraction tool that extracts website content for a plurality of the entities associated with at least one of the predefined classifications; and a content analyzer analyzing the extracted content, where the analyzed content is used to update the classification scheme.