Research on Focused Spider
With the rapid development of the Internet technology, the amount of pages in the WWW has grown dramatically and search engines are irreplaceable for web users and become the entries of the web for people. Web spider, as the data source for search engine, is the most important component of search engine. Introduces the key technologies of web spider. In addition, the growing individual needs of web users as well as the dramatic increase in the number of pages leading general search engines can not meet the specific needs of users. The topic-based search engines have been rapid development. The focused spider has also been great breakthroughs and progress in the meanwhile. Unlike general spiders, general spiders focused crawling general integrity, and the focused spiders emphasize the relevance of a particular topic. Introduces the researches on focused spiders.