Design and Implementation of Topic Crawler in the Agricultural Products Supply System
Introduces the working principle of topic crawler and with the function of it, puts forward the design of topic crawler in the agricultural product supply and demand docking system module and analyzes the design and function of each module. Achieves the concrete implementation of the topic Web crawler in the system. When the number of effective post topic in the system is below to a certain threshold,Web crawler can crawl other similar sites and fetch relevant information and establish index at the aim of making the system better rec-ommended to the user and allowing the user obtain useful information.