基于混沌序列的网页信息关键词爬取方法优化

Optimization of Web Information Keyword Crawling Method Based on Chaotic Sequence

常规的网页信息关键词爬取方法通过提取网页信息的统一资源定位器(Uniform Resource Locator,URL)来获得网页信息,提取关键词局限于文本字段,导致爬取准确率较低。对此,提出基于混沌序列的网页信息关键词爬取方法。首先,分析信息爬取流程,提取更加详细的全部信息;其次,根据提取原理的不同,划分网页信息提取板块;最后,分析网页信息混沌序列,提取所需网页信息关键词。实验结果表明,采用所提方法时,爬取准确率约为96.8%,相比传统方法提高了6.92%,相对来说,具有较高的准确性。

In conventional web page information keyword methods, web page information is obtained by extracting the Uniform Resource Locator(URL) of the web page information. The extraction of keywords is limited to text fields, resulting in insufficient crawling accuracy. Therefore, a method for crawling web information keywords based on chaotic sequences is proposed. In the research of keyword crawling methods, firstly, analyze the information crawling process and extract more detailed and complete information. Secondly, according to the different extraction principles, divide the webpage information extraction section. Finally, analyze the chaotic sequence of web page information and extract the required web page information keywords. From the experimental results, it can be seen that the crawling accuracy of the proposed method is about 96.8%, which is 6.92% higher than traditional methods. Relatively speaking, the designed crawling method has high accuracy.