基于DOM树和混合文本密度的网页信息提取方法研究

Research on Web Page Information Extraction Method Based on DOM Tree and Mixed Text Density

在网页信息提取领域,文档对象模型(Document Object Model,DOM)树和混合文本密度是两个重要的概念。文章提出一种基于DOM树和混合文本密度的网页信息提取方法。首先,利用DOM树结构分析网页的标签层次结构,确定每个标签的重要性;其次,根据混合文本密度计算每个标签中包含有用信息的概率并且提取重要信息;最后,进行实验分析。实验结果表明,该方法能够有效提取网页中的有用信息。

In the field of web page information extraction,Document Object Model(DOM)tree and mixed text density are two important concepts.The article proposes a web page information extraction method based on DOM tree and mixed text density.Firstly,use the DOM tree structure to analyze the hierarchical structure of web pages'tags and determine the importance of each tag;Secondly,calculate the probability of containing useful information in each label based on the mixed text density and extract important information;Finally,conduct experimental analysis.The experimental results show that this method can effectively extract useful information from web pages.