基于特定领域的网页文本提取与实现

Extraction and Implementation of Text Based on Specific Areas of the Webpage

提出了针对小范围的网页文本提取的一种方法.结合对东方财富网的股评网页的HTML文件进行网页文本分析,设计出基于特定领域的网页结构特征的网页文本提取算法.该算法的设计与普通的广义网页提取算法的设计相比,设计简单,针对性较强,提取效率较高,且对股票市场的网页信息的识别与处理起到基础性的作用.

This article proposes a method for web text extraction of small scale, and conducts the practice using the HTML doeuments of stock comment pages of www. eastmoney, com. The algorithm designed is based on the web structural characters of a certain specific field, which includes two main steps ： the pretreatment of HTML web documents and its acception or rejection. Compared with the ordinary designs of general web page extraction algorithms, this algorithmic design is of simplicity, stronger pertinence and higher extraction efficiency, which plays a fundamental role in the recognition and processing of web information of the stock market.