基于页面对比分析的数据提取

Data Extracting Based on the Page Comparison and Analysis

针对提供大规模数据查询的Web页面,提出了一种基于站点内页面对比分析的Web数据提取方法。在对页面建树和分块的基础上对比分析获得页面数据块,然后利用同结构多页面对比和格式判断提取出数据,最后将数据存入到数据库中。该方法成功运用到多个信息提取系统中,实现了高效、准确的数据提取。

The Web based data service is expanding quickly with the dramatic expanse of Intemet. In this paper a Web data extraction method is proposed , which is based on Page Comparison and structure analysis Firstly it parses the semi-structured HTML documents and partitions it. Then Analysis relied on table structure can extract data from significative arca which is extracted through the similar Pages Comparison. Finally these data can be integrated into database. This approach has been efficiently and accurately applied in many retrieval systems.