一种有效的多关键词词频统计方法

An Efficient Approach for Counting Multiple Keywords Frequency

针对词频统计的特点,设计了一种多关键词词频统计方法。该方法以一种树形的数据结构来存储待处理关键词集合的信息。实现了多关键词的高效匹配,扫描一次文档就可统计出全部关键词词频信息。通过理论分析与实验表明,其性能比传统的关键词词频统计方法有较大的提高。

For the characteristic of the word frequency statistic, this paper designs an approach for counting multiple keywords frequency. In this method, for taking full use of the redundancy information between keywords, it stores the set of keywords with a kind of data structure of tree form. This method realizes the matching high efficiently of many keywords. Scanning the file once is able to get the information of frequency of all keywords. Through theory analysis and experiment result, its performance is more efficient than other algorithms.