基于加权超图随机游走的文献关键词提取算法

Keywords Extraction Algorithm Based on Weighted Hypergraph Random Walk

针对科技文献类标题短文本关键词提取时,已有自然语言处理算法难以建模文献时间与权威性且短文本词语较少建模往往存在高维稀疏问题,本文提出了一个综合实时性以及权威性的关键词提取算法为研究者进行相关推荐.该方法将文献标题视为超边,将标题中不同词项视为超点来构建超图,并对超图中的超边与超点同时加权,进而设计一种基于加权超图随机游走的关键词提取算法对文献标题的词项进行提取.该模型通过对文献来源,发表年份以及被引次数建模来对超边进行加权,根据节点之间的关联度以及每对节点在特定标题中的共现距离对超点加权.最后,通过超图上的随机游走计算出节点的重要性进而确立可推荐的关键词.实验表明,与三种基准短文本关键词提取算法相比,本文算法在精确率和召回率方面均有所提高.

It is difficult for the existing natural language processing algorithms to model the time and authority of short texts such as paper titles of scientific literature. Besides,the short texts always tend to have fewer words and thus suffer from high dimension and sparsity. A keyword extraction method involving both real-time and authoritativeness is presented.A weighted hyper-graph is constructed where vertexes represent weighted terms and weighted hyper-edges measure the semantic relatedness of both binary relations and nary relations among terms. On one hand,the source of the documents,the year of publication and number of citations are considered for weighting hyper-edges,on the other hand,the degree of association between the nodes and co-occurrence distance for each pair of nodes in particular title are calculated for weighting hypervertexes. The random walk approach is performed on the weighted hyper-graph to obtain the recommended keywords.Experimental results demonstrated that compared with three baseline algorithms,the proposed approach is able to extract keywords with higher precision and recall.