期刊文献+

一种面向隐含主题的上下文树核

A Context Tree Kernel Based on Latent Semantic Topic
下载PDF
导出
摘要 该文针对上下文树核用于文本表示时缺乏语义信息的问题,提出了一种面向隐含主题的上下文树核构造方法。首先采用隐含狄利克雷分配将文本中的词语映射到隐含主题空间,然后以隐含主题为单位建立上下文树模型,最后利用模型间的互信息构造上下文树核。该方法以词的语义类别来定义文本的生成模型,解决了基于词的文本建模时所遇到的统计数据的稀疏性问题。在文本数据集上的聚类实验结果表明,文中提出的上下文树核能够更好地度量文本间主题的相似性,提高了文本聚类的性能。 The lack of semantic information is a critical problem of context tree kernel in text representation.A context tree kernel method based on latent topics is proposed.First,words are mapped to latent topic space through Latent Dirichlet Allocation(LDA).Then,context tree models are built using latent topics.Finally,context tree kernel for text is defined through mutual information between the models.In this approach,document generative models are defined using semantic class instead of words,and the issue of statistic data sparse is solved.The clustering experiment results on text data set show,the proposed context tree kernel is a better measure of topic similarity between documents,and the performance of text clustering is greatly improved.
出处 《电子与信息学报》 EI CSCD 北大核心 2010年第11期2695-2700,共6页 Journal of Electronics & Information Technology
关键词 文本聚类 上下文树核 统计语言模型 隐含狄利克雷分配(LDA) Text clustering Context tree kernel Statistical language models Latent Dirichlet Allocation(LDA)
  • 相关文献

参考文献13

  • 1Srivastava A N and Sahami M. Text Mining: Classification, Clustering, and Applications[M]. Boca Raton: Chapman and Hall, 2009: 1-25.
  • 2Cristianini N, Shawe-Taylor J, and Lodhi H. Latent semantic kernels[J]. Journal of Intelligent Information Systems, 2002, 18(2/3): 127-152.
  • 3Nyffenegger M, Chappelier J C, and Gaussier E. Revisiting Fisher kernels for document similarities[C]. 17th European Conference on Machine Learning, Berlin, Germany, September 18-22, 2006: 727-734.
  • 4Lehmann A and Shawe-Taylor J. A probabilistic model for text kernels[C]. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, 2006: 537-544.
  • 5Cuturi M and Vert J P. The context-tree kernel for strings[J]. Neural Networks, 2005, 18(8): 1111-1123.
  • 6Yin Chuan-huan, Tian Sheng-feng, and Mu Shao-min, et al.. Efficient computations of gapped string kernels based on suffix kernel[J]. Neurocomputing, 2008, 71(4-6): 944-962.
  • 7Vert J P. Text categorization using adaptive context trees[C]. Proceedings of the Second International Conference on Computational Linguistics and Intelligent Text Processing, Mexico City, Mexico, February 18-24, 2001: 423-436.
  • 8Willems F M J, Shtarkov Y M, and Tjalkens T J. The context-tree weighting method: basic properties[J]. IEEE Transactions on Information Theory, 1995, 41(3): 653-664.
  • 9Vert J P. Adaptive context trees and text clustering[J]. IEEE Transactions on Information Theory, 2001, 47(5): 1884-1901.
  • 10李晓光,于戈,王大玲,鲍玉斌.基于信息论的潜在概念获取与文本聚类[J].软件学报,2008,19(9):2276-2284. 被引量:7

二级参考文献1

共引文献6

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部