基于不变图卷积神经网络的文本分类

Text Classification Based on Invariant Graph Convolutional Neural Networks

文本分类是自然语言处理中一个基本而又重要的任务,近年来,图神经网络被越来越多地应用于文本分类中。然而,使用图神经网络的图表示学习在涉及文本分类的任务中不能很好地满足新词的归纳学习,其一般假设训练和测试数据来自相同的分布,但现实中这个假设经常不成立。为了克服这些问题,文中提出了Invariant-GCN,用于通过GCN进行归纳文本分类。首先为每个文档构建单个图,使用GCN根据其局部结构学习细粒度的单词表示,这可以有效地为新文档中没见过的单词生成嵌入进而将单词节点作为文档嵌入合并;然后提取最大限度地保留不变类内信息的期望子图,使用这些子图进行学习不受分布变化的影响;最后通过图分类方法完成文本分类。在4个基准数据集上与5种分类方法进行了比较,实验结果表明Invariant-GCN具有良好的文本分类效果。

Text classification is a basic and important task in natural language processing,and graph neural networks have been applied to this task in recent years.However,the graph representation learning using graph neural networks can not well satisfy the generalization learning of new words in the task involving text classification.It is generally assumed that training and testing data come from the same distribution,which is often invalid in reality.To overcome these problems,this paper puts forward the Invariant-GCN,which is used for text categorization by GCN reported.First,to build a single figure for each document,use GCN to learn fine-grained word representation according to its local structure,which can effectivelygenerate embeddings for words not seen in the new document and then merge the word nodes as document embeddings.And then extract the maximum limit retained within the same class information expectations subgraph,use the graph to study is not affected by the distribution change.Finally,the text classification is completed by graph classification method.In four benchmark datasets,the the Invariant-GCN is compared with five classification methods,and the experimental results show that it has a good effect of text categorization.