基于长时间跨度语料的词义演变计算研究

A Study on Semantic Evolution Computation with Diachronic Corpus

该文收集了自晚清到21世纪间长达144年的连续历时报刊语料,通过统计分析和词语分布式表示两类方法展开研究,计算并辅助识别汉语词语的词义历时演变现象。采用TF-IDF、词频比例等多种统计分析的评价指标和目标词语在文段中的共现实词及其重合度挖掘出现词义演变的词语。针对历时语料上不同时间段的词向量对齐,采用SGNS训练词向量加正交矩阵投影、SGNS递增训练和"锚点词"二阶词向量表示三种方法,其中以SGNS递增训练效果最佳。针对自动发现的词义演变现象,采用目标词历时自相似度和锚点词历时相似度的分析方法,并利用近邻词来明确目标词变迁前后的词义。

This paper collected a diachronic corpus of Chinese newspapers and periodicals for the past 144 years dated back to the late Qing Dynasty.A study on word semantic evolution computation is conducted for Chinese via statistical analysis and word distributed representation.Chinese word with potential semantic evolution is first discovered by context overlapping of content words via TF-IDF,word frequency ratio and other statistical indicators.Then,to align the word embeddings derived from corpus of different time periods,three methods are examined:orthogonal matrix alignment after SGNS training,second-order word vector representation and SGNS incremental training(which bears top performance).Finally,the word semantic evolution is identified by the diachronic self-similarity of the candidate word and the diachronic similarity of anchor words,with neighboring words as the description of the word meaning in the evolution.