摘要
跨语言词嵌入在自然语言处理任务中扮演着重要角色。现流行的跨语言词嵌入方法都基于一个同构假设,该假设认为不同语言的词嵌入空间具有相似的结构。然而,该同构假设在远距离语言对以及低资源上面临着巨大挑战。对此,提出对不同设置下的词嵌入进行融合创建元嵌入的方法提高跨语言词嵌入的质量。在EN-ZH上的实验结果表明,提出的元嵌入方法在跨语言词嵌入上的有效性。
Cross-language word embedding plays an important role in natural language processing tasks.The current popular cross-language word embedding methods are based on an isomorphism hypothesis,which assumes that word embedding spaces in different languages have similar structures.However,this isomorphic hypothesis faces huge challenges in terms of long-distance language pairs and low resources.In this regard,a method of fusing word embeddings under different settings to create meta-embedding is proposed to improve the quality of cross-language word embedding.The experimental results on EN-ZH show that the proposed meta-embedding method is effective in cross-language word embedding.
作者
韩越
艾山·吾买尔
HAN Yue;AISHAN Wumaier(College of Information Science and Engineering,Xinjiang University,Urumqi 830046;Xinjiang Laboratory of Multi-Language Information Technology,Xinjiang University,Urumqi 830046)
出处
《现代计算机》
2021年第20期20-25,32,共7页
Modern Computer
基金
自治区高校科研计划自然科学项目(No.XJUEDU2019I004)
国家自然科学基金项目(No.61662077)。
关键词
跨语言词嵌入
元嵌入
低资源
同构假设
Cross-Language Word Embedding
Meta-Embedding
Low Resources
Isomorphic Hypothesis