半监督跨领域语义依存分析技术研究

Semi-supervised Domain Adaptation for Semantic Dependency Parsing

近年来,尽管深度学习给语义依存分析带来了长足的进步,但由于语义依存分析数据标注代价非常高昂,并且在单领域上性能较好的依存分析器迁移到其他领域时,其性能会大幅度下降。因此为了使其走向实用,就必须解决领域适应问题。该文提出一个新的基于对抗学习的领域适应依存分析模型,该模型基于对抗学习的共享双编码器结构,并引入领域私有辅助任务和正交约束,同时也探究了多种预训练模型在跨领域依存分析任务上的效果和性能。

To address the domain adaptation of a dependency parser with better performance in a single domain, this paper proposes a new semi-supervised method based on adversarial learning. We design a shared dual encoder structure based on adversarial learning, and introduce domain private auxiliary tasks and orthogonal constraints. At the same time, we explore a variety of pre-trained models in the cross domain dependency parsing task about the effectiveness and performance.