Joint entity-relation knowledge embedding via cost-sensitive learning

As a joint-optimization problem which simultaneously fulfills two different but correlated embedding tasks （i.e., entity embedding and relation embedding）, knowledge embedding problem is solved in a joint embedding scheme. In this embedding scheme, we design a joint compatibility scoring function to quantitatively evaluate the relational facts with respect to entities and relations, and further incorporate the scoring function into the maxmargin structure learning process that explicitly learns the embedding vectors of entities and relations using the context information of the knowledge base. By optimizing the joint problem, our design is capable of effectively capturing the intrinsic topological structures in the learned embedding spaces. Experimental results demonstrate the effectiveness of our embedding scheme in characterizing the semantic correlations among different relation units, and in relation prediction for knowledge inference.

我们将实体嵌入问题看作同时完成两个不同但相关的嵌入任务(实体嵌入和关系嵌入)的联合优化问题,并在联合嵌入框架下求解该问题。在该嵌入框架下,我们设计了联合评分函数,用以对实体和关系间的相关性实例进行量化评价,并将评分函数融入最大间隔学习方法中,使用知识库中的上下文信息学习实体与关系的嵌入向量。通过求解联合优化问题,我们的设计有效地表达了嵌入空间的固有拓扑结构。实验结果证实了我们的嵌入框架在表达不同关系的语义相关性和进行知识推理中的关系预测时的有效性。