Operational requirements analysis method based on question answering of WEKG

The weapon and equipment operational requirement analysis(WEORA) is a necessary condition to win a future war,among which the acquisition of knowledge about weapons and equipment is a great challenge. The main challenge is that the existing weapons and equipment data fails to carry out structured knowledge representation, and knowledge navigation based on natural language cannot efficiently support the WEORA. To solve above problem, this research proposes a method based on question answering(QA) of weapons and equipment knowledge graph(WEKG) to construct and navigate the knowledge related to weapons and equipment in the WEORA. This method firstly constructs the WEKG, and builds a neutral network-based QA system over the WEKG by means of semantic parsing for knowledge navigation. Finally, the method is evaluated and a chatbot on the QA system is developed for the WEORA. Our proposed method has good performance in the accuracy and efficiency of searching target knowledge, and can well assist the WEORA.

DPAL-BERT:A Faster and Lighter Question Answering Model

Recent advancements in natural language processing have given rise to numerous pre-training language models in question-answering systems.However,with the constant evolution of algorithms,data,and computing power,the increasing size and complexity of these models have led to increased training costs and reduced efficiency.This study aims to minimize the inference time of such models while maintaining computational performance.It also proposes a novel Distillation model for PAL-BERT(DPAL-BERT),specifically,employs knowledge distillation,using the PAL-BERT model as the teacher model to train two student models:DPAL-BERT-Bi and DPAL-BERTC.This research enhances the dataset through techniques such as masking,replacement,and n-gram sampling to optimize knowledge transfer.The experimental results showed that the distilled models greatly outperform models trained from scratch.In addition,although the distilled models exhibit a slight decrease in performance compared to PAL-BERT,they significantly reduce inference time to just 0.25%of the original.This demonstrates the effectiveness of the proposed approach in balancing model performance and efficiency.

ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering

Recently,pre-trained language representation models such as bidirec-tional encoder representations from transformers(BERT)have been performing well in commonsense question answering(CSQA).However,there is a problem that the models do not directly use explicit information of knowledge sources existing outside.To augment this,additional methods such as knowledge-aware graph network(KagNet)and multi-hop graph relation network(MHGRN)have been proposed.In this study,we propose to use the latest pre-trained language model a lite bidirectional encoder representations from transformers(ALBERT)with knowledge graph information extraction technique.We also propose to applying the novel method,schema graph expansion to recent language models.Then,we analyze the effect of applying knowledge graph-based knowledge extraction techniques to recent pre-trained language models and confirm that schema graph expansion is effective in some extent.Furthermore,we show that our proposed model can achieve better performance than existing KagNet and MHGRN models in CommonsenseQA dataset.

基于知识表示学习的KBQA答案推理重排序算法

现有的知识库问答(KBQA)研究通常依赖于完善的知识库,忽视了实际应用中知识图谱稀疏性这一关键问题。为了弥补该不足,引入了知识表示学习方法,将知识库转换为低维向量,有效摆脱了传统模型中对子图搜索空间的依赖,并实现了对隐式关系的推理,这是以往研究所未涉及到的。其次,针对传统KBQA在信息检索中常见的问句语义理解错误对下游问答推理的错误传播,引入了一种基于知识表示学习的答案推理重排序机制。该机制使用伪孪生网络分别对知识三元组和问句进行表征,并融合上游任务核心实体关注度评估阶段的特征,以实现对答案推理结果三元组的有效重排序。最后,为了验证所提算法的有效性,在中国移动RPA知识图谱问答系统与英文开源数据集下分别进行了对比实验。实验结果显示,相比现有的同类模型,该算法在hits@n、准确率、F_(1)值等多个关键评估指标上均表现更佳,证明了基于知识表示学习的KBQA答案推理重排序算法在处理稀疏知识图谱的隐式关系推理和KBQA答案推理方面的优越性。

Meta-path reasoning of knowledge graph for commonsense question answering

Commonsense question answering(CQA)requires understanding and reasoning over QA context and related commonsense knowledge,such as a structured Knowledge Graph(KG).Existing studies combine language models and graph neural networks to model inference.However,traditional knowledge graph are mostly concept-based,ignoring direct path evidence necessary for accurate reasoning.In this paper,we propose MRGNN(Meta-path Reasoning Graph Neural Network),a novel model that comprehensively captures sequential semantic information from concepts and paths.In MRGNN,meta-paths are introduced as direct inference evidence and an original graph neural network is adopted to aggregate features from both concepts and paths simultaneously.We conduct sufficient experiments on the CommonsenceQA and OpenBookQA datasets,showing the effectiveness of MRGNN.Also,we conduct further ablation experiments and explain the reasoning behavior through the case study.

Automatic Question Answering from Web Documents

A passage retrieval strategy for web-based question answering （QA） systems is proposed in our QA system. It firstly analyzes the question based on semantic patterns to obtain its syntactic and semantic information and then form initial queries. The queries are used to retrieve documents from the World Wide Web （WWW） using the Google search engine. The queries are then rewritten to form queries for passage retrieval in order to improve the precision. The relations between keywords in the question are employed in our query rewrite method. The experimental result on the question set of the TREC-2003 passage task shows that our system performs well for factoid questions.

QA-KGNet:一种语言模型驱动的知识图谱问答模型

基于知识图谱的问答系统可以解析用户问题,已成为一种检索知识、自动回答所询问题的有效途径.知识图谱问答系统通常是利用神经程序归纳模型,将自然语言问题转化为逻辑形式,在知识图谱上执行该逻辑形式能够得到答案.然而,使用预训练语言模型和知识图谱的知识问答系统包含两个挑战:(1)给定问答(questionanswering, QA)上下文,需要从大型知识图谱(knowledge graph, KG)中识别相关知识;(2)对QA上下文和KG进行联合推理.基于此,提出一种语言模型驱动的知识图谱问答推理模型QA-KGNet,将QA上下文和KG连接起来形成一个工作图,使用语言模型计算给定QA上下文节点与KG节点的关联度,并使用多头图注意力网络更新节点表示.在Commonsense QA、OpenBookQA和Med QA-USMLE真实数据集上进行实验来评估QA-KGNet的性能,实验结果表明:QA-KGNet优于现有的基准模型,表现出优越的结构化推理能力.

Expert Knowledge-Based Apparel Recommendation Question and Answer System

Aiming at the lack of professional knowledge to guide apparel recommendation,an apparel recommendation method based on image design expert knowledge has been proposed.Then,apparel recommendation knowledge graphs have been created and a apparel recommendation question and answer(Q&A)system has been designed and implemented.The question templates in the apparel recommendation domain were defined,the task of recognizing the named entities of question sentences was completed by the Bi-directional encoder representations from transformer-Bi-directional long short-term memory-conditional random field(BERT-BiLSTM-CRF)model,and the question template with the highest matching degree to the user’s question was obtained by using term frequency-inverse document frequency(TF-IDF)algorithm.The corresponding cypher graph database query statement was generated to retrieve the knowledge graph for answers,and iFLYTEK’s voice application programming interface(API)was called to implement the Q&A.The experimental results have shown that the Q&A system has a high accuracy rate and application value in the field of apparel recommendations.

Application of Question and Answering on Virtual Human Dialogue:a Review and Prediction

Nowadays,virtual human(VH) is becoming a hot research topic in virtualization.VH dialogue can be categorized as an application of natural language processing(NLP) technology,since it is relational to question and answering(QA) technologies.In order to integrate these technologies,this paper reviews some important work on VH dialogue,and predicts some research points on the view of QA technologies.

旅游自动问答系统中多任务问句分类研究

目前旅游产业信息化建设需要构建旅游自动问答系统,其中问句分类是问答系统的重要组成部分,传统问句类别体系角度单一,且传统分类模型对不平衡的问句数据集表现欠佳。针对这一问题,该文从问题主题和问句答案类型两个角度构建了旅游领域的问句类别体系架构,并提出多任务问句分类模型MT-Bert,在BERT上进行多任务训练,并加入自注意力机制,使用Softmax分类器,并设计了多任务融合损失函数。在山西旅游数据集的结果表明,MT-Bert在两种类别体系的微平均F1值分别为97.6%、91.7%,且避免了非平衡数据的预测失败问题,可以有效处理非平衡数据。

基于知识图谱多跳推理的中文矿物知识问答方法与系统

已有相关矿物数据库用于存储和查询相关矿物知识,常用的搜索引擎也可以对矿物知识进行查询,但无法回答用自然语言进行提问的矿物问题,查询返回的答案需要进一步筛选。亦有基于知识图谱进行矿物知识问答的相关研究,但只能回答涉及知识图谱中一个三元组的简单问题,无法回答涉及多个三元组的多跳复杂问题。为此,本文提出基于知识图谱多跳推理的矿物复杂知识问答方法,采用ComplEx模型将矿物实体、关系和问句表示为复数向量,以更好地获取相互之间的语义及推理关系。输入矿物问句后,通过Bert-LSTM-CRF获取其中心词,采用基于编辑距离及分词的方法获得中心词的候选实体集合,然后采用全连接网络确定最相关的实体作为推理起点,与矿物问句拼接后通过全连接网络获得当前跳的最相关关系。根据当前跳的起始实体及最相关关系,在矿物知识图谱中获得另一实体作为下一跳的推理起点,并将下一跳的问句更新为原问句,与当前跳最相关关系拼接,以将当前跳的推理信息带入到下一跳推理中,直到获得的最相关推理关系为预定义的结束标识符,推理结束,返回最后一跳的实体为答案,并给出推理路径。采用Python语言,在Tensorflow框架下实现了本文提出的矿物复杂知识问答并与相关模型进行对比,证明了本文方法的有效性。采用前后端分离架构,使用RESTful API、React、Ajax、echarts和Flask等框架和技术,开发了基于知识图谱多跳推理的矿物复杂知识问答系统,为矿物知识获取及相关地质研究提供了平台和工具。

融入三维语义特征的常识推理问答方法

现有使用预训练语言模型和知识图谱的常识问答方法主要集中于构建知识图谱子图及跨模态信息结合的研究,忽略了知识图谱自身丰富的语义特征,且缺少对不同问答任务的知识图谱子图节点相关性的动态调整,导致预测准确率低。为解决以上问题,提出一种融入三维语义特征的常识推理问答方法。首先提出知识图谱节点的关系层级、实体层级、三元组层级三维语义特征量化指标;其次,通过注意力机制动态计算关系层级、实体层级、三元组层级三种维度的语义特征对不同实体节点间的重要性;最后,通过图神经网络进行多层聚合迭代嵌入三维语义特征,获得更多的外推知识表示,更新知识图谱子图节点表示,提升答案预测精度。与QA-GNN常识问答推理方法相比,所提方法在CommonsenseQA数据集上的验证集和测试集的准确率分别提高了1.70个百分点和0.74个百分点,在OpenBookQA数据集上使用AristoRoBERTa数据处理方法的准确率提高了1.13个百分点。实验结果表明,所提出的融入三维语义特征的常识推理问答方法能够有效提高常识问答任务准确率。

融合GPT和知识图谱的洪涝应急决策智能问答系统研究

为提高生成式预训练语言大模型(generative pre-trained transformer, GPT)的应急管理信息分析能力,以实现洪涝灾害应急处置过程中的在线辅助决策,提出融合GPT和知识图谱的应急决策智能问答系统(KG-GPT)。改进GPT架构以识别问题中的关键信息,利用知识图谱推理应急领域知识并生成具有逻辑性的回答;结合洪涝灾害的实际应急决策问答数据集并编制演练脚本,使用自动评估和专家评估方法将本系统与GPT进行对比实验。研究结果表明:该系统成功融合应急领域知识图谱和GPT模型,能够深刻理解问题的背景信息并生成流畅回答;与GPT相比,该系统可为决策者提供更快速准确的在线辅助决策工具。研究结果可提升洪涝灾害应急信息分析和决策效率。

基于问题与关系嵌入空间对齐的知识图谱问答

为解决基于嵌入的知识图谱问答中,因采用不同的训练模型导致问题嵌入与知识图谱嵌入处于不同语义空间的问题,提出一种知识图谱问答模型。将关系转换为手工构造的自然语言问题,通过神经网络训练问题的嵌入表示与知识图谱的关系嵌入表示尽可能靠近;通过训练集中的问题对神经网络参数进行微调,使答案获得最高评分。在WebquestionSP数据集上的实验结果表明,相较于EmbedKGQA,所提方法的hits@1指标提高了10.5个百分点;在缺失50%三元组的情况下hits@1指标提高了9.9个百分点。

面向地质图的知识图谱构建及智能问答应用

海量地质图件蕴含着丰富的地学基础知识及专家经验知识。地质图主要表达了通过区域地质调查、矿产地质调查所获取的地球表面的地质知识(如地层单元、岩体、断裂等)。如何快速地从矢量地质图件中抽取地质知识并形成知识服务是目前地学知识图谱及知识服务研究的前沿。由于传统的地质图知识抽取主要依赖人工方式进行综合分析,本文聚焦于矢量地质图件知识表达与抽取研究,提出了一种地质图知识表达框架,提取地质图中所包含的地质实体及关系,将地质图信息以知识图谱的形式表达,并开展了基于地质矢量知识图谱的智能问答应用。最后以江西省于都县银坑幅矢量数据集为例开展实验验证分析,结果表明,本文方法能够较为全面地获取地质图中各个地质对象的信息,提高了地质图语义表达的效果,同时也可以提高地质学习人员对地质图的理解和认识,让计算机能够大规模获取地质图的知识内容。

基于知识图谱的问答系统研究

随着信息时代的快速发展,问答系统作为知识获取的重要工具,其研究和应用价值日益凸显。传统的问答系统主要依赖于关键词匹配或预先定义模板,难以处理复杂、具有深度的问题,而基于知识图谱的问答系统应用先进的语言系统进行问题解答,用户能高效、准确地获取所需信息。文章将深入探讨知识图谱的构建、表示与更新,以及基于知识图谱的问答系统的设计、实现与应用,通过案例分析,揭示其面临的挑战与未来发展方向,并为问答系统的进一步发展提供有益的参考和启示,希望能够给人们获取知识带来更为便捷和智能的体验。

航空发动机润滑系统故障知识图谱构建及应用

由于航空发动机润滑系统结构功能复杂,基于现有的健康管理系统开展故障诊断存在可解释性不足及高度依赖专家经验的问题,提出一套面向航空发动机润滑系统的故障知识图谱构建方法。在结合专家知识设计润滑系统故障知识图谱本体概念的基础上,采用双向长短期记忆(BiLSTM)神经网络和条件随机场(CRF)等深度学习技术实现知识自主抽取,并基于余弦距离和Jaccard相关系数法进行多源异构故障知识的融合。同时,基于构建的润滑系统故障知识图谱,实现润滑系统故障知识智能问答和故障归因分析应用。结果表明:知识图谱技术能够实现对润滑系统故障先验知识利用及故障原因解释,在智能故障诊断领域具有良好应用前景。

基于层次结构图的多跳知识图谱问答模型

知识图谱问答(KBQA)旨在理解用户的自然语言问句,在结构化的知识图谱中通过检索、推理等手段来获取答案实体。近年来,多跳KBQA备受关注,然而,复杂问句中通常存在多个关系意图,已有KBQA方法大多忽视了推理关系链的关系顺序问题。为此,提出一种基于层次结构图的多跳知识图谱问答模型(HSG-KBQA),建模自然语言问句的关系层次顺序,指导模型在每个推理步选择合理的关系意图。设计一种层次结构图,显式地体现问句中关系的层次距离,利用LSTM-BiGCN编码层将词语间的依存信息编码到问句中;提出虚拟节点的概念,利用图池化技术过滤不重要的节点,学习推理过程中知识图谱的状态;设计基于注意力机制和层次权重的解码器来优化指令生成,使推理指令更匹配问句中的关系链顺序。实验结果表明,HSG-KBQA在WebQuestionsSP数据集上取得了71.3%的Hits@1分数,在PathQuestions数据集上取得了97.3%(PQ-2H)和89.7%(PQ-3H)的Hits@1分数,均优于对照基准模型,表明HSG-KBQA模型在KBQA任务中具有更好的性能。

煤矿工种知识图谱智能问答研究

知识图谱是用于表征实体间结构关系的新一代知识库,其通过语义网络描述现实世界事物之间的逻辑关系,而基于知识图谱的智能问答技术也在不断发展,智能问答系统与知识图谱相结合,是对结构化知识的进一步剖析及利用。该文通过收集煤矿工种专业信息,构建煤矿工种知识图谱,并在此基础上对智能问答技术和系统进行了研究。在知识图谱构建方面,对工种专业进行定义,通过Bert-BiLSTM-CRF实体识别模型对煤矿工种关键信息进行抽取,再利用图数据库存储三元组工种知识数据得到工种图谱。在智能问答环节,通过设计问题模板,利用Bert模型实现端到端的问句意图识别和槽位提取,并采用Sentente-Bert对问句的提及词和知识图谱的候选实体进行链接,继而将问句转化形成图数据库查询语句,从图谱中返回答案。实验结果表明,构建的煤矿工种知识图谱及智能问答系统,在多个评价指标表现良好,可以满足煤矿工种知识问答需求,为煤矿智能化建设做出了有益探索。

基于知识图谱的农作物良种问答系统的设计与实现

种子是农业生产的基础,通过科学评估农作物品种的适应性、产量潜力、品质特性、抗性等因素,选择适宜当地生态环境和市场需求的优良品种,对提高农业生产效益、促进农村经济发展和农民增收具有重要意义.因此,基于知识图谱技术,构建一个农作物良种问答系统,以帮助农户快速、准确地获取农作物品种相关信息,提高农业生产效率,增加农民收益.为此,研究收集农作物品种相关数据,包括品种名称、品种来源、生长周期、适宜种植区域、发病阶段等信息;采用数据预处理、知识融合和知识存储等方法构建农作物品种知识图谱;借助自然语言处理和BiLSTM-CRF技术设计并开发了一个问答系统.经测试,构建的农作物良种问答系统准确率可达87.67%,能满足用户对农作物品种信息的查询、获取和推荐需求.