In the spinning process, some key process parameters( i. e.,raw material index inputs) have very strong relationship with the quality of finished products. The abnormal changes of these process parameters could result...In the spinning process, some key process parameters( i. e.,raw material index inputs) have very strong relationship with the quality of finished products. The abnormal changes of these process parameters could result in various categories of faulty products. In this paper, a hybrid learning-based model was developed for on-line intelligent monitoring and diagnosis of the spinning process. In the proposed model, a knowledge-based artificial neural network( KBANN) was developed for monitoring the spinning process and recognizing faulty quality categories of yarn. In addition,a rough set( RS)-based rule extraction approach named RSRule was developed to discover the causal relationship between textile parameters and yarn quality. These extracted rules were applied in diagnosis of the spinning process, provided guidelines on improving yarn quality,and were used to construct KBANN. Experiments show that the proposed model significantly improve the learning efficiency, and its prediction precision is improved by about 5. 4% compared with the BP neural network model.展开更多
In this paper,an approach is developed to optimize the quality of the training samples in the conventional Artificial Neural Network(ANN)by incorporating expert knowledge in the means of constructing expert-rule sampl...In this paper,an approach is developed to optimize the quality of the training samples in the conventional Artificial Neural Network(ANN)by incorporating expert knowledge in the means of constructing expert-rule samples from rules in an expert system,and through training by using these samples,an ANN based on expert-knowledge is further developed.The method is introduced into the field of quantitative identification of potential seismic sources on the basis of the rules in an expert system.Then it is applied to the quantitative identification of the potential seismic sources in Beijing and its adjacent area.The result indicates that the expert rule based on ANN method can well incorporate and represent the expert knowledge in the rules in an expert system,and the quality of the samples and the efficiency of training and the accuracy of the result are optimized.展开更多
Due to the many types of distributed denial-of-service attacks(DDoS)attacks and the large amount of data generated,it becomes a chal-lenge to manage and apply the malicious behavior knowledge generated by DDoS attacks...Due to the many types of distributed denial-of-service attacks(DDoS)attacks and the large amount of data generated,it becomes a chal-lenge to manage and apply the malicious behavior knowledge generated by DDoS attacks.We propose a malicious behavior knowledge base framework for DDoS attacks,which completes the construction and application of a multi-domain malicious behavior knowledge base.First,we collected mali-cious behavior traffic generated by five mainstream DDoS attacks.At the same time,we completed the knowledge collection mechanism through data pre-processing and dataset design.Then,we designed a malicious behavior category graph and malicious behavior structure graph for the characteristic information and spatial structure of DDoS attacks and completed the knowl-edge learning mechanism using a graph neural network model.To protect the data privacy of multiple multi-domain malicious behavior knowledge bases,we implement the knowledge-sharing mechanism based on federated learning.Finally,we store the constructed knowledge graphs,graph neural network model,and Federated model into the malicious behavior knowledge base to complete the knowledge management mechanism.The experimental results show that our proposed system architecture can effectively construct and apply the malicious behavior knowledge base,and the detection capability of multiple DDoS attacks occurring in the network reaches above 0.95,while there exists a certain anti-interference capability for data poisoning cases.展开更多
A novel knowledge-based fuzzy neural network (KBFNN) for fault diagnosis is presented. Crude rules were extracted and the corresponding dependent factors and antecedent coverage factors were calculated firstly from ...A novel knowledge-based fuzzy neural network (KBFNN) for fault diagnosis is presented. Crude rules were extracted and the corresponding dependent factors and antecedent coverage factors were calculated firstly from the diagnostic sample based on rough sets theory. Then the number of rules was used to construct partially the structure of a fuzzy neural network and those factors were implemented as initial weights, with fuzzy output parameters being optimized by genetic algorithm. Such fuzzy neural network was called KBFNN. This KBFNN was utilized to identify typical faults of rotating machinery. Diagnostic results show that it has those merits of shorter training time and higher right diagnostic level compared to general fuzzy neural networks.展开更多
With the help of the feedforward neural network diagnostic method, the hybrid diagnostic networks corresponding to information in multiple symptom domains are built and the comprehensive judgment is carried out with w...With the help of the feedforward neural network diagnostic method, the hybrid diagnostic networks corresponding to information in multiple symptom domains are built and the comprehensive judgment is carried out with weighted average method. Meanwhile, this method has the ability of self learning and self adaptation in order to adapt both the complexity of vibrations produced practically and the pluralistic potent of vibration symptoms induced really for large rotating machinery, especially for turbogenerators. The reliability and precision of diagnosis with this method is heightened. It seems that the method can take more practical value in engineering applications.展开更多
It is becoming an important social problem to make maintenance and rehabilitation of existing infrastructures such as bridges, buildings, etc. in the world. The kernel of such structure management is to develop a meth...It is becoming an important social problem to make maintenance and rehabilitation of existing infrastructures such as bridges, buildings, etc. in the world. The kernel of such structure management is to develop a method of safety assessment on items<span style="font-family:;" "=""> </span><span style="font-family:;" "="">which include remaining life and load carrying capacity. The purpose of this paper is to summarize the finding of up-to-date research articles concerning the application of knowledge-based systems to assessment and management of structures and to illustrate the potential of such systems in the structural engineering. In here, knowledge-based systems include knowledge-based expert systems incorporation with artificial neural networks, fuzzy reasoning and genetic or immune algorithms.</span><span style="font-family:;" "=""> </span><span style="font-family:;" "="">Specifically, two modern bridge management systems (BMS’s) are presented in the paper. The first is a BMS to assess the performance and derive optimal strategies for inspection and maintenance of concrete bridge structures using reliability based and knowledge-based systems. The second is the concrete bridge rating expert system (<i>J-BMS BREX</i>) to evaluate the performance of existing bridges by incorporating with artificial neural networks and fuzzy reasoning.</span>展开更多
Question answering (QA) over knowledge base (KB) aims to provide a structured answer from a knowledge base to a natural language question. In this task, a key step is how to represent and understand the natural langua...Question answering (QA) over knowledge base (KB) aims to provide a structured answer from a knowledge base to a natural language question. In this task, a key step is how to represent and understand the natural language query. In this paper, we propose to use tree-structured neural networks constructed based on the constituency tree to model natural language queries. We identify an interesting observation in the constituency tree: different constituents have their own semantic characteristics and might be suitable to solve different subtasks in a QA system. Based on this point, we incorporate the type information as an auxiliary supervision signal to improve the QA performance. We call our approach type-aware QA. We jointly characterize both the answer and its answer type in a unified neural network model with the attention mechanism. Instead of simply using the root representation, we represent the query by combining the representations of different constituents using task-specific attention weights. Extensive experiments on public datasets have demonstrated the effectiveness of our proposed model. More specially, the learned attention weights are quite useful in understanding the query. The produced representations for intermediate nodes can be used for analyzing the effectiveness of components in a QA system.展开更多
利用自然语言处理技术从生物医学文本中抽取药物治疗、疾病诊断等事件以及事件中涉及的疾病、药物等实体,对于生物医学领域相关学术研究以及各类生物医学应用系统具有重要意义。针对生物医学文本中的缩略词及专业术语难以识别和生物医...利用自然语言处理技术从生物医学文本中抽取药物治疗、疾病诊断等事件以及事件中涉及的疾病、药物等实体,对于生物医学领域相关学术研究以及各类生物医学应用系统具有重要意义。针对生物医学文本中的缩略词及专业术语难以识别和生物医学语义关系难以嵌入的问题,提出了一种融合外部知识和图卷积神经网络的生物医学信息联合识别模型。图卷积神经网络构建了包含实体和语义关系的异构图,能够迭代地融合本地知识图和外部知识图中的交互信息,根据得到的交互信息来进行生物医学实体对之间关系的抽取任务。预训练编码后利用图卷积神经网络构建本地和外部知识两个知识图,获得两个图中每个节点的特征表示,并且通过注意力实体链接的方法将两个图进行融合与信息迭代,进而抽取其最后一层隐藏层来完成最终的分类识别。其中统一医学语言系统(unified medical language system,UMLS)被用作实体消歧的外部知识库,实体链接器根据注意力权重选择对应实体。通过在MLEE语料库上进行的实验表明,联合任务能够实现事件抽取和触发词、元素识别的综合性能。展开更多
Traditional Chinese medicine prescription is one of the treasures of traditional Chinese medicine(TCM).There are tens of thousands TCM prescriptions accumulated in the past thousands of years,corresponding to differen...Traditional Chinese medicine prescription is one of the treasures of traditional Chinese medicine(TCM).There are tens of thousands TCM prescriptions accumulated in the past thousands of years,corresponding to different diseases,symptoms and therapeutic goals.The correspondences are so complicated that there is an urgent need to leverage new technologies such as artificial intelligence(AI)to analyze,understand and utilize them effectively.In this paper,we present a brief overview of this direction,where current research progress on TCM prescription powered by AI is summarized.Our summarization focuses on three aspects,TCM prescription mining that aims at understanding the TCM prescription,TCM prescription or herb knowledge base construction that aims at extracting knowledge to support the TCM prescription-related study,and TCM prescription discovery that aims at utilizing AI technologies to further energize TCM.It is encouraging to see that steady progress in this direction has been made recently.Besides,a toy experiment on image-based TCM herb recognition by using convolutional neural networks is also conducted.It basically verifies that it is promising to use AI technologies to address challenging tasks in TCM.We also point out several research topics that could be cooperatively performed by researchers from the two disciplines.展开更多
现有的方面级情感分析方法对句法依存树蕴含信息使用不足,忽略多方面词之间的关联,并且缺少对外部知识的使用。针对这些问题,提出一种知识增强的方面词交互图神经网络(KEAIG)模型。首先利用融合领域知识的BERT-PT (Bidirectional Encode...现有的方面级情感分析方法对句法依存树蕴含信息使用不足,忽略多方面词之间的关联,并且缺少对外部知识的使用。针对这些问题,提出一种知识增强的方面词交互图神经网络(KEAIG)模型。首先利用融合领域知识的BERT-PT (Bidirectional Encoder Representation from Transformers with Post-Train)编码文本,并利用知识图谱增加句法树的情感信息。模型分两部分对句法依存树蕴含的信息进行提取:第一部分利用句法依存树中的关联关系和每个单词的词性标签提取句子特征,第二部分对融入知识图谱的句法依存树进行特征提取。之后使用融合门控单元将多方面词关联特征融合进提取到的特征中。最后将两部分句子表示拼接起来作为最终分类依据。在4个数据集上的实验结果表明,所提模型相较于基准模型关系图注意力网络(RGAT),在准确率上分别提升了2.17%、5.54%、2.60%和2.83%,在F1值(Macro-F1)上分别提升了2.69%、6.87%、8.77%和14.70%,充分表明了利用句法树、引入外部知识和提取多方面词关联的有效性。展开更多
基金National Natural Science Foundation of China(No.51175077)
文摘In the spinning process, some key process parameters( i. e.,raw material index inputs) have very strong relationship with the quality of finished products. The abnormal changes of these process parameters could result in various categories of faulty products. In this paper, a hybrid learning-based model was developed for on-line intelligent monitoring and diagnosis of the spinning process. In the proposed model, a knowledge-based artificial neural network( KBANN) was developed for monitoring the spinning process and recognizing faulty quality categories of yarn. In addition,a rough set( RS)-based rule extraction approach named RSRule was developed to discover the causal relationship between textile parameters and yarn quality. These extracted rules were applied in diagnosis of the spinning process, provided guidelines on improving yarn quality,and were used to construct KBANN. Experiments show that the proposed model significantly improve the learning efficiency, and its prediction precision is improved by about 5. 4% compared with the BP neural network model.
文摘In this paper,an approach is developed to optimize the quality of the training samples in the conventional Artificial Neural Network(ANN)by incorporating expert knowledge in the means of constructing expert-rule samples from rules in an expert system,and through training by using these samples,an ANN based on expert-knowledge is further developed.The method is introduced into the field of quantitative identification of potential seismic sources on the basis of the rules in an expert system.Then it is applied to the quantitative identification of the potential seismic sources in Beijing and its adjacent area.The result indicates that the expert rule based on ANN method can well incorporate and represent the expert knowledge in the rules in an expert system,and the quality of the samples and the efficiency of training and the accuracy of the result are optimized.
基金supported by the NationalKeyR&DProgramof China underGrant No.2018YFA0701604.
文摘Due to the many types of distributed denial-of-service attacks(DDoS)attacks and the large amount of data generated,it becomes a chal-lenge to manage and apply the malicious behavior knowledge generated by DDoS attacks.We propose a malicious behavior knowledge base framework for DDoS attacks,which completes the construction and application of a multi-domain malicious behavior knowledge base.First,we collected mali-cious behavior traffic generated by five mainstream DDoS attacks.At the same time,we completed the knowledge collection mechanism through data pre-processing and dataset design.Then,we designed a malicious behavior category graph and malicious behavior structure graph for the characteristic information and spatial structure of DDoS attacks and completed the knowl-edge learning mechanism using a graph neural network model.To protect the data privacy of multiple multi-domain malicious behavior knowledge bases,we implement the knowledge-sharing mechanism based on federated learning.Finally,we store the constructed knowledge graphs,graph neural network model,and Federated model into the malicious behavior knowledge base to complete the knowledge management mechanism.The experimental results show that our proposed system architecture can effectively construct and apply the malicious behavior knowledge base,and the detection capability of multiple DDoS attacks occurring in the network reaches above 0.95,while there exists a certain anti-interference capability for data poisoning cases.
基金Project supported by the National Major Science and Technology Foundation of China during the 10th Five-Year Plan Period(No.2001BA204B05-KHK Z0009)
文摘A novel knowledge-based fuzzy neural network (KBFNN) for fault diagnosis is presented. Crude rules were extracted and the corresponding dependent factors and antecedent coverage factors were calculated firstly from the diagnostic sample based on rough sets theory. Then the number of rules was used to construct partially the structure of a fuzzy neural network and those factors were implemented as initial weights, with fuzzy output parameters being optimized by genetic algorithm. Such fuzzy neural network was called KBFNN. This KBFNN was utilized to identify typical faults of rotating machinery. Diagnostic results show that it has those merits of shorter training time and higher right diagnostic level compared to general fuzzy neural networks.
文摘With the help of the feedforward neural network diagnostic method, the hybrid diagnostic networks corresponding to information in multiple symptom domains are built and the comprehensive judgment is carried out with weighted average method. Meanwhile, this method has the ability of self learning and self adaptation in order to adapt both the complexity of vibrations produced practically and the pluralistic potent of vibration symptoms induced really for large rotating machinery, especially for turbogenerators. The reliability and precision of diagnosis with this method is heightened. It seems that the method can take more practical value in engineering applications.
文摘It is becoming an important social problem to make maintenance and rehabilitation of existing infrastructures such as bridges, buildings, etc. in the world. The kernel of such structure management is to develop a method of safety assessment on items<span style="font-family:;" "=""> </span><span style="font-family:;" "="">which include remaining life and load carrying capacity. The purpose of this paper is to summarize the finding of up-to-date research articles concerning the application of knowledge-based systems to assessment and management of structures and to illustrate the potential of such systems in the structural engineering. In here, knowledge-based systems include knowledge-based expert systems incorporation with artificial neural networks, fuzzy reasoning and genetic or immune algorithms.</span><span style="font-family:;" "=""> </span><span style="font-family:;" "="">Specifically, two modern bridge management systems (BMS’s) are presented in the paper. The first is a BMS to assess the performance and derive optimal strategies for inspection and maintenance of concrete bridge structures using reliability based and knowledge-based systems. The second is the concrete bridge rating expert system (<i>J-BMS BREX</i>) to evaluate the performance of existing bridges by incorporating with artificial neural networks and fuzzy reasoning.</span>
文摘Question answering (QA) over knowledge base (KB) aims to provide a structured answer from a knowledge base to a natural language question. In this task, a key step is how to represent and understand the natural language query. In this paper, we propose to use tree-structured neural networks constructed based on the constituency tree to model natural language queries. We identify an interesting observation in the constituency tree: different constituents have their own semantic characteristics and might be suitable to solve different subtasks in a QA system. Based on this point, we incorporate the type information as an auxiliary supervision signal to improve the QA performance. We call our approach type-aware QA. We jointly characterize both the answer and its answer type in a unified neural network model with the attention mechanism. Instead of simply using the root representation, we represent the query by combining the representations of different constituents using task-specific attention weights. Extensive experiments on public datasets have demonstrated the effectiveness of our proposed model. More specially, the learned attention weights are quite useful in understanding the query. The produced representations for intermediate nodes can be used for analyzing the effectiveness of components in a QA system.
文摘利用自然语言处理技术从生物医学文本中抽取药物治疗、疾病诊断等事件以及事件中涉及的疾病、药物等实体,对于生物医学领域相关学术研究以及各类生物医学应用系统具有重要意义。针对生物医学文本中的缩略词及专业术语难以识别和生物医学语义关系难以嵌入的问题,提出了一种融合外部知识和图卷积神经网络的生物医学信息联合识别模型。图卷积神经网络构建了包含实体和语义关系的异构图,能够迭代地融合本地知识图和外部知识图中的交互信息,根据得到的交互信息来进行生物医学实体对之间关系的抽取任务。预训练编码后利用图卷积神经网络构建本地和外部知识两个知识图,获得两个图中每个节点的特征表示,并且通过注意力实体链接的方法将两个图进行融合与信息迭代,进而抽取其最后一层隐藏层来完成最终的分类识别。其中统一医学语言系统(unified medical language system,UMLS)被用作实体消歧的外部知识库,实体链接器根据注意力权重选择对应实体。通过在MLEE语料库上进行的实验表明,联合任务能够实现事件抽取和触发词、元素识别的综合性能。
基金the National Natural Science Foundation of China(No.2019YFC1710400,2019YFC1710404).
文摘Traditional Chinese medicine prescription is one of the treasures of traditional Chinese medicine(TCM).There are tens of thousands TCM prescriptions accumulated in the past thousands of years,corresponding to different diseases,symptoms and therapeutic goals.The correspondences are so complicated that there is an urgent need to leverage new technologies such as artificial intelligence(AI)to analyze,understand and utilize them effectively.In this paper,we present a brief overview of this direction,where current research progress on TCM prescription powered by AI is summarized.Our summarization focuses on three aspects,TCM prescription mining that aims at understanding the TCM prescription,TCM prescription or herb knowledge base construction that aims at extracting knowledge to support the TCM prescription-related study,and TCM prescription discovery that aims at utilizing AI technologies to further energize TCM.It is encouraging to see that steady progress in this direction has been made recently.Besides,a toy experiment on image-based TCM herb recognition by using convolutional neural networks is also conducted.It basically verifies that it is promising to use AI technologies to address challenging tasks in TCM.We also point out several research topics that could be cooperatively performed by researchers from the two disciplines.
文摘现有的方面级情感分析方法对句法依存树蕴含信息使用不足,忽略多方面词之间的关联,并且缺少对外部知识的使用。针对这些问题,提出一种知识增强的方面词交互图神经网络(KEAIG)模型。首先利用融合领域知识的BERT-PT (Bidirectional Encoder Representation from Transformers with Post-Train)编码文本,并利用知识图谱增加句法树的情感信息。模型分两部分对句法依存树蕴含的信息进行提取:第一部分利用句法依存树中的关联关系和每个单词的词性标签提取句子特征,第二部分对融入知识图谱的句法依存树进行特征提取。之后使用融合门控单元将多方面词关联特征融合进提取到的特征中。最后将两部分句子表示拼接起来作为最终分类依据。在4个数据集上的实验结果表明,所提模型相较于基准模型关系图注意力网络(RGAT),在准确率上分别提升了2.17%、5.54%、2.60%和2.83%,在F1值(Macro-F1)上分别提升了2.69%、6.87%、8.77%和14.70%,充分表明了利用句法树、引入外部知识和提取多方面词关联的有效性。