GATiT:An Intelligent Diagnosis Model Based on Graph Attention Network Incorporating Text Representation in Knowledge Reasoning

The growing prevalence of knowledge reasoning using knowledge graphs(KGs)has substantially improved the accuracy and efficiency of intelligent medical diagnosis.However,current models primarily integrate electronic medical records(EMRs)and KGs into the knowledge reasoning process,ignoring the differing significance of various types of knowledge in EMRs and the diverse data types present in the text.To better integrate EMR text information,we propose a novel intelligent diagnostic model named the Graph ATtention network incorporating Text representation in knowledge reasoning(GATiT),which comprises text representation,subgraph construction,knowledge reasoning,and diagnostic classification.In the text representation process,GATiT uses a pre-trained model to obtain text representations of the EMRs and additionally enhances embeddings by including chief complaint information and numerical information in the input.In the subgraph construction process,GATiT constructs text subgraphs and disease subgraphs from the KG,utilizing EMR text and the disease to be diagnosed.To differentiate the varying importance of nodes within the subgraphs features such as node categories,relevance scores,and other relevant factors are introduced into the text subgraph.Themessage-passing strategy and attention weight calculation of the graph attention network are adjusted to learn these features in the knowledge reasoning process.Finally,in the diagnostic classification process,the interactive attention-based fusion method integrates the results of knowledge reasoning with text representations to produce the final diagnosis results.Experimental results on multi-label and single-label EMR datasets demonstrate the model’s superiority over several state-of-theart methods.

Knowledge Reasoning Method Based on Deep Transfer Reinforcement Learning:DTRLpath

In recent years,with the continuous development of deep learning and knowledge graph reasoning methods,more and more researchers have shown great interest in improving knowledge graph reasoning methods by inferring missing facts through reasoning.By searching paths on the knowledge graph and making fact and link predictions based on these paths,deep learning-based Reinforcement Learning(RL)agents can demonstrate good performance and interpretability.Therefore,deep reinforcement learning-based knowledge reasoning methods have rapidly emerged in recent years and have become a hot research topic.However,even in a small and fixed knowledge graph reasoning action space,there are still a large number of invalid actions.It often leads to the interruption of RL agents’wandering due to the selection of invalid actions,resulting in a significant decrease in the success rate of path mining.In order to improve the success rate of RL agents in the early stages of path search,this article proposes a knowledge reasoning method based on Deep Transfer Reinforcement Learning path(DTRLpath).Before supervised pre-training and retraining,a pre-task of searching for effective actions in a single step is added.The RL agent is first trained in the pre-task to improve its ability to search for effective actions.Then,the trained agent is transferred to the target reasoning task for path search training,which improves its success rate in searching for target task paths.Finally,based on the comparative experimental results on the FB15K-237 and NELL-995 datasets,it can be concluded that the proposed method significantly improves the success rate of path search and outperforms similar methods in most reasoning tasks.

IndRT-GCNets: Knowledge Reasoning with Independent Recurrent Temporal Graph Convolutional Representations

Due to the structural dependencies among concurrent events in the knowledge graph and the substantial amount of sequential correlation information carried by temporally adjacent events,we propose an Independent Recurrent Temporal Graph Convolution Networks(IndRT-GCNets)framework to efficiently and accurately capture event attribute information.The framework models the knowledge graph sequences to learn the evolutionary represen-tations of entities and relations within each period.Firstly,by utilizing the temporal graph convolution module in the evolutionary representation unit,the framework captures the structural dependency relationships within the knowledge graph in each period.Meanwhile,to achieve better event representation and establish effective correlations,an independent recurrent neural network is employed to implement auto-regressive modeling.Furthermore,static attributes of entities in the entity-relation events are constrained andmerged using a static graph constraint to obtain optimal entity representations.Finally,the evolution of entity and relation representations is utilized to predict events in the next subsequent step.On multiple real-world datasets such as Freebase13(FB13),Freebase 15k(FB15K),WordNet11(WN11),WordNet18(WN18),FB15K-237,WN18RR,YAGO3-10,and Nell-995,the results of multiple evaluation indicators show that our proposed IndRT-GCNets framework outperforms most existing models on knowledge reasoning tasks,which validates the effectiveness and robustness.

An Ontology Reasoning Architecture for Data Mining Knowledge Management

In order to realize the intelligent management of data mining （DM） domain knowledge, this paper presents an architecture for DM knowledge management based on ontology. Using ontology database, this architecture can realize intelligent knowledge retrieval and automatic accomplishment of DM tasks by means of ontology services. Its key features include：①Describing DM ontology and meta-data using ontology based on Web ontology language （OWL）.② Ontology reasoning function. Based on the existing concepts and relations, the hidden knowledge in ontology can be obtained using the reasoning engine. This paper mainly focuses on the construction of DM ontology and the reasoning of DM ontology based on OWL DL（s）.

High-Speed Railway Train Timetable Conflict Prediction Based on Fuzzy Temporal Knowledge Reasoning

Trains are prone to delays and deviations from train operation plans during their operation because of internal or external disturbances. Delays may develop into operational conflicts between adjacent trains as a result of delay propagation, which may disturb the arrangement of the train operation plan and threaten the operational safety of trains. Therefore, reliable conflict prediction results can be valuable references for dispatchers in making more efficient train operation adjustments when conflicts occur. In contrast to the traditional approach to conflict prediction that involves introducing random disturbances, this study addresses the issue of the fuzzification of time intervals in a train timetable based on historical statistics and the modeling of a high-speed railway train timetable based on the concept of a timed Petri net. To measure conflict prediction results more comprehensively, we divided conflicts into potential conflicts and certain conflicts and defined the judgment conditions for both. Two evaluation indexes, one for the deviation of a single train and one for the possibility of conflicts between adjacent train operations, were developed using a formalized computation method. Based on the temporal fuzzy reasoning method, with some adjustment, a new conflict prediction method is proposed, and the results of a simulation example for two scenarios are presented. The results prove that conflict prediction after fuzzy processing of the time intervals of a train timetable is more reliable and practical and can provide helpful information for use in train operation adjustment, train timetable improvement, and other purposes.

Research on knowledge reasoning of TCM based on knowledge graphs

With the widespread use of Internet,the amount of data in the field of traditional Chinese medicine(TCM)is growing exponentially.Consequently,there is much attention on the collection of useful knowledge as well as its effective organization and expression.Knowledge graphs have thus emerged,and knowledge reasoning based on this tool has become one of the hot spots of research.This paper first presents a brief introduction to the development of knowledge graphs and knowledge reasoning,and explores the significance of knowledge reasoning.Secondly,the mainstream knowledge reasoning methods,including knowledge reasoning based on traditional rules,knowledge reasoning based on distributed feature representation,and knowledge reasoning based on neural networks are introduced.Then,using stroke as an example,the knowledge reasoning methods are expounded,the principles and characteristics of commonly used knowledge reasoning methods are summarized,and the research and applications of knowledge reasoning techniques in TCM in recent years are sorted out.Finally,we summarize the problems faced in the development of knowledge reasoning in TCM,and put forward the importance of constructing a knowledge reasoning model suitable for the field of TCM.

Bayesian Diagnostic Network: A Powerful Model for Representation and Reasoning of Engineering Diagnostic Knowledge

Engineering diagnosis is essential to the operation of industrial equipment.The key to successful diagnosis is correct knowledge representation and reasoning. The Bayesiannetwork is a powerful tool for it. This paper utilizes the Bayesian network to represent and reasondiagnostic knowledge, named Bayesian diagnostic network. It provides a three-layer topologicstructure based on operating conditions, possible faults and corresponding symptoms. The paper alsodiscusses an approximate stochastic sampling algorithm. Then a practical Bayesian network for gasturbine diagnosis is constructed on a platform developed under a Visual C++ environment. It showsthat the Bayesian network is a powerful model for representation and reasoning of diagnosticknowledge. The three-layer structure and the approximate algorithm are effective also.

A Dialogue System for Coherent Reasoning with Inconsistent Knowledge Bases

Traditionally, the AI community assumes that a knowledge base must be consistent. Despite that, there are many applications where, due to the existence of rules with exceptions, inconsistent knowledge must be considered. One way of restoring consistency is to withdraw conflicting rules;however, this will destroy part of the knowledge. Indeed, a better alternative would be to give precedence to exceptions. This paper proposes a dialogue system for coherent reasoning with inconsistent knowledge, which resolves conflicts by using precedence relations of three kinds: explicit precedence relation, which is synthesized from precedence rules;implicit precedence relation, which is synthesized from defeasible rules;mixed precedence relation, which is synthesized by combining explicit and implicit precedence relations.

Knowledge Representation and Fuzzy Reasoning of an Agricultural Expert System

The design scheme of an agricultural expert system based on longan and cauliflower planting techniques is presented. Using an object-oriented design and a combination of the techniques in multimedia, database, expert system and artificial intelligence, an in-depth analysis and summary are made of the knowledge features of die agricultural multimedia expert system and data models involved. According to the practical problems in agricultural field, the architectures and functions of the system are designed, and some design ideas about the hybrid knowledge representation and fuzzy reasoning are proposed.

A Knowledge-reuse Based Intelligent Reasoning Model for Worsted Process Optimization

The textile process planning is a knowledge reuse process in nature, which depends on the expert’s knowledge and experience. It seems to be very difficult to build up an integral mathematical model to optimize hundreds of the processing parameters. In fact, the existing process cases which were recorded to ensure the ability to trace production steps can also be used to optimize the process itself. This paper presents a novel knowledge-reuse based hybrid intelligent reasoning model (HIRM) for worsted process optimization. The model architecture and reasoning mechanism are respectively described. An applied case with HIRM is given to demonstrate that the best process decision can be made, and important processing parameters such as for raw material optimized.

＂Intelligent＂ Knowledge Reuse for Complex Logistics Projects： An Application of Ontology-Driven and Case-Based Reasoning

The application potential of ontology-driven and CBR （case-based reasoning） is demonstrated for the business knowledge management particularly with respect to the reuse of knowledge of experience concerning logistics projects. The relevance of poorly structured, qualitative and especially in natural language represented knowledge is outlined for purposes of knowledge management, particularly with respect to the management of project-related knowledge. It is elucidated how this kind of knowledge can be preprocessed and reused with the support of a computer. At first, the technique of CBR is outlined in its basic fundamentals. Thereupon, it will be shown how the technique of ontologies can be used for the computer-supported processing of knowledge represented in natural language and integrated in computer-assisted CBR systems. A simple application example illustrates how ontology-driven and CBR can be used in practice within the reuse of project-related knowledge. Finally, it will be addressed which further need for research exists in principle.

Research on and implementation of a knowledge-reasoning based evaluation support system

An evaluation support system involving complicated decision making problems during engineering design of products is introduced by first describng and modeling complicated decision making problems, and then constructing and describing the architecture and functional structure of an evaluation support system, based on knowledge-based reasoning. Knowledge contains important experience of field-expert and can be classified and stored in knowledge bases, and therefore, the system suggests information-processing tools based on information resources including data knowledge bases and methods bases, which can be used to evaluate the designs against the multi-criteria decision framework thereby providing decision-makers with rational and scientific information.

A Survey of Knowledge Graph Construction Using Machine Learning

Knowledge graph(KG)serves as a specialized semantic network that encapsulates intricate relationships among real-world entities within a structured framework.This framework facilitates a transformation in information retrieval,transitioning it from mere string matching to far more sophisticated entity matching.In this transformative process,the advancement of artificial intelligence and intelligent information services is invigorated.Meanwhile,the role ofmachine learningmethod in the construction of KG is important,and these techniques have already achieved initial success.This article embarks on a comprehensive journey through the last strides in the field of KG via machine learning.With a profound amalgamation of cutting-edge research in machine learning,this article undertakes a systematical exploration of KG construction methods in three distinct phases:entity learning,ontology learning,and knowledge reasoning.Especially,a meticulous dissection of machine learningdriven algorithms is conducted,spotlighting their contributions to critical facets such as entity extraction,relation extraction,entity linking,and link prediction.Moreover,this article also provides an analysis of the unresolved challenges and emerging trajectories that beckon within the expansive application of machine learning-fueled,large-scale KG construction.

New Knowledge Network Evaluation Method for Design Rationale Management

Current design rationale （DR） systems have not demonstrated the value of the approach in practice since little attention is put to the evaluation method of DR knowledge. To systematize knowledge management process for future computer-aided DR applications, a prerequisite is to provide the measure for the DR knowledge. In this paper, a new knowledge network evaluation method for DR management is presented. The method characterizes the DR knowledge value from four perspectives, namely, the design rationale structure scale, association knowledge and reasoning ability, degree of design justification support and degree of knowledge representation conciseness. The DR knowledge comprehensive value is also measured by the proposed method. To validate the proposed method, different style of DR knowledge network and the performance of the proposed measure are discussed. The evaluation method has been applied in two realistic design cases and compared with the structural measures. The research proposes the DR knowledge evaluation method which can provide object metric and selection basis for the DR knowledge reuse during the product design process. In addition, the method is proved to be more effective guidance and support for the application and management of DR knowledge.

Experts' Knowledge Fusion in Model-Based Diagnosis Based on Bayes Networks

In previous researches on a model-based diagnostic system, the components are assumed mutually independent. Howerver , the assumption is not always the case because the information about whether a component is faulty or not usually influences our knowledge about other components. Some experts may draw such a conclusion that 'if component m 1 is faulty, then component m 2 may be faulty too'. How can we use this experts' knowledge to aid the diagnosis? Based on Kohlas's probabilistic assumption-based reasoning method, we use Bayes networks to solve this problem. We calculate the posterior fault probability of the components in the observation state. The result is reasonable and reflects the effectiveness of the experts' knowledge.

A Semantic Retrieval Method Based on the Fuzzy Reasoning

This paper gives a semantic fuzzy retrieval method of multimedia object, discusses the principle of fuzzy semantic retrieval technique, presents a fuzzy reasoning mechanism based on the knowledge base, and designs the relevant reasoning algorithms. Researchful results have innovative significance.

Design of Multi-attribute Knowledge Base Based on Hybrid Knowledge Representation

Based on the knowledge representation and knowledge reasoning, this paper addresses the creation of the multi-attribute knowledge base on the basis of hybrid knowledge representation, with the help of object-oriented programming language and relational database. Compared with general knowledge base, multi-attribute knowledge base can enhance the ability of knowledge processing and application; integrate the heterogeneous knowledge, such as model, symbol, case-based sample knowledge; and support the whole decision process by integrated reasoning.

Critical Relation Path Aggregation-Based Industrial Control Component Exploitable Vulnerability Reasoning

With the growing discovery of exposed vulnerabilities in the Industrial Control Components(ICCs),identification of the exploitable ones is urgent for Industrial Control System(ICS)administrators to proactively forecast potential threats.However,it is not a trivial task due to the complexity of the multi-source heterogeneous data and the lack of automatic analysis methods.To address these challenges,we propose an exploitability reasoning method based on the ICC-Vulnerability Knowledge Graph(KG)in which relation paths contain abundant potential evidence to support the reasoning.The reasoning task in this work refers to determining whether a specific relation is valid between an attacker entity and a possible exploitable vulnerability entity with the help of a collective of the critical paths.The proposed method consists of three primary building blocks:KG construction,relation path representation,and query relation reasoning.A security-oriented ontology combines exploit modeling,which provides a guideline for the integration of the scattered knowledge while constructing the KG.We emphasize the role of the aggregation of the attention mechanism in representation learning and ultimate reasoning.In order to acquire a high-quality representation,the entity and relation embeddings take advantage of their local structure and related semantics.Some critical paths are assigned corresponding attentive weights and then they are aggregated for the determination of the query relation validity.In particular,similarity calculation is introduced into a critical path selection algorithm,which improves search and reasoning performance.Meanwhile,the proposed algorithm avoids redundant paths between the given pairs of entities.Experimental results show that the proposed method outperforms the state-of-the-art ones in the aspects of embedding quality and query relation reasoning accuracy.

ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering

Recently,pre-trained language representation models such as bidirec-tional encoder representations from transformers(BERT)have been performing well in commonsense question answering(CSQA).However,there is a problem that the models do not directly use explicit information of knowledge sources existing outside.To augment this,additional methods such as knowledge-aware graph network(KagNet)and multi-hop graph relation network(MHGRN)have been proposed.In this study,we propose to use the latest pre-trained language model a lite bidirectional encoder representations from transformers(ALBERT)with knowledge graph information extraction technique.We also propose to applying the novel method,schema graph expansion to recent language models.Then,we analyze the effect of applying knowledge graph-based knowledge extraction techniques to recent pre-trained language models and confirm that schema graph expansion is effective in some extent.Furthermore,we show that our proposed model can achieve better performance than existing KagNet and MHGRN models in CommonsenseQA dataset.

Alzheimer’s Disease Diagnosis Based on a Semantic Rule-Based Modeling and Reasoning Approach

Alzheimer’s disease(AD)is a very complex disease that causes brain failure,then eventually,dementia ensues.It is a global health problem.99%of clinical trials have failed to limit the progression of this disease.The risks and barriers to detecting AD are huge as pathological events begin decades before appearing clinical symptoms.Therapies for AD are likely to be more helpful if the diagnosis is determined early before the final stage of neurological dysfunction.In this regard,the need becomes more urgent for biomarker-based detection.A key issue in understanding AD is the need to solve complex and high-dimensional datasets and heterogeneous biomarkers,such as genetics,magnetic resonance imaging(MRI),cerebrospinal fluid(CSF),and cognitive scores.Establishing an interpretable reasoning system and performing interoperability that achieves in terms of a semantic model is potentially very useful.Thus,our aim in this work is to propose an interpretable approach to detect AD based on Alzheimer’s disease diagnosis ontology(ADDO)and the expression of semantic web rule language(SWRL).This work implements an ontology-based application that exploits three different machine learning models.These models are random forest(RF),JRip,and J48,which have been used along with the voting ensemble.ADNI dataset was used for this study.The proposed classifier’s result with the voting ensemble achieves a higher accuracy of 94.1%and precision of 94.3%.Our approach provides effective inference rules.Besides,it contributes to a real,accurate,and interpretable classifier model based on various AD biomarkers for inferring whether the subject is a normal cognitive(NC),significant memory concern(SMC),early mild cognitive impairment(EMCI),late mild cognitive impairment(LMCI),or AD.