A deep learning method based on prior knowledge with dual training for solving FPK equation

The evolution of the probability density function of a stochastic dynamical system over time can be described by a Fokker–Planck–Kolmogorov(FPK) equation, the solution of which determines the distribution of macroscopic variables in the stochastic dynamic system. Traditional methods for solving these equations often struggle with computational efficiency and scalability, particularly in high-dimensional contexts. To address these challenges, this paper proposes a novel deep learning method based on prior knowledge with dual training to solve the stationary FPK equations. Initially, the neural network is pre-trained through the prior knowledge obtained by Monte Carlo simulation(MCS). Subsequently, the second training phase incorporates the FPK differential operator into the loss function, while a supervisory term consisting of local maximum points is specifically included to mitigate the generation of zero solutions. This dual-training strategy not only expedites convergence but also enhances computational efficiency, making the method well-suited for high-dimensional systems. Numerical examples, including two different two-dimensional(2D), six-dimensional(6D), and eight-dimensional(8D) systems, are conducted to assess the efficacy of the proposed method. The results demonstrate robust performance in terms of both computational speed and accuracy for solving FPK equations in the first three systems. While the method is also applicable to high-dimensional systems, such as 8D, it should be noted that computational efficiency may be marginally compromised due to data volume constraints.

RepDNet:A re-parameterization despeckling network for autonomous underwater side-scan sonar imaging with prior-knowledge customized convolution

Side-scan sonar(SSS)is now a prevalent instrument for large-scale seafloor topography measurements,deployable on an autonomous underwater vehicle(AUV)to execute fully automated underwater acoustic scanning imaging along a predetermined trajectory.However,SSS images often suffer from speckle noise caused by mutual interference between echoes,and limited AUV computational resources further hinder noise suppression.Existing approaches for SSS image processing and speckle noise reduction rely heavily on complex network structures and fail to combine the benefits of deep learning and domain knowledge.To address the problem,Rep DNet,a novel and effective despeckling convolutional neural network is proposed.Rep DNet introduces two re-parameterized blocks:the Pixel Smoothing Block(PSB)and Edge Enhancement Block(EEB),preserving edge information while attenuating speckle noise.During training,PSB and EEB manifest as double-layered multi-branch structures,integrating first-order and secondorder derivatives and smoothing functions.During inference,the branches are re-parameterized into a 3×3 convolution,enabling efficient inference without sacrificing accuracy.Rep DNet comprises three computational operations:3×3 convolution,element-wise summation and Rectified Linear Unit activation.Evaluations on benchmark datasets,a real SSS dataset and Data collected at Lake Mulan aestablish Rep DNet as a well-balanced network,meeting the AUV computational constraints in terms of performance and latency.

Assessing healthcare workers’knowledge and confidence in the diagnosis,management and prevention of Monkeypox

BACKGROUND Monkeypox(Mpox),is a disease of global public health concern,as it does not affect only countries in western and central Africa.AIM To assess Burundi healthcare workers(HCWs)s’level of knowledge and confidence in the diagnosis and management of Mpox.METHODS We conducted a cross-sectional study via an online survey designed mainly from the World Health Organization course distributed among Burundi HCWs from June-July 2023.The questionnaire comprises 8 socioprofessional-related questions,22 questions about Mpox disease knowledge,and 3 questions to assess confidence in Mpox diagnosis and management.The data were analyzed via SPSS software version 25.0.A P value<0.05 was considered to indicate statistical significance.RESULTS The study sample comprised 471 HCWs who were mainly medical doctors(63.9%)and nurses(30.1%).None of the 22 questions concerning Mpox knowledge had at least 50%correct responses.A very low number of HCWs(17.4%)knew that Mpox has a vaccine.The confidence level to diagnose(21.20%),treat(18.00%)or prevent(23.30%)Mpox was low among HCWs.The confidence level in the diagnosis of Mpox was associated with the HCWs’age(P value=0.009),sex(P value<0.001),work experience(P value=0.002),and residence(P value<0.001).The confidence level to treat Mpox was significantly associated with the HCWs’age(P value=0.050),sex(P value<0.001),education(P value=0.033)and occupation(P value=0.005).The confidence level to prevent Mpox was associated with the HCWs’education(P value<0.001),work experience(P value=0.002),residence(P value<0.001)and type of work institution(P value=0.003).CONCLUSION This study revealed that HCWs have the lowest level of knowledge regarding Mpox and a lack of confidence in the ability to diagnose,treat or prevent it.There is an urgent need to organize continuing medical education programs on Mpox epidemiology and preparedness for Burundi HCWs.We encourage future researchers to assess potential hesitancy toward Mpox vaccination and its associated factors.

Prioritizing sustainable development goals and linking them to ecosystem services:A global expert’s knowledge evaluation

The implementation of strategies to achieve the Sustainable Development Goals(SDGs)is frequently hindered by potential trade-offs between priorities for either environmental protection or human well-being.However,ecosystem services(ES)-based solutions can offer possible co-benefits for SDGs implementation that are often overlooked or underexploited.In this study,we cover this gap and investigate how experts from different countries value the SDGs and relate them with ES.A total of 66 countries participated to the survey,and answers were grouped into three macro-regions:Asia;Europe,North America,and Oceania(ENO);Latin America,Caribbean and Africa(LA).Results show that the most prioritized SDGs in the three macro-regions are usually those related to essential material needs and environmental conditions,such as SDG2(Zero Hunger),SDG1(No Poverty),and SDG6(Clean Water).At a global scale,the number of prioritized synergies between SDGs and ES largely exceeded trade-offs.The highest amount of synergies was observed for SDG1(No Poverty),mainly with SDG2,SDG3(Good Health),SDG5(Gender Equality),and SDG8(Economic Growth).Other major synergies among SDGs include SDG14-15(Life below water-Life on land),SDG5-10(Gender Equity-Reduced Inequality),and SDG1-2(No poverty-Zero Hunger).At a global scale,SDG15,SDG13,SDG14,and SDG6 were closely related to ES like climate regulation,freshwater,food,water purification,biodiversity,and education.SDG11(Sustainable Cities)and SDG3 were also relevant in Asia and in LA,respectively.Overall,this study shows the potential to couple future policies that can implement SDGs’strategies while adopting ES-based solutions in different regions of the world.

Dynamic Spectrum Access Based on Prior Knowledge Enabled Reinforcement Learning with Double Actions in Complex Electromagnetic Environment

The spectrum access problem of cognitive users in the fast-changing dynamic interference spectrum environment is addressed in this paper.The prior knowledge for the dynamic spectrum access is modeled and a reliability quantification scheme is presented to guide the use of the prior knowledge in the learning process.Furthermore,a spectrum access scheme based on the prior knowledge enabled RL(PKRL)is designed,which effectively improved the learning efficiency and provided a solution for users to better adapt to the fast-changing and high-density electromagnetic environment.Compared with the existing methods,the proposed algorithm can adjust the access channel online according to historical information and improve the efficiency of the algorithm to obtain the optimal access policy.Simulation results show that,the convergence speed of the learning is improved by about 66%with the invariant average throughput.

Cascade Human Activity Recognition Based on Simple Computations Incorporating Appropriate Prior Knowledge

The purpose of Human Activities Recognition(HAR)is to recognize human activities with sensors like accelerometers and gyroscopes.The normal research strategy is to obtain better HAR results by finding more efficient eigenvalues and classification algorithms.In this paper,we experimentally validate the HAR process and its various algorithms independently.On the base of which,it is further proposed that,in addition to the necessary eigenvalues and intelligent algorithms,correct prior knowledge is even more critical.The prior knowledge mentioned here mainly refers to the physical understanding of the analyzed object,the sampling process,the sampling data,the HAR algorithm,etc.Thus,a solution is presented under the guidance of right prior knowledge,using Back-Propagation neural networks(BP networks)and simple Convolutional Neural Networks(CNN).The results show that HAR can be achieved with 90%–100%accuracy.Further analysis shows that intelligent algorithms for pattern recognition and classification problems,typically represented by HAR,require correct prior knowledge to work effectively.

Formal Inferring the Law of Conservation of Energy from Assuming A-Priori-ness of Knowledge in a Formal Axiomatic Epistemology System Sigma

The research purpose is invention (construction) of a formal logical inference of the Law of Conservation of Energy within a logically formalized axiomatic epistemology-and-axiology theory Sigma from a precisely defined assumption of a-priori-ness of knowledge. For realizing this aim, the following work has been done: 1) a two-valued algebraic system of formal axiology has been defined precisely and applied to proper-philosophy of physics, namely, to an almost unknown (not-recognized) formal-axiological aspect of the physical law of conservation of energy;2) the formal axiomatic epistemology-and-axiology theory Sigma has been defined precisely and applied to proper-physics for realizing the above-indicated purpose. Thus, a discrete mathematical model of relationship between philosophy of physics and universal epistemology united with formal axiology has been constructed. Results: 1) By accurate computing relevant compositions of evaluation-functions within the discrete mathematical model, it is demonstrated that a formal-axiological analog of the great conservation law of proper physics is a formal-axiological law of two-valued algebra of metaphysics. (A precise algorithmic definition of the unhabitual (not-well-known) notion “formal-axiological law of algebra of metaphysics” is given.) 2) The hitherto never published significantly new nontrivial scientific result of investigation presented in this article is a formal logical inference of the law of conservation of energy within the formal axiomatic theory Sigma from conjunction of the formal-axiological analog of the law of conservation of energy and the assumption of a-priori-ness of knowledge.

The Relationship between the ESL Students' Prior Knowledge and Their Reading Comprehension

This article will firstly review literature about the readers' prior knowledge and its roles in reading comprehension.Secondly,it will explore the kind of prior knowledge which should ESL tertiary students have in their English reading comprehension.Thirdly,the essay will describe a research among the ESL tertiary students from China about their views on the relationship between prior knowledge and reading comprehension.

Low-Cost Federated Broad Learning for Privacy-Preserved Knowledge Sharing in the RIS-Aided Internet of Vehicles

High-efficiency and low-cost knowledge sharing can improve the decision-making ability of autonomous vehicles by mining knowledge from the Internet of Vehicles(IoVs).However,it is challenging to ensure high efficiency of local data learning models while preventing privacy leakage in a high mobility environment.In order to protect data privacy and improve data learning efficiency in knowledge sharing,we propose an asynchronous federated broad learning(FBL)framework that integrates broad learning(BL)into federated learning(FL).In FBL,we design a broad fully connected model(BFCM)as a local model for training client data.To enhance the wireless channel quality for knowledge sharing and reduce the communication and computation cost of participating clients,we construct a joint resource allocation and reconfigurable intelligent surface(RIS)configuration optimization framework for FBL.The problem is decoupled into two convex subproblems.Aiming to improve the resource scheduling efficiency in FBL,a double Davidon–Fletcher–Powell(DDFP)algorithm is presented to solve the time slot allocation and RIS configuration problem.Based on the results of resource scheduling,we design a reward-allocation algorithm based on federated incentive learning(FIL)in FBL to compensate clients for their costs.The simulation results show that the proposed FBL framework achieves better performance than the comparison models in terms of efficiency,accuracy,and cost for knowledge sharing in the IoV.

Incorporating empirical knowledge into data-driven variable selection for quantitative analysis of coal ash content by laser-induced breakdown spectroscopy

Laser-induced breakdown spectroscopy(LIBS)has become a widely used atomic spectroscopic technique for rapid coal analysis.However,the vast amount of spectral information in LIBS contains signal uncertainty,which can affect its quantification performance.In this work,we propose a hybrid variable selection method to improve the performance of LIBS quantification.Important variables are first identified using Pearson's correlation coefficient,mutual information,least absolute shrinkage and selection operator(LASSO)and random forest,and then filtered and combined with empirical variables related to fingerprint elements of coal ash content.Subsequently,these variables are fed into a partial least squares regression(PLSR).Additionally,in some models,certain variables unrelated to ash content are removed manually to study the impact of variable deselection on model performance.The proposed hybrid strategy was tested on three LIBS datasets for quantitative analysis of coal ash content and compared with the corresponding data-driven baseline method.It is significantly better than the variable selection only method based on empirical knowledge and in most cases outperforms the baseline method.The results showed that on all three datasets the hybrid strategy for variable selection combining empirical knowledge and data-driven algorithms achieved the lowest root mean square error of prediction(RMSEP)values of 1.605,3.478 and 1.647,respectively,which were significantly lower than those obtained from multiple linear regression using only 12 empirical variables,which are 1.959,3.718 and 2.181,respectively.The LASSO-PLSR model with empirical support and 20 selected variables exhibited a significantly improved performance after variable deselection,with RMSEP values dropping from 1.635,3.962 and 1.647 to 1.483,3.086 and 1.567,respectively.Such results demonstrate that using empirical knowledge as a support for datadriven variable selection can be a viable approach to improve the accuracy and reliability of LIBS quantification.

Design Hybrid Methods for Encoding Prior Knowledge in Feedforward Network with Application in Chemical Engineering

Three-layer feedforward networks have been widely used in modeling chemical engineering processes and prior-knowledge-based methods have been introduced to improve their performances.In this paper,we propose the methodology of designing better prior-knowledge-based hybrid methods by combining the existing ones. Then according to this methodology,two hybrid methods,interpolation-optimization (IO) method and interpolation penalty-function (IPF) method,are designed as examples.Finally,both methods are applied to modeling two cases in chemical engineering to investigate their effectiveness.Simulation results show that the performances of the hybrid methods are better than those of their parents.

Tunable structure priors for Bayesian rule learning for knowledge integrated biomarker discovery

AIM To develop a framework to incorporate background domain knowledge into classification rule learning for knowledge discovery in biomedicine.METHODS Bayesian rule learning(BRL) is a rule-based classifier that uses a greedy best-first search over a space of Bayesian belief-networks(BN) to find the optimal BN to explain the input dataset, and then infers classification rules from this BN. BRL uses a Bayesian score to evaluate the quality of BNs. In this paper, we extended the Bayesian score to include informative structure priors, which encodes our prior domain knowledge about the dataset. We call this extension of BRL as BRL_p. The structure prior has a λ hyperparameter that allows the user to tune the degree of incorporation of the prior knowledge in the model learning process. We studied the effect of λ on model learning using a simulated dataset and a real-world lung cancer prognostic biomarker dataset, by measuring the degree of incorporation of our specified prior knowledge. We also monitored its effect on the model predictive performance. Finally, we compared BRL_p to other stateof-the-art classifiers commonly used in biomedicine.RESULTS We evaluated the degree of incorporation of prior knowledge into BRL_p, with simulated data by measuring the Graph Edit Distance between the true datagenerating model and the model learned by BRL_p. We specified the true model using informative structurepriors. We observed that by increasing the value of λ we were able to increase the influence of the specified structure priors on model learning. A large value of λ of BRL_p caused it to return the true model. This also led to a gain in predictive performance measured by area under the receiver operator characteristic curve(AUC). We then obtained a publicly available real-world lung cancer prognostic biomarker dataset and specified a known biomarker from literature [the epidermal growth factor receptor(EGFR) gene]. We again observed that larger values of λ led to an increased incorporation of EGFR into the final BRL_p model. This relevant background knowledge also led to a gain in AUC.CONCLUSION BRL_p enables tunable structure priors to be incorporated during Bayesian classification rule learning that integrates data and knowledge as demonstrated using lung cancer biomarker data.

Heterogeneous Image Knowledge Driven Visual Perception

Dear Editor,This letter is concerned with visual perception closely related to heterogeneous images.Facing the huge challenge brought by different image modalities,we propose a visual perception framework based on heterogeneous image knowledge,i.e.,the domain knowledge associated with specific vision tasks,to better address the corresponding visual perception problems.

Boosting multi-features with prior knowledge for mini unmanned helicopter landmark detection

Without sufficient real training data,the data driven classification algorithms based on boosting method cannot solely be utilized to applications such as the mini unmanned helicopter landmark image detection.In this paper,we propose an approach which uses a boosting algorithm with the prior knowledge for the mini unmanned helicopter landmark image detection.The stage forward stagewise additive model of boosting is analyzed,and the approach how to combine it with the prior knowledge model is presented.The approach is then applied to landmark image detection,where the multi-features are boosted to solve a series of problems,such as rotation,noises affected,etc.Results of real flight experiments demonstrate that for small training examples the boosted learning system using prior knowledge is dramatically better than the one driven by data only.

Novel Privacy Preserving Method of Countering the Threats from Priori Knowledge

Recently,many data anonymization methods have been proposed to protect privacy in the applications of data mining.But few of them have considered the threats from user's priori knowledge of data patterns.To solve this problem,a flexible method was proposed to randomize the dataset,so that the user could hardly obtain the sensitive data even knowing data relationships in advance.The method also achieves a high level of accuracy in the mining process as demonstrated in the experiments.

A novel fracture-cavity reservoir outcrop geological knowledge base construction method considering parameter collection and processing,mutual transformation of data-knowledge,application and update

This study endeavors to formulate a comprehensive methodology for establishing a Geological Knowledge Base(GKB)tailored to fracture-cavity reservoir outcrops within the North Tarim Basin.The acquisition of quantitative geological parameters was accomplished through diverse means such as outcrop observations,thin section studies,unmanned aerial vehicle scanning,and high-resolution cameras.Subsequently,a three-dimensional digital outcrop model was generated,and the parameters were standardized.An assessment of traditional geological knowledge was conducted to delineate the knowledge framework,content,and system of the GKB.The basic parameter knowledge was extracted using multiscale fine characterization techniques,including core statistics,field observations,and microscopic thin section analysis.Key mechanism knowledge was identified by integrating trace elements from filling,isotope geochemical tests,and water-rock simulation experiments.Significant representational knowledge was then extracted by employing various methods such as multiple linear regression,neural network technology,and discriminant classification.Subsequently,an analogy study was performed on the karst fracture-cavity system(KFCS)in both outcrop and underground reservoir settings.The results underscored several key findings:(1)Utilization of a diverse range of techniques,including outcrop observations,core statistics,unmanned aerial vehicle scanning,high-resolution cameras,thin section analysis,and electron scanning imaging,enabled the acquisition and standardization of data.This facilitated effective management and integration of geological parameter data from multiple sources and scales.(2)The GKB for fracture-cavity reservoir outcrops,encompassing basic parameter knowledge,key mechanism knowledge,and significant representational knowledge,provides robust data support and systematic geological insights for the intricate and in-depth examination of the genetic mechanisms of fracture-cavity reservoirs.(3)The developmental characteristics of fracturecavities in karst outcrops offer effective,efficient,and accurate guidance for fracture-cavity research in underground karst reservoirs.The outlined construction method of the outcrop geological knowledge base is applicable to various fracture-cavity reservoirs in different layers and regions worldwide.

A Survey of Knowledge Graph Construction Using Machine Learning

Knowledge graph(KG)serves as a specialized semantic network that encapsulates intricate relationships among real-world entities within a structured framework.This framework facilitates a transformation in information retrieval,transitioning it from mere string matching to far more sophisticated entity matching.In this transformative process,the advancement of artificial intelligence and intelligent information services is invigorated.Meanwhile,the role ofmachine learningmethod in the construction of KG is important,and these techniques have already achieved initial success.This article embarks on a comprehensive journey through the last strides in the field of KG via machine learning.With a profound amalgamation of cutting-edge research in machine learning,this article undertakes a systematical exploration of KG construction methods in three distinct phases:entity learning,ontology learning,and knowledge reasoning.Especially,a meticulous dissection of machine learningdriven algorithms is conducted,spotlighting their contributions to critical facets such as entity extraction,relation extraction,entity linking,and link prediction.Moreover,this article also provides an analysis of the unresolved challenges and emerging trajectories that beckon within the expansive application of machine learning-fueled,large-scale KG construction.

Combining Deep Learning with Knowledge Graph for Design Knowledge Acquisition in Conceptual Product Design

The acquisition of valuable design knowledge from massive fragmentary data is challenging for designers in conceptual product design.This study proposes a novel method for acquiring design knowledge by combining deep learning with knowledge graph.Specifically,the design knowledge acquisition method utilises the knowledge extraction model to extract design-related entities and relations from fragmentary data,and further constructs the knowledge graph to support design knowledge acquisition for conceptual product design.Moreover,the knowledge extraction model introduces ALBERT to solve memory limitation and communication overhead in the entity extraction module,and uses multi-granularity information to overcome segmentation errors and polysemy ambiguity in the relation extraction module.Experimental comparison verified the effectiveness and accuracy of the proposed knowledge extraction model.The case study demonstrated the feasibility of the knowledge graph construction with real fragmentary porcelain data and showed the capability to provide designers with interconnected and visualised design knowledge.

Application of sparse S transform network with knowledge distillation in seismic attenuation delineation

Time-frequency analysis is a successfully used tool for analyzing the local features of seismic data.However,it suffers from several inevitable limitations,such as the restricted time-frequency resolution,the difficulty in selecting parameters,and the low computational efficiency.Inspired by deep learning,we suggest a deep learning-based workflow for seismic time-frequency analysis.The sparse S transform network(SSTNet)is first built to map the relationship between synthetic traces and sparse S transform spectra,which can be easily pre-trained by using synthetic traces and training labels.Next,we introduce knowledge distillation(KD)based transfer learning to re-train SSTNet by using a field data set without training labels,which is named the sparse S transform network with knowledge distillation(KD-SSTNet).In this way,we can effectively calculate the sparse time-frequency spectra of field data and avoid the use of field training labels.To test the availability of the suggested KD-SSTNet,we apply it to field data to estimate seismic attenuation for reservoir characterization and make detailed comparisons with the traditional time-frequency analysis methods.

A new evolutional model for institutional field knowledge flow network

Purpose:This paper aims to address the limitations in existing research on the evolution of knowledge flow networks by proposing a meso-level institutional field knowledge flow network evolution model(IKM).The purpose is to simulate the construction process of a knowledge flow network using knowledge organizations as units and to investigate its effectiveness in replicating institutional field knowledge flow networks.Design/Methodology/Approach:The IKM model enhances the preferential attachment and growth observed in scale-free BA networks,while incorporating three adjustment parameters to simulate the selection of connection targets and the types of nodes involved in the network evolution process Using the PageRank algorithm to calculate the significance of nodes within the knowledge flow network.To compare its performance,the BA and DMS models are also employed for simulating the network.Pearson coefficient analysis is conducted on the simulated networks generated by the IKM,BA and DMS models,as well as on the actual network.Findings:The research findings demonstrate that the IKM model outperforms the BA and DMS models in replicating the institutional field knowledge flow network.It provides comprehensive insights into the evolution mechanism of knowledge flow networks in the scientific research realm.The model also exhibits potential applicability to other knowledge networks that involve knowledge organizations as node units.Research Limitations:This study has some limitations.Firstly,it primarily focuses on the evolution of knowledge flow networks within the field of physics,neglecting other fields.Additionally,the analysis is based on a specific set of data,which may limit the generalizability of the findings.Future research could address these limitations by exploring knowledge flow networks in diverse fields and utilizing broader datasets.Practical Implications:The proposed IKM model offers practical implications for the construction and analysis of knowledge flow networks within institutions.It provides a valuable tool for understanding and managing knowledge exchange between knowledge organizations.The model can aid in optimizing knowledge flow and enhancing collaboration within organizations.Originality/value:This research highlights the significance of meso-level studies in understanding knowledge organization and its impact on knowledge flow networks.The IKM model demonstrates its effectiveness in replicating institutional field knowledge flow networks and offers practical implications for knowledge management in institutions.Moreover,the model has the potential to be applied to other knowledge networks,which are formed by knowledge organizations as node units.