When the training data are insufficient, especially when only a small sample size of data is available, domain knowledge will be taken into the process of learning parameters to improve the performance of the Bayesian...When the training data are insufficient, especially when only a small sample size of data is available, domain knowledge will be taken into the process of learning parameters to improve the performance of the Bayesian networks. In this paper, a new monotonic constraint model is proposed to represent a type of common domain knowledge. And then, the monotonic constraint estimation algorithm is proposed to learn the parameters with the monotonic constraint model. In order to demonstrate the superiority of the proposed algorithm, series of experiments are carried out. The experiment results show that the proposed algorithm is able to obtain more accurate parameters compared to some existing algorithms while the complexity is not the highest.展开更多
Several recent successes in deep learning(DL),such as state-of-the-art performance on several image classification benchmarks,have been achieved through the improved configuration.Hyperparameters(HPs)tuning is a key f...Several recent successes in deep learning(DL),such as state-of-the-art performance on several image classification benchmarks,have been achieved through the improved configuration.Hyperparameters(HPs)tuning is a key factor affecting the performance of machine learning(ML)algorithms.Various state-of-the-art DL models use different HPs in different ways for classification tasks on different datasets.This manuscript provides a brief overview of learning parameters and configuration techniques to show the benefits of using a large-scale handdrawn sketch dataset for classification problems.We analyzed the impact of different learning parameters and toplayer configurations with batch normalization(BN)and dropouts on the performance of the pre-trained visual geometry group 19(VGG-19).The analyzed learning parameters include different learning rates and momentum values of two different optimizers,such as stochastic gradient descent(SGD)and Adam.Our analysis demonstrates that using the SGD optimizer and learning parameters,such as small learning rates with high values of momentum,along with both BN and dropouts in top layers,has a good impact on the sketch image classification accuracy.展开更多
Osteosarcoma is a type of malignant bone tumor that is reported across the globe.Recent advancements in Machine Learning(ML)and Deep Learning(DL)models enable the detection and classification of malignancies in biomed...Osteosarcoma is a type of malignant bone tumor that is reported across the globe.Recent advancements in Machine Learning(ML)and Deep Learning(DL)models enable the detection and classification of malignancies in biomedical images.In this regard,the current study introduces a new Biomedical Osteosarcoma Image Classification using Elephant Herd Optimization and Deep Transfer Learning(BOIC-EHODTL)model.The presented BOIC-EHODTL model examines the biomedical images to diagnose distinct kinds of osteosarcoma.At the initial stage,Gabor Filter(GF)is applied as a pre-processing technique to get rid of the noise from images.In addition,Adam optimizer with MixNet model is also employed as a feature extraction technique to generate feature vectors.Then,EHOalgorithm is utilized along with Adaptive Neuro-Fuzzy Classifier(ANFC)model for recognition and categorization of osteosarcoma.EHO algorithm is utilized to fine-tune the parameters involved in ANFC model which in turn helps in accomplishing improved classification results.The design of EHO with ANFC model for classification of osteosarcoma is the novelty of current study.In order to demonstrate the improved performance of BOIC-EHODTL model,a comprehensive comparison was conducted between the proposed and existing models upon benchmark dataset and the results confirmed the better performance of BOIC-EHODTL model over recent methodologies.展开更多
The accuracy of target threat estimation has a great impact on command decision-making.The Bayesian network,as an effective way to deal with the problem of uncertainty,can be used to track the change of the target thr...The accuracy of target threat estimation has a great impact on command decision-making.The Bayesian network,as an effective way to deal with the problem of uncertainty,can be used to track the change of the target threat level.Unfortunately,the traditional discrete dynamic Bayesian network(DDBN)has the problems of poor parameter learning and poor reasoning accuracy in a small sample environment with partial prior information missing.Considering the finiteness and discreteness of DDBN parameters,a fuzzy k-nearest neighbor(KNN)algorithm based on correlation of feature quantities(CF-FKNN)is proposed for DDBN parameter learning.Firstly,the correlation between feature quantities is calculated,and then the KNN algorithm with fuzzy weight is introduced to fill the missing data.On this basis,a reasonable DDBN structure is constructed by using expert experience to complete DDBN parameter learning and reasoning.Simulation results show that the CF-FKNN algorithm can accurately fill in the data when the samples are seriously missing,and improve the effect of DDBN parameter learning in the case of serious sample missing.With the proposed method,the final target threat assessment results are reasonable,which meets the needs of engineering applications.展开更多
The uncertainty during the period of software project development often brings huge risks to contractors and clients. If we can find an effective method to predict the cost and quality of software projects based on fa...The uncertainty during the period of software project development often brings huge risks to contractors and clients. If we can find an effective method to predict the cost and quality of software projects based on facts like the project character and two-side cooperating capability at the beginning of the project,we can reduce the risk. Bayesian Belief Network(BBN) is a good tool for analyzing uncertain consequences, but it is difficult to produce precise network structure and conditional probability table.In this paper,we built up network structure by Delphi method for conditional probability table learning,and learn update probability table and nodes’confidence levels continuously according to the application cases, which made the evaluation network have learning abilities, and evaluate the software development risk of organization more accurately.This paper also introduces EM algorithm, which will enhance the ability to produce hidden nodes caused by variant software projects.展开更多
This study investigates the performance of four machine learning(ML)algorithms to evaluate the earthquake-induced liquefaction potential of soil based on the cone penetration test field case history records using the ...This study investigates the performance of four machine learning(ML)algorithms to evaluate the earthquake-induced liquefaction potential of soil based on the cone penetration test field case history records using the Bayesian belief network(BBN)learning software Netica.The BBN structures that were developed by ML algorithms-K2,hill climbing(HC),tree augmented naive(TAN)Bayes,and Tabu search were adopted to perform parameter learning in Netica,thereby fixing the BBN models.The performance measure indexes,namely,overall accuracy(OA),precision,recall,F-measure,and area under the receiver operating characteristic curve,were used to evaluate the training and testing BBN models’performance and highlight the capability of the K2 and TAN Bayes models over the Tabu search and HC models.The sensitivity analysis results showed that the cone tip resistance and vertical effective stress are the most sensitive factors,whereas the mean grain size is the least sensitive factor in the prediction of seismic soil liquefaction potential.The results of this study can provide theoretical support for researchers in selecting appropriate ML algorithms and improving the predictive performance of seismic soil liquefaction potential models.展开更多
With the acceleration of global climate change and urbanization,disaster chains are always connected to artificial systems like critical infrastructure.The complexity and uncertainty of the disaster chain development ...With the acceleration of global climate change and urbanization,disaster chains are always connected to artificial systems like critical infrastructure.The complexity and uncertainty of the disaster chain development process and the severity of the consequences have brought great challenges to emergency decision makers.The Bayesian network(BN)was applied in this study to reason about disaster chain scenarios to support the choice of appropriate response strategies.To capture the interacting relationships among different factors,a scenario representation model of disaster chains was developed,followed by the determination of the BN structure.In deriving the conditional probability tables of the BN model,we found that,due to the lack of data and the significant uncertainty of disaster chains,parameter learning methodologies based on data or expert knowledge alone are insufficient.By integrating both sample data and expert knowledge with the maximum entropy principle,we proposed a parameter estimation algorithm under expert prior knowledge(PEUK).Taking the rainstorm disaster chain as an example,we demonstrated the superiority of the PEUK-built BN model over the traditional maximum a posterior(MAP)algorithm and the direct expert opinion elicitation method.The results also demonstrate the potential of our BN scenario reasoning paradigm to assist real-world disaster decisions.展开更多
基金supported by the National Natural Science Foundation of China(6130513361573285)the Fundamental Research Funds for the Central Universities(3102016CG002)
文摘When the training data are insufficient, especially when only a small sample size of data is available, domain knowledge will be taken into the process of learning parameters to improve the performance of the Bayesian networks. In this paper, a new monotonic constraint model is proposed to represent a type of common domain knowledge. And then, the monotonic constraint estimation algorithm is proposed to learn the parameters with the monotonic constraint model. In order to demonstrate the superiority of the proposed algorithm, series of experiments are carried out. The experiment results show that the proposed algorithm is able to obtain more accurate parameters compared to some existing algorithms while the complexity is not the highest.
文摘Several recent successes in deep learning(DL),such as state-of-the-art performance on several image classification benchmarks,have been achieved through the improved configuration.Hyperparameters(HPs)tuning is a key factor affecting the performance of machine learning(ML)algorithms.Various state-of-the-art DL models use different HPs in different ways for classification tasks on different datasets.This manuscript provides a brief overview of learning parameters and configuration techniques to show the benefits of using a large-scale handdrawn sketch dataset for classification problems.We analyzed the impact of different learning parameters and toplayer configurations with batch normalization(BN)and dropouts on the performance of the pre-trained visual geometry group 19(VGG-19).The analyzed learning parameters include different learning rates and momentum values of two different optimizers,such as stochastic gradient descent(SGD)and Adam.Our analysis demonstrates that using the SGD optimizer and learning parameters,such as small learning rates with high values of momentum,along with both BN and dropouts in top layers,has a good impact on the sketch image classification accuracy.
基金The authors extend their appreciation to the Deanship of Scientific Research at King Khalid University for funding this work through Large Groups Project under grant number(42/43)Princess Nourah bint Abdulrahman University Researchers Supporting Project number(PNURSP2022R151)Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia.The authors would like to thank the Deanship of Scientific Research at Umm Al-Qura University for supporting this work by Grant Code:(22UQU4340237DSR16).
文摘Osteosarcoma is a type of malignant bone tumor that is reported across the globe.Recent advancements in Machine Learning(ML)and Deep Learning(DL)models enable the detection and classification of malignancies in biomedical images.In this regard,the current study introduces a new Biomedical Osteosarcoma Image Classification using Elephant Herd Optimization and Deep Transfer Learning(BOIC-EHODTL)model.The presented BOIC-EHODTL model examines the biomedical images to diagnose distinct kinds of osteosarcoma.At the initial stage,Gabor Filter(GF)is applied as a pre-processing technique to get rid of the noise from images.In addition,Adam optimizer with MixNet model is also employed as a feature extraction technique to generate feature vectors.Then,EHOalgorithm is utilized along with Adaptive Neuro-Fuzzy Classifier(ANFC)model for recognition and categorization of osteosarcoma.EHO algorithm is utilized to fine-tune the parameters involved in ANFC model which in turn helps in accomplishing improved classification results.The design of EHO with ANFC model for classification of osteosarcoma is the novelty of current study.In order to demonstrate the improved performance of BOIC-EHODTL model,a comprehensive comparison was conducted between the proposed and existing models upon benchmark dataset and the results confirmed the better performance of BOIC-EHODTL model over recent methodologies.
基金supported by the Fundamental Scientific Research Business Expenses for Central Universities(3072021CFJ0803)the Advanced Marine Communication and Information Technology Ministry of Industry and Information Technology Key Laboratory Project(AMCIT21V3).
文摘The accuracy of target threat estimation has a great impact on command decision-making.The Bayesian network,as an effective way to deal with the problem of uncertainty,can be used to track the change of the target threat level.Unfortunately,the traditional discrete dynamic Bayesian network(DDBN)has the problems of poor parameter learning and poor reasoning accuracy in a small sample environment with partial prior information missing.Considering the finiteness and discreteness of DDBN parameters,a fuzzy k-nearest neighbor(KNN)algorithm based on correlation of feature quantities(CF-FKNN)is proposed for DDBN parameter learning.Firstly,the correlation between feature quantities is calculated,and then the KNN algorithm with fuzzy weight is introduced to fill the missing data.On this basis,a reasonable DDBN structure is constructed by using expert experience to complete DDBN parameter learning and reasoning.Simulation results show that the CF-FKNN algorithm can accurately fill in the data when the samples are seriously missing,and improve the effect of DDBN parameter learning in the case of serious sample missing.With the proposed method,the final target threat assessment results are reasonable,which meets the needs of engineering applications.
文摘The uncertainty during the period of software project development often brings huge risks to contractors and clients. If we can find an effective method to predict the cost and quality of software projects based on facts like the project character and two-side cooperating capability at the beginning of the project,we can reduce the risk. Bayesian Belief Network(BBN) is a good tool for analyzing uncertain consequences, but it is difficult to produce precise network structure and conditional probability table.In this paper,we built up network structure by Delphi method for conditional probability table learning,and learn update probability table and nodes’confidence levels continuously according to the application cases, which made the evaluation network have learning abilities, and evaluate the software development risk of organization more accurately.This paper also introduces EM algorithm, which will enhance the ability to produce hidden nodes caused by variant software projects.
基金The work presented in this paper was part of research sponsored by the National Key Research&Development Plan of China(Nos.2018YFC1505305 and 2016YFE0200100)the Key Program of the National Natural Science Foundation of China(No.51639002).
文摘This study investigates the performance of four machine learning(ML)algorithms to evaluate the earthquake-induced liquefaction potential of soil based on the cone penetration test field case history records using the Bayesian belief network(BBN)learning software Netica.The BBN structures that were developed by ML algorithms-K2,hill climbing(HC),tree augmented naive(TAN)Bayes,and Tabu search were adopted to perform parameter learning in Netica,thereby fixing the BBN models.The performance measure indexes,namely,overall accuracy(OA),precision,recall,F-measure,and area under the receiver operating characteristic curve,were used to evaluate the training and testing BBN models’performance and highlight the capability of the K2 and TAN Bayes models over the Tabu search and HC models.The sensitivity analysis results showed that the cone tip resistance and vertical effective stress are the most sensitive factors,whereas the mean grain size is the least sensitive factor in the prediction of seismic soil liquefaction potential.The results of this study can provide theoretical support for researchers in selecting appropriate ML algorithms and improving the predictive performance of seismic soil liquefaction potential models.
基金supported by the National Key Research and Development Program of China(Grant No.2021YFF0600400)the National Natural Science Foundation of China(Grant Nos.72104123,72004113)。
文摘With the acceleration of global climate change and urbanization,disaster chains are always connected to artificial systems like critical infrastructure.The complexity and uncertainty of the disaster chain development process and the severity of the consequences have brought great challenges to emergency decision makers.The Bayesian network(BN)was applied in this study to reason about disaster chain scenarios to support the choice of appropriate response strategies.To capture the interacting relationships among different factors,a scenario representation model of disaster chains was developed,followed by the determination of the BN structure.In deriving the conditional probability tables of the BN model,we found that,due to the lack of data and the significant uncertainty of disaster chains,parameter learning methodologies based on data or expert knowledge alone are insufficient.By integrating both sample data and expert knowledge with the maximum entropy principle,we proposed a parameter estimation algorithm under expert prior knowledge(PEUK).Taking the rainstorm disaster chain as an example,we demonstrated the superiority of the PEUK-built BN model over the traditional maximum a posterior(MAP)algorithm and the direct expert opinion elicitation method.The results also demonstrate the potential of our BN scenario reasoning paradigm to assist real-world disaster decisions.
基金Supported by the National Science Foundation of USA ( the most recent one being num bered PHY- 970 4 5 2 0 ) and by the U niversities of Missouri and Nebraska ( U SA )