Structural reliability analysis using enhanced cuckoo search algorithm and artificial neural network

The present study proposed an enhanced cuckoo search(ECS) algorithm combined with artificial neural network(ANN) as the surrogate model to solve structural reliability problems. In order to enhance the accuracy and convergence rate of the original cuckoo search(CS) algorithm, the main parameters namely, abandon probability of worst nests paand search step sizeα0 are dynamically adjusted via nonlinear control equations. In addition, a global-best guided equation incorporating the information of global best nest is introduced to the ECS to enhance its exploitation. Then, the proposed ECS is linked to the well-trained ANN model for structural reliability analysis. The computational capability of the proposed algorithm is validated using five typical structural reliability problems and an engineering application. The comparison results show the efficiency and accuracy of the proposed algorithm.

ANN Model and Learning Algorithm in Fault Diagnosis for FMS

The fault diagnosis model for FMS based on multi layer feedforward neural networks was discussed An improved BP algorithm,the tactic of initial value selection based on genetic algorithm and the method of network structure optimization were presented for training this model ANN(artificial neural network)fault diagnosis model for the robot in FMS was made by the new algorithm The result is superior to the rtaditional algorithm

Application of Random Search Methods in the Determination of Learning Rate for Training Container Dwell Time Data Using Artificial Neural Networks

Purpose: This study aimed to enhance the prediction of container dwell time, a crucial factor for optimizing port operations, resource allocation, and supply chain efficiency. Determining an optimal learning rate for training Artificial Neural Networks (ANNs) has remained a challenging task due to the diverse sizes, complexity, and types of data involved. Design/Method/Approach: This research used a RandomizedSearchCV algorithm, a random search approach, to bridge this knowledge gap. The algorithm was applied to container dwell time data from the TOS system of the Port of Tema, which included 307,594 container records from 2014 to 2022. Findings: The RandomizedSearchCV method outperformed standard training methods both in terms of reducing training time and improving prediction accuracy, highlighting the significant role of the constant learning rate as a hyperparameter. Research Limitations and Implications: Although the study provides promising outcomes, the results are limited to the data extracted from the Port of Tema and may differ in other contexts. Further research is needed to generalize these findings across various port systems. Originality/Value: This research underscores the potential of RandomizedSearchCV as a valuable tool for optimizing ANN training in container dwell time prediction. It also accentuates the significance of automated learning rate selection, offering novel insights into the optimization of container dwell time prediction, with implications for improving port efficiency and supply chain operations.

Improved prediction of clay soil expansion using machine learning algorithms and meta-heuristic dichotomous ensemble classifiers

Soil swelling-related disaster is considered as one of the most devastating geo-hazards in modern history.Hence,proper determination of a soil’s ability to expand is very vital for achieving a secure and safe ground for infrastructures.Accordingly,this study has provided a novel and intelligent approach that enables an improved estimation of swelling by using kernelised machines(Bayesian linear regression(BLR)&bayes point machine(BPM)support vector machine(SVM)and deep-support vector machine(D-SVM));(multiple linear regressor(REG),logistic regressor(LR)and artificial neural network(ANN)),tree-based algorithms such as decision forest(RDF)&boosted trees(BDT).Also,and for the first time,meta-heuristic classifiers incorporating the techniques of voting(VE)and stacking(SE)were utilised.Different independent scenarios of explanatory features’combination that influence soil behaviour in swelling were investigated.Preliminary results indicated BLR as possessing the highest amount of deviation from the predictor variable(the actual swell-strain).REG and BLR performed slightly better than ANN while the meta-heuristic learners(VE and SE)produced the best overall performance(greatest R2 value of 0.94 and RMSE of 0.06%exhibited by VE).CEC,plasticity index and moisture content were the features considered to have the highest level of importance.Kernelized binary classifiers(SVM,D-SVM and BPM)gave better accuracy(average accuracy and recall rate of 0.93 and 0.60)compared to ANN,LR and RDF.Sensitivity-driven diagnostic test indicated that the meta-heuristic models’best performance occurred when ML training was conducted using k-fold validation technique.Finally,it is recommended that the concepts developed herein be deployed during the preliminary phases of a geotechnical or geological site characterisation by using the best performing meta-heuristic models via their background coding resource.

Modelling reference evapotranspiration using gene expression programming and artificial neural network at Pantnagar,India

Evapotranspiration is an essential component of the hydrological cycle that is of particular interest for water resource planning.Its quantification is helpful in irrigation scheduling,water balance studies,water allocation,etc.Modelling of reference evapotranspiration(ET0)using both gene expression programming(GEP)and artificial neural network(ANN)techniques was done using the daily meteorological data of the Pantnagar region,India,from 2010 to 2019.A total of 15 combinations of inputs were used in developing the ET0 models.The model with the least number of inputs consisted of maximum and minimum air temperatures,whereas the model with the highest number of inputs consisted of maximum air temperature,minimum air temperature,mean relative humidity,number of sunshine hours,wind speed at 2mheight and extra-terrestrial radiation as inputs and with ET0 as the output for all the models.All the GEP models were developed for a single functional set and pre-defined genetic operator values,while the best structure in each ANN model was found based on the performance during the testing phase.It was found that ANN models were superior to GEP models for the estimation purpose.It was evident from the reduction in RMSE values ranging from 2%to 56%during training and testing phases in all the ANN models compared with GEP models.The ANN models showed an increase of about 0.96%to 9.72%of R2 value compared to the respective GEP models.The comparative study of these models with multiple linear regression(MLR)depicted that the ANN and GEP models were superior to MLR models.

Enhancing the reusability and interoperability of artificial neural networks with DEVS modeling and simulation

Artificial neural networks(ANNs),a branch of artificial intelligence,has become a very interesting domain since the eighties when back-propagation(BP)learning algorithm for multilayer feed-forward architecture was introduced to solve nonlinear problems.It is used extensively to solve complex nonalgorithmic problems such as prediction,pattern recognition and clustering.However,in the context of a holistic study,there may be a need to integrate ANN with other models developed in various paradigms to solve a problem.In this paper,we suggest discrete event system specification(DEVS)be used as a model of computation(MoC)to make ANN models interoperable with other models(since all discrete event models can be expressed in DEVS,and continuous models can be approximated by DEVS).By combining ANN and DEVS,we can model the complex configuration of ANNs and express its internal workings.Therefore,we are extending the DEVS-based ANN proposed by Toma et al.[A new DEVS-based generic art-ficial neural network modeling approach,The 23rd European Modeling and Simulation Symp.(Simulation in Industry),Rome,Italy,2011]for comparing multiple configuration parameters and learning algorithms and also to do prediction.The DEVS models are described using the high level language for system specification(HiLLS),[Ma¨ıga et al.,A new approach to modeling dynamic structure systems,The 29th European Modeling and Simulation Symp.(Simulation in Industry),Leicester,United Kingdom,2015]a graphical modeling language for clarity.The developed platform is a tool to transform ANN models into DEVS computational models,making them more reusable and more interoperable in the context of larger multi-perspective modeling and simulation(MAS).

A Review of Computing with Spiking Neural Networks

Artificial neural networks(ANNs)have led to landmark changes in many fields,but they still differ significantly fromthemechanisms of real biological neural networks and face problems such as high computing costs,excessive computing power,and so on.Spiking neural networks(SNNs)provide a new approach combined with brain-like science to improve the computational energy efficiency,computational architecture,and biological credibility of current deep learning applications.In the early stage of development,its poor performance hindered the application of SNNs in real-world scenarios.In recent years,SNNs have made great progress in computational performance and practicability compared with the earlier research results,and are continuously producing significant results.Although there are already many pieces of literature on SNNs,there is still a lack of comprehensive review on SNNs from the perspective of improving performance and practicality as well as incorporating the latest research results.Starting from this issue,this paper elaborates on SNNs along the complete usage process of SNNs including network construction,data processing,model training,development,and deployment,aiming to provide more comprehensive and practical guidance to promote the development of SNNs.Therefore,the connotation and development status of SNNcomputing is reviewed systematically and comprehensively from four aspects:composition structure,data set,learning algorithm,software/hardware development platform.Then the development characteristics of SNNs in intelligent computing are summarized,the current challenges of SNNs are discussed and the future development directions are also prospected.Our research shows that in the fields of machine learning and intelligent computing,SNNs have comparable network scale and performance to ANNs and the ability to challenge large datasets and a variety of tasks.The advantages of SNNs over ANNs in terms of energy efficiency and spatial-temporal data processing have been more fully exploited.And the development of programming and deployment tools has lowered the threshold for the use of SNNs.SNNs show a broad development prospect for brain-like computing.

STUDIES OF THE DYNAMIC BEHAVIORS OF A CLASS OF LEARNING ASSOCIATIVE NEURAL NETWORKS

This paper investigates exponential stability and trajectory bounds of motions of equilibria of a class of associative neural networks under structural variations as learning a new pattern. Some conditions for the possible maximum estimate of the domain of structural exponential stability are determined. The filtering ability of the associative neural networks contaminated by input noises is analyzed. Employing the obtained results as valuable guidelines, a systematic synthesis procedure for constructing a dynamical associative neural network that stores a given set of vectors as the stable equilibrium points as well as learns new patterns can be developed. Some new concepts defined here are expected to be the instruction for further studies of learning associative neural networks.

Establish a normal fetal lung gestational age grading model and explore the potential value of deep learning algorithms in fetal lung maturity evaluation

Background:Prenatal evaluation of fetal lung maturity(FLM)is a challenge,and an effective non-invasive method for prenatal assessment of FLM is needed.The study aimed to establish a normal fetal lung gestational age(GA)grading model based on deep learning(DL)algorithms,validate the effectiveness of the model,and explore the potential value of DL algorithms in assessing FLM.Methods:A total of 7013 ultrasound images obtained from 1023 normal pregnancies between 20 and 41+6 weeks were analyzed in this study.There were no pregnancy-related complications that affected fetal lung development,and all infants were born without neonatal respiratory diseases.The images were divided into three classes based on the gestational week:class I:20 to 29+6 weeks,class II:30 to 36+6 weeks,and class III:37 to 41+6 weeks.There were 3323,2142,and 1548 images in each class,respectively.First,we performed a pre-processing algorithm to remove irrelevant information from each image.Then,a convolutional neural network was designed to identify different categories of fetal lung ultrasound images.Finally,we used ten-fold cross-validation to validate the performance of our model.This new machine learning algorithm automatically extracted and classified lung ultrasound image information related to GA.This was used to establish a grading model.The performance of the grading model was assessed using accuracy,sensitivity,specificity,and receiver operating characteristic curves.Results:A normal fetal lung GA grading model was established and validated.The sensitivity of each class in the independent test set was 91.7%,69.8%,and 86.4%,respectively.The specificity of each class in the independent test set was 76.8%,90.0%,and 83.1%,respectively.The total accuracy was 83.8%.The area under the curve(AUC)of each class was 0.982,0.907,and 0.960,respectively.The micro-average AUC was 0.957,and the macro-average AUC was 0.949.Conclusions:The normal fetal lung GA grading model could accurately identify ultrasound images of the fetal lung at different GAs,which can be used to identify cases of abnormal lung development due to gestational diseases and evaluate lung maturity after antenatal corticosteroid therapy.The results indicate that DL algorithms can be used as a non-invasive method to predict FLM.

Structural Damage Identification Using Ensemble Deep Convolutional Neural Network Models

The existing strategy for evaluating the damage condition of structures mostly focuses on feedback supplied by traditional visualmethods,which may result in an unreliable damage characterization due to inspector subjectivity or insufficient level of expertise.As a result,a robust,reliable,and repeatable method of damage identification is required.Ensemble learning algorithms for identifying structural damage are evaluated in this article,which use deep convolutional neural networks,including simple averaging,integrated stacking,separate stacking,and hybridweighted averaging ensemble and differential evolution(WAE-DE)ensemblemodels.Damage identification is carried out on three types of damage.The proposed algorithms are used to analyze the damage of 4585 structural images.The effectiveness of the ensemble learning techniques is evaluated using the confusion matrix.For the testing dataset,the confusion matrix achieved an accuracy of 94 percent and a minimum recall of 92 percent for the best model(WAE-DE)in distinguishing damage types as flexural,shear,combined,or undamaged.

Fuzzy adaptive learning control network with sigmoid membership function

To get simpler operation in modified fuzzy adaptive learning control network （FALCON） in some engineering application, sigmoid nonlinear function is employed as a substitute of traditional Gaussian membership function. For making the modified FALCON learning more efficient and stable, a simulated annealing （SA） learning coefficient is introduced into learning algorithm. At first, the basic concepts and main advantages of FALCON were briefly reviewed. Subsequently, the topological structure and nodes operation were illustrated; the gradient-descent learning algorithm with SA learning coefficient was derived; and the distinctions between the archetype and the modification were analyzed. Eventually, the significance and worthiness of the modified FALCON were validated by its application to probability prediction of anode effect in aluminium electrolysis cells.

Extreme learning with chemical reaction optimization for stock volatility prediction

Extreme learning machine(ELM)allows for fast learning and better generalization performance than conventional gradient-based learning.However,the possible inclusion of non-optimal weight and bias due to random selection and the need for more hidden neurons adversely influence network usability.Further,choosing the optimal number of hidden nodes for a network usually requires intensive human intervention,which may lead to an ill-conditioned situation.In this context,chemical reaction optimization(CRO)is a meta-heuristic paradigm with increased success in a large number of application areas.It is characterized by faster convergence capability and requires fewer tunable parameters.This study develops a learning framework combining the advantages of ELM and CRO,called extreme learning with chemical reaction optimization(ELCRO).ELCRO simultaneously optimizes the weight and bias vector and number of hidden neurons of a single layer feed-forward neural network without compromising prediction accuracy.We evaluate its performance by predicting the daily volatility and closing prices of BSE indices.Additionally,its performance is compared with three other similarly developed models—ELM based on particle swarm optimization,genetic algorithm,and gradient descent—and find the performance of the proposed algorithm superior.Wilcoxon signed-rank and Diebold–Mariano tests are then conducted to verify the statistical significance of the proposed model.Hence,this model can be used as a promising tool for financial forecasting.

Yarn Properties Prediction Based on Machine Learning Method

Although many works have been done to construct prediction models on yarn processing quality,the relation between spinning variables and yarn properties has not been established conclusively so far.Support vector machines(SVMs),based on statistical learning theory,are gaining applications in the areas of machine learning and pattern recognition because of the high accuracy and good generalization capability.This study briefly introduces the SVM regression algorithms,and presents the SVM based system architecture for predicting yarn properties.Model selection which amounts to search in hyper-parameter space is performed for study of suitable parameters with grid-research method.Experimental results have been compared with those of artificial neural network(ANN)models.The investigation indicates that in the small data sets and real-life production,SVM models are capable of remaining the stability of predictive accuracy,and more suitable for noisy and dynamic spinning process.

Error assessment of laser cutting predictions by semi-supervised learning

Experimentation data of perspex glass sheet cutting, using CO2 laser, with missing values were modelled with semi-supervised artificial neural networks. Factorial design of experiment was selected for the verification of orthogonal array based model prediction. It shows improvement in modelling of edge quality and kerf width by applying semi-supervised learning algorithm, based on novel error assessment on simulations. The results are expected to depict better prediction on average by utilizing the systematic randomized techniques to initialize the neural network weights and increase the number of initialization. Missing values handling is difficult with statistical tools and supervised learning techniques; on the other hand, semi-supervised learning generates better results with the smallest datasets even with missing values.

Artificial emotion model based on reinforcement learning mechanism of neural network

A hierarchical-processed frame construction of artificial emotion model for intelligent system is proposed in the paper according to the basic conclusion of emotional psychology. The general method of emotion processing, which considers only one single layer, has been changed in the presented construction. An artificial emotional development model is put forward based on reinforcement learning mechanism of neural network. The new model takes the emotion itself as reinforcement signal and describes its different influences on action learning efficiency corresponding to different individualities. In the end, simulation result based on child playmate robot is discussed and the effectiveness of the model is verified.

Predicting Optimal Trading Actions Using a Genetic Algorithm and Ensemble Method

Machine learning has been applied to the foreign exchange market for algorithmic trading. However, the selection of trading algorithms is a difficult problem. In this work, an approach that combines trading agents is designed. In the proposed approach, an artificial neural network is used to predict the optimum actions of each agent for USD/JPY currency pairs. The agents are trained using a genetic algorithm and are then combined using an ensemble method. We compare the performance of the combined agent to the average performance of many agents. Simulation results show that the total return is better when the combined agent is used.

Impact characterization on thin structures using machine learning approaches

Machine learning algorithms are trained and compared to identify and to characterise the impact on typical aerospace panels of different geometry.Experimental activities are conducted to build a proper impacts’dataset.Polynomial regression algorithm and artificial neural network are applied and optimised to panels without stringer to test their capability to identify the impacts.Subsequently,the algorithms are applied to panels reinforced with stringers that represent a significant increase of complexity in terms of dynamic features of the system to test:the focus is not only on the impact position’s detection but also on the event’s severity.After the identification of the best algorithm,the corresponding machine learning model is deployed on an ARM processor minicomputer,implementing an impact detection system,able to be installed on board an aerial vehicle,making it a smart aircraft equipped with an artificial intelligence decision-making system.

A deep neural network-based algorithm for solving structural optimization

We propose the deep Lagrange method(DLM),which is a new optimization method,in this study.It is based on a deep neural network to solve optimization problems.The method takes the advantage of deep learning artificial neural networks to find the optimal values of the optimization function instead of solving optimization problems by calculating sensitivity analysis.The DLM method is non-linear and could potentially deal with nonlinear optimization problems.Several test cases on sizing optimization and shape optimization are performed,and their results are then compared with analytical and numerical solutions.

人工神经网络与遗传算法预测液体晃荡参数的比较

This paper develops a numerical code for modelling liquid sloshing.The coupled boundary element-finite element method was used to solve the Laplace equation for inviscid fluid and nonlinear free surface boundary conditions.Using Nakayama and Washizu’s results,the code performance was validated.Using the developed numerical mode,we proposed artificial neural network(ANN)and genetic algorithm(GA)methods for evaluating sloshing loads and comparing them.To compare the efficiency of the suggested methods,the maximum free surface displacement and the maximum horizontal force exerted on a rectangular tank’s perimeter are examined.It can be seen from the results that both ANNs and GAs can accurately predict η_(max) and F_(max).