Identification Simulation for Dynamical System Based on Genetic Algorithm and Recurrent Multilayer Neural Network

Identification simulation for dynamical system which is based on genetic algorithm (GA) and recurrent multilayer neural network (RMNN) is presented. In order to reduce the inputs of the model, RMNN which can remember and store some previous parameters is used for identifier. And for its high efficiency and optimization, genetic algorithm is introduced into training RMNN. Simulation results show the effectiveness of the proposed scheme. Under the same training algorithm, the identification performance of RMNN is superior to that of nonrecurrent multilayer neural network (NRMNN).

Improving the spaceborne GNSS-R altimetric precision based on the novel multilayer feedforward neural network weighted joint prediction model

Global navigation satellite system-reflection(GNSS-R)sea surface altimetry based on satellite constellation platforms has become a new research direction and inevitable trend,which can meet the altimetric precision at the global scale required for underwater navigation.At present,there are still research gaps for GNSS-R altimetry under this mode,and its altimetric capability cannot be specifically assessed.Therefore,GNSS-R satellite constellations that meet the global altimetry needs to be designed.Meanwhile,the matching precision prediction model needs to be established to quantitatively predict the GNSS-R constellation altimetric capability.Firstly,the GNSS-R constellations altimetric precision under different configuration parameters is calculated,and the mechanism of the influence of orbital altitude,orbital inclination,number of satellites and simulation period on the precision is analyzed,and a new multilayer feedforward neural network weighted joint prediction model is established.Secondly,the fit of the prediction model is verified and the performance capability of the model is tested by calculating the R2 value of the model as 0.9972 and the root mean square error(RMSE)as 0.0022,which indicates that the prediction capability of the model is excellent.Finally,using the novel multilayer feedforward neural network weighted joint prediction model,and considering the research results and realistic costs,it is proposed that when the constellation is set to an orbital altitude of 500 km,orbital inclination of 75and the number of satellites is 6,the altimetry precision can reach 0.0732 m within one year simulation period,which can meet the requirements of underwater navigation precision,and thus can provide a reference basis for subsequent research on spaceborne GNSS-R sea surface altimetry.

The Role and Place of Artificial Neural Network Architectures Structural Redundancy in the Input Data Prototypes and Generalization Development

Neural Networks (NN) are the functional unit of Deep Learning and are known to mimic the behavior of the human brain to solve complex data-driven problems. Whenever we train our own neural networks, we need to take care of something called the generalization of the neural network. The performance of Artificial Neural Networks (ANN) mostly depends upon its generalization capability. In this paper, we propose an innovative approach to enhance the generalization capability of artificial neural networks (ANN) using structural redundancy. A novel perspective on handling input data prototypes and their impact on the development of generalization, which could improve to ANN architectures accuracy and reliability is described.

Simultaneous Identification of Thermophysical Properties of Semitransparent Media Using a Hybrid Model Based on Artificial Neural Network and Evolutionary Algorithm

A hybrid identification model based on multilayer artificial neural networks(ANNs) and particle swarm optimization(PSO) algorithm is developed to improve the simultaneous identification efficiency of thermal conductivity and effective absorption coefficient of semitransparent materials.For the direct model,the spherical harmonic method and the finite volume method are used to solve the coupled conduction-radiation heat transfer problem in an absorbing,emitting,and non-scattering 2D axisymmetric gray medium in the background of laser flash method.For the identification part,firstly,the temperature field and the incident radiation field in different positions are chosen as observables.Then,a traditional identification model based on PSO algorithm is established.Finally,multilayer ANNs are built to fit and replace the direct model in the traditional identification model to speed up the identification process.The results show that compared with the traditional identification model,the time cost of the hybrid identification model is reduced by about 1 000 times.Besides,the hybrid identification model remains a high level of accuracy even with measurement errors.

Neural Network-Based State of Charge Estimation Method for Lithium-ion Batteries Based on Temperature

Lithium-ion batteries are commonly used in electric vehicles,mobile phones,and laptops.These batteries demonstrate several advantages,such as environmental friendliness,high energy density,and long life.However,battery overcharging and overdischarging may occur if the batteries are not monitored continuously.Overcharging causesfire and explosion casualties,and overdischar-ging causes a reduction in the battery capacity and life.In addition,the internal resistance of such batteries varies depending on their external temperature,elec-trolyte,cathode material,and other factors;the capacity of the batteries decreases with temperature.In this study,we develop a method for estimating the state of charge(SOC)using a neural network model that is best suited to the external tem-perature of such batteries based on their characteristics.During our simulation,we acquired data at temperatures of 25°C,30°C,35°C,and 40°C.Based on the tem-perature parameters,the voltage,current,and time parameters were obtained,and six cycles of the parameters based on the temperature were used for the experi-ment.Experimental data to verify the proposed method were obtained through a discharge experiment conducted using a vehicle driving simulator.The experi-mental data were provided as inputs to three types of neural network models:mul-tilayer neural network(MNN),long short-term memory(LSTM),and gated recurrent unit(GRU).The neural network models were trained and optimized for the specific temperatures measured during the experiment,and the SOC was estimated by selecting the most suitable model for each temperature.The experimental results revealed that the mean absolute errors of the MNN,LSTM,and GRU using the proposed method were 2.17%,2.19%,and 2.15%,respec-tively,which are better than those of the conventional method(4.47%,4.60%,and 4.40%).Finally,SOC estimation based on GRU using the proposed method was found to be 2.15%,which was the most accurate.

Mechanical movement data acquisition method based on the multilayer neural networks and machine vision in a digital twin environment[version 1;peer review:2 approved]

Background:Digital twin requires virtual reality mapping and optimization iteration between physical devices and virtual models.The mechanical movement data collection of physical equipment is essential for the implementation of accurate virtual and physical synchronization in a digital twin environment.However,the traditional approach relying on PLC(programmable logic control)fails to collect various mechanical motion state data.Additionally,few investigations have used machine visions for the virtual and physical synchronization of equipment.Thus,this paper presents a mechanical movement data acquisition method based on multilayer neural networks and machine vision.Methods:Firstly,various visual marks with different colors and shapes are designed for marking physical devices.Secondly,a recognition method based on the Hough transform and histogram feature is proposed to realize the recognition of shape and color features respectively.Then,the multilayer neural network model is introduced in the visual mark location.The neural network is trained by the dropout algorithm to realize the tracking and location of the visual mark.To test the proposed method,1000 samples were selected.Results:The experiment results shows that when the size of the visual mark is larger than 6mm,the recognition success rate of the recognition algorithm can reach more than 95%.In the actual operation environment with multiple cameras,the identification points can be located more accurately.Moreover,the camera calibration process of binocular and multi-eye vision can be simplified by the multilayer neural networks.Conclusions:This study proposes an effective method in the collection of mechanical motion data of physical equipment in a digital twin environment. Further studies are needed to perceive posture and shape data of physical entities under the multi-camera redundant shooting.

Near-infrared Spectral Detection of the Content of Soybean Fat Acids Based on Genetic Multilayer Feed forward Neural Network

In the paper, a method of building mathematic model employing genetic multilayer feed forward neural network is presented, and the quantitative relationship of chemical measured values and near-infrared spectral data is established. In the paper, quantitative mathematic model related chemical assayed values and near-infrared spectral data is established by means of genetic multilayer feed forward neural network, acquired near-infrared spectral data are taken as input of network with the content of five kinds of fat acids tested from chemical method as output, weight values of multilayer feed forward neural network are trained by genetic algorithms and detection model of neural network of soybean is built. A kind of multilayer feed forward neural network trained by genetic algorithms is designed in the paper. Through experiments, all the related coefficients of five fat acids can approach 0.9 which satisfies the preliminary test of soybean breeding.

Preliminary Biometrics of ECG Signal Based on Temporal Organization through the Implementation of a Multilayer Perceptron Neural Network

The attributes of the ECG signal signifying the unique electrical properties of the heart offer the opportunity to expand the realm of biometrics, which pertains the identification of an individual based on physical characteristics. The temporal organization of the ECG signal offers a basis for composing a machine learning feature set. The four attributes of the feature set are derived through software automation enabled by Python. These four attributes are the temporal differential of the P wave maximum and T wave maximum relative to the R wave maximum and the Q wave minimum and S wave minimum relative to the R wave maximum. The multilayer perceptron neural network was applied and evaluated in terms of classification accuracy and time to develop the model. Superior performance was achieved with respect to a reduced feature set considering only the temporal differential of the P wave maximum and T wave maximum relative to the R wave maximum by comparison to all four attributes applied to the feature set and the temporal differential of the Q wave minimum and S wave minimum relative to the R wave maximum. With these preliminary findings and the advent of portable and wearable devices for the acquisition of the ECG signal, the temporal organization of the ECG signal offers robust potential for the field of biometrics.

Neural Network inverse Adaptive Controller Based on Davidon Least Square

General neural network inverse adaptive controller has two flaws: the first is the slow convergence speed; the second is the invalidation to the non-minimum phase system. These defects limit the scope in which the neural network inverse adaptive controller is used. We employ Davidon least squares in training the multi-layer feedforward neural network used in approximating the inverse model of plant to expedite the convergence, and then through constructing the pseudo-plant, a neural network inverse adaptive controller is put forward which is still effective to the nonlinear non-minimum phase system. The simulation results show the validity of this scheme.

A BP Artificial Neural Network Model for Earthquake Magnitude Prediction in Himalayas, India

The aim of this study is to evaluate the performance of BP neural network techniques in predicting earthquakes occurring in the region of Himalayan belt (with the use of different types of input data). These parameters are extracted from Himalayan Earthquake catalogue comprised of all minor, major events and their aftershock sequences in the Himalayan basin for the past 128 years from 1887 to 2015. This data warehouse contains event data, event time with seconds, latitude, longitude, depth, standard deviation and magnitude. These field data are converted into eight mathematically computed parameters known as seismicity indicators. These seismicity indicators have been used to train the BP Neural Network for better decision making and predicting the magnitude of the pre-defined future time period. These mathematically computed indicators considered are the clustered based on every events above 2.5 magnitude, total number of events from past years to 2014, frequency-magnitude distribution b-values, Gutenberg-Richter inverse power law curve for the n events, the rate of square root of seismic energy released during the n events, energy released from the event, the mean square deviation about the regression line based on the Gutenberg-Richer inverse power law for the n events, coefficient of variation of mean time and average value of the magnitude for last n events. We propose a three-layer feed forward BP neural network model to identify factors, with the actual occurrence of the earthquake magnitude M and other seven mathematically computed parameters seismicity indicators as input and target vectors in Himalayan basin area. We infer through comparing curve as observed from seismometer in Himalayan Earthquake catalogue comprised of all events above magnitude 2.5 mg, their aftershock sequences in the Himalayan basin of year 2015 and BP neural network predicting earthquakes in 2015. The model yields good prediction result for the earthquakes of magnitude between 4.0 and 6.0.

An Early Stopping-Based Artificial Neural Network Model for Atmospheric Corrosion Prediction of Carbon Steel

The optimization of network topologies to retain the generalization ability by deciding when to stop overtraining an artificial neural network(ANN)is an existing vital challenge in ANN prediction works.The larger the dataset the ANN is trained with,the better generalization the prediction can give.In this paper,a large dataset of atmospheric corrosion data of carbon steel compiled from several resources is used to train and test a multilayer backpropagation ANN model as well as two conventional corrosion prediction models(linear and Klinesmith models).Unlike previous related works,a grid search-based hyperparameter tuning is performed to develop multiple hyperparameter combinations(network topologies)to train multiple ANNs with mini-batch stochastic gradient descent optimization algorithm to facilitate the training of a large dataset.After that,one selection strategy for the optimal hyperparameter combination is applied by an early stopping method to guarantee the generalization ability of the optimal network model.The correlation coefficients(R)of the ANN model can explain about 80%(more than 75%)of the variance of atmospheric corrosion of carbon steel,and the root mean square errors(RMSE)of three models show that the ANN model gives a better performance than the other two models with acceptable generalization.The influence of input parameters on the output is highlighted by using the fuzzy curve analysis method.The result reveals that TOW,Cl-and SO2 are the most important atmospheric chemical variables,which have a well-known nonlinear relationship with atmospheric corrosion.

Artificial Neural Networks for Prediction of COVID-19 in Saudi Arabia

In this study,we have proposed an artificial neural network(ANN)model to estimate and forecast the number of confirmed and recovered cases of COVID-19 in the upcoming days until September 17,2020.The proposed model is based on the existing data(training data)published in the Saudi Arabia Coronavirus disease(COVID-19)situation—Demographics.The Prey-Predator algorithm is employed for the training.Multilayer perceptron neural network(MLPNN)is used in this study.To improve the performance of MLPNN,we determined the parameters of MLPNN using the prey-predator algorithm(PPA).The proposed model is called the MLPNN–PPA.The performance of the proposed model has been analyzed by the root mean squared error(RMSE)function,and correlation coefficient(R).Furthermore,we tested the proposed model using other existing data recorded in Saudi Arabia(testing data).It is demonstrated that the MLPNN-PPA model has the highest performance in predicting the number of infected and recovering in Saudi Arabia.The results reveal that the number of infected persons will increase in the coming days and become a minimum of 9789.The number of recoveries will be 2000 to 4000 per day.

A Novel Method for Solving Ordinary Differential Equations with Artificial Neural Networks

This research work investigates the use of Artificial Neural Network (ANN) based on models for solving first and second order linear constant coefficient ordinary differential equations with initial conditions. In particular, we employ a feed-forward Multilayer Perceptron Neural Network (MLPNN), but bypass the standard back-propagation algorithm for updating the intrinsic weights. A trial solution of the differential equation is written as a sum of two parts. The first part satisfies the initial or boundary conditions and contains no adjustable parameters. The second part involves a feed-forward neural network to be trained to satisfy the differential equation. Numerous works have appeared in recent times regarding the solution of differential equations using ANN, however majority of these employed a single hidden layer perceptron model, incorporating a back-propagation algorithm for weight updation. For the homogeneous case, we assume a solution in exponential form and compute a polynomial approximation using statistical regression. From here we pick the unknown coefficients as the weights from input layer to hidden layer of the associated neural network trial solution. To get the weights from hidden layer to the output layer, we form algebraic equations incorporating the default sign of the differential equations. We then apply the Gaussian Radial Basis function (GRBF) approximation model to achieve our objective. The weights obtained in this manner need not be adjusted. We proceed to develop a Neural Network algorithm using MathCAD software, which enables us to slightly adjust the intrinsic biases. We compare the convergence and the accuracy of our results with analytic solutions, as well as well-known numerical methods and obtain satisfactory results for our example ODE problems.

Comparison of Electric Load Forecasting between Using SOM and MLP Neural Network

Electric load forecasting has been a major area of research in the last decade since the production of accurate short-term forecasts for electricity loads has proven to be a key to success for many of the decision makers in the energy sector, from power generation to operation of the system. The objective of this research is to analyze the capacity of the MLP （multilayer perceptron neural network） versus SOM （self-organizing map neural network） for short-term load forecasting. The MLP is one of the most commonly used networks. It can be used for classification problems, model construction, series forecasting and discrete control. On the other hand, the SOM is a type of artificial neural network that is trained using unsupervised data to produce a low-dimensional, discretized representation of an input space of training samples in a cell map. Historical data of real global load demand were used for the research. Both neural models provide good prediction results, but the results obtained with the SOM maps are markedly better Also the main advantage of SOM maps is that they reach good results as a network unsupervised. It is much easier to train and interpret the results.

Pioneering role of machine learning in unveiling intensive care unitacquired weakness

In the research published in the World Journal of Clinical Cases,Wang and Long conducted a quantitative analysis to delineate the risk factors for intensive care unit-acquired weakness(ICU-AW)utilizing advanced machine learning methodologies.The study employed a multilayer perceptron neural network to accurately predict the incidence of ICU-AW,focusing on critical variables such as ICU stay duration and mechanical ventilation.This research marks a significant advancement in applying machine learning to clinical diagnostics,offering a new paradigm for predictive medicine in critical care.It underscores the importance of integrating artificial intelligence technologies in clinical practice to enhance patient management strategies and calls for interdisciplinary collaboration to drive innovation in healthcare.

FORECASTING AUTOMOBILE WARRANTY PERFORMANCE IN PRESENCE OF ‘MATURING DATA’ PHENOMENA USING MULTILAYER PERCEPTRON NEURAL NETWORK

Automobile companies that spend billions of dollars annually towards warranty cost, give high priority to warranty reduction programs. Forecasting of automobile warranty performance plays an important role towards these efforts. The forecasting process involves prediction of not only the specific months-in-service (MIS) warranty performance at certain future time, but also at future MIS values. However, 'maturing data' (also called warranty growth) phenomena that causes warranty performance at specific MIS values to change with time, makes such a forecasting task challenging. Although warranty forecasting methods such as log-log plots and dynamic linear models appear in literature, there is a need for applications addressing the well recognized issue of ‘maturing data’. In this paper we use an artificial neural network for the forecasting of warranty performance in presence of ‘maturing data’ phenomena. The network parameters are optimized by minimizing the training and testing errors using response surface methodology. This application shows the effectiveness of neural networks in the forecasting of automobile warranty performance in the presence of the ‘maturing data’ phenomena.

Adaptive neural network observer for proton-exchange membrane fuel cell system

This paper develops an adaptive neural network(NN)observer for proton-exchange membrane fuel cells(PEMFCs).Indeed,information on the oxygen excess ratio(OER)value is crucial to ensure optimal management of the durability and reliability of the PEMFC.The OER indicator is computed from the mass of oxygen and nitrogen inside the PEMFC cathode.Unfortunately,the measurement process of both these masses is difficult and costly.To solve this problem,the design of a PEMFC state observer is attractive.However,the behaviour of the fuel cell system is highly non-linear and its modelling is complex.Due to this constraint,a multilayer perceptron neural network(MLPNN)-based observer is proposed in this paper to estimate the oxygen and nitrogen masses.One notable advantage of the suggested MLPNN observer is that it does not require a database to train the NN.Indeed,the weights of the NN are updated in real time using the output error.In addition,the observer parameters,namely the learning rate and the damping factor,are online adapted using the optimization tools of extremum seeking.Moreover,the proposed observer stability analysis is performed using the Lyapunov theory.The observer performances are validated by simulation under MATLAB®/Simulink®.The supremacy of the proposed adaptive MLPNN observer is highlighted by comparison with a fixed-parameter MLPNN observer and a classical high-gain observer(HGO).The mean rela-tive error value of the excess oxygen rate is considered the performance index,which is equal to 1.01%for an adaptive MLPNN and 3.95%and 9.95%for a fixed MLPNN and HGO,respectively.Finally,a robustness test of the proposed observer with respect to measurement noise is performed.

Multilayer perceptron neural network activated by adaptive Gaussian radial basis function and its application to predict lid-driven cavity flow

To improve the performance of multilayer perceptron(MLP)neural networks activated by conventional activation functions,this paper presents a new MLP activated by univariate Gaussian radial basis functions(RBFs)with adaptive centers and widths,which is composed of more than one hidden layer.In the hidden layer of the RBF-activated MLP network(MLPRBF),the outputs of the preceding layer are first linearly transformed and then fed into the univariate Gaussian RBF,which exploits the highly nonlinear property of RBF.Adaptive RBFs might address the issues of saturated outputs,low sensitivity,and vanishing gradients in MLPs activated by other prevailing nonlinear functions.Finally,we apply four MLP networks with the rectified linear unit(ReLU),sigmoid function(sigmoid),hyperbolic tangent function(tanh),and Gaussian RBF as the activation functions to approximate the one-dimensional(1D)sinusoidal function,the analytical solution of viscous Burgers’equation,and the two-dimensional(2D)steady lid-driven cavity flows.Using the same network structure,MLP-RBF generally predicts more accurately and converges faster than the other threeMLPs.MLP-RBF using less hidden layers and/or neurons per layer can yield comparable or even higher approximation accuracy than other MLPs equipped with more layers or neurons.

Selection for high quality pepper seeds by machine vision and classifiers

This research aimed to improve selection of pepper seeds for separating high-quality seeds from low-quality seeds. Past research has shown that seed vigor is significantly related to the seed color and size, thus several physical features were identified as candidate predictors of high seed quality. Image recognition software was used to automate recognition of seed feature quality using 400 kernels of pepper cultivar 101. In addition, binary logistic regression and a neural network were applied to determine models with high predictive value of seed germination. Single-kernel germination tests were conducted to validate the predictive value of the identified features. The best predictors of seed vigor were determined by the highest correlation observed between the physical features and the subsequent fresh weight of seedlings that germinated from the 400 seeds. Correlation analysis showed that fresh weight was significantly positively correlated with eight physical features： three color features （R, a＊, brightness）, width, length, projected area, and single-kernel density, and weight. In contrast, fresh weight significantly negatively correlated with the feature of hue. In analyses of two of the highest correlating single features,＇ germination percentage increased from 59.3 to 71.8% when a＊〉3, and selection rate peaked at 57.8%. Germination percentage increased from 59.3 to 79.4%, and the selection rate reached 76.8%, when single-kernel weight 〉0.0064 g. The most effective model was based on a multilayer perceptron （MLP） neural network, consisting of 15 physical traits as variables, and a stability calculated as 99.4%. Germination percentage in a calibration set of seeds was 79.1% and the selection rate was 90.0%. These results indicated that the model was effective in predicting seed germination based on physical features and could be used as a guide for quality control in seed selection. Automated systems based on machine vision and model classifiers can contribute to reducing the costs and labor required in the selection of pepper seeds.

Influence of brittleness and confining stress on rock cuttability based on rock indentation tests

In order to understand the influence of brittleness and confining stress on rock cuttability,the indentation tests were carried out by a conical pick on the four types of rocks.Then,the experimental results were utilized to take regression analysis.The eight sets of normalized regression models were established for reflecting the relationships of peak indentation force(PIF)and specific energy(SE)with brittleness index and uniaxial confining stress.The regression analyses present that these regression models have good prediction performance.The regressive results indicate that brittleness indices and uniaxial confining stress conditions have non-linear effects on the rock cuttability that is determined by PIF and SE.Finally,the multilayer perceptual neural network was used to measure the importance weights of brittleness index and uniaxial confining stress upon the influence for rock cuttability.The results indicate that the uniaxial confining stress is more significant than brittleness index for influencing the rock cuttability.