Preliminary Biometrics of ECG Signal Based on Temporal Organization through the Implementation of a Multilayer Perceptron Neural Network

The attributes of the ECG signal signifying the unique electrical properties of the heart offer the opportunity to expand the realm of biometrics, which pertains the identification of an individual based on physical characteristics. The temporal organization of the ECG signal offers a basis for composing a machine learning feature set. The four attributes of the feature set are derived through software automation enabled by Python. These four attributes are the temporal differential of the P wave maximum and T wave maximum relative to the R wave maximum and the Q wave minimum and S wave minimum relative to the R wave maximum. The multilayer perceptron neural network was applied and evaluated in terms of classification accuracy and time to develop the model. Superior performance was achieved with respect to a reduced feature set considering only the temporal differential of the P wave maximum and T wave maximum relative to the R wave maximum by comparison to all four attributes applied to the feature set and the temporal differential of the Q wave minimum and S wave minimum relative to the R wave maximum. With these preliminary findings and the advent of portable and wearable devices for the acquisition of the ECG signal, the temporal organization of the ECG signal offers robust potential for the field of biometrics.

The development of a knowledge base in an expert system based on the four-layer perceptron neural network

Owing to continuous production lines with large amount of consecutive controls, various control signals and huge logistic relations, this paper introduced the methods and principles of the development of knowledge base in a fault diagnosis expert system that was based on machine learning by the four-layer perceptron neural network. An example was presented. By combining differential function with not differential function and back propagation of error with back propagation of expectation, the four-layer perceptron neural network was established. And it was good for solving such a bottleneck problem in knowledge acquisition in expert system and enhancing real-time on-line diagnosis. A method of synthetic back propagation was designed, which broke the limit to non-differentiable function in BP neural network.

Classification of frozen soil blastability by using perceptron neural network

Influence factors of frozen soil blastability are analyzed which mainly conclude the strain energy coefficient, tensile strength, compressive strength, longitudinal wave velocity and transverse wave velocity. According to the principle of perceptron neural network, at first the index factors are standardized by the aid of the efficient function theory, then the blastability of frozen sand at -7, -12 and -17 ℃ are classified three categories. Through adjusting the weight value and threshold value, we can obtain that the clay blastability at -7 ℃ is close to the sand blastability at -12 ℃, they belong to the second category, the clay blastability at -12 ℃ is close to the sand blastability at -17 ℃, thus they are divided into the third category.

Updated Lithological Map in the Forest Zone of the Centre, South and East Regions of Cameroon Using Multilayer Perceptron Neural Network and Landsat Images

The Multilayer Perceptron Neural Network (MLPNN) induction technique has been successfully applied to a variety of machine learning tasks, including the extraction and classification of image features. However, not much has been done in the application of MLPNN on images obtained by remote sensing. In this article, two automatic classification systems used in image feature extraction and classification from remote sensing data are presented. The first is a combination of two models: a MLPNN induction technique, integrated under ENVI (Environment for Visualizing Images) platform for classification, and a pre-processing model including dark subtraction for the calibration of the image, the Principal Components Analysis (PCA) for band selections and Independent Components Analysis (ICA) as blind source separator for feature extraction of the Landsat image. The second classification system is a MLPNN induction technique based on the Keras platform. In this case, there was no need for pre-processing model. Experimental results show the two classification systems to outperform other typical feature extraction and classification methods in terms of accuracy for some lithological classes including Granite1 class with the highest class accuracies of 96.69% and 92.69% for the first and second classification system respectively. Meanwhile, the two classification systems perform almost equally with the overall accuracies of 53.01% and 49.98% for the first and second models respectively though the keras model has the advantage of not integrating the pre-processing model, hence increasing its efficiency. The application of these two systems to the study area resulted in the generation of an updated geological mapping with six lithological classes detected including the Gneiss, the Micaschist, the Schist and three versions of Granites (Granite1, Granite2 and Granite3).

FORECASTING AUTOMOBILE WARRANTY PERFORMANCE IN PRESENCE OF ‘MATURING DATA’ PHENOMENA USING MULTILAYER PERCEPTRON NEURAL NETWORK

Automobile companies that spend billions of dollars annually towards warranty cost, give high priority to warranty reduction programs. Forecasting of automobile warranty performance plays an important role towards these efforts. The forecasting process involves prediction of not only the specific months-in-service (MIS) warranty performance at certain future time, but also at future MIS values. However, 'maturing data' (also called warranty growth) phenomena that causes warranty performance at specific MIS values to change with time, makes such a forecasting task challenging. Although warranty forecasting methods such as log-log plots and dynamic linear models appear in literature, there is a need for applications addressing the well recognized issue of ‘maturing data’. In this paper we use an artificial neural network for the forecasting of warranty performance in presence of ‘maturing data’ phenomena. The network parameters are optimized by minimizing the training and testing errors using response surface methodology. This application shows the effectiveness of neural networks in the forecasting of automobile warranty performance in the presence of the ‘maturing data’ phenomena.

Multilayer perceptron neural network activated by adaptive Gaussian radial basis function and its application to predict lid-driven cavity flow

To improve the performance of multilayer perceptron(MLP)neural networks activated by conventional activation functions,this paper presents a new MLP activated by univariate Gaussian radial basis functions(RBFs)with adaptive centers and widths,which is composed of more than one hidden layer.In the hidden layer of the RBF-activated MLP network(MLPRBF),the outputs of the preceding layer are first linearly transformed and then fed into the univariate Gaussian RBF,which exploits the highly nonlinear property of RBF.Adaptive RBFs might address the issues of saturated outputs,low sensitivity,and vanishing gradients in MLPs activated by other prevailing nonlinear functions.Finally,we apply four MLP networks with the rectified linear unit(ReLU),sigmoid function(sigmoid),hyperbolic tangent function(tanh),and Gaussian RBF as the activation functions to approximate the one-dimensional(1D)sinusoidal function,the analytical solution of viscous Burgers’equation,and the two-dimensional(2D)steady lid-driven cavity flows.Using the same network structure,MLP-RBF generally predicts more accurately and converges faster than the other threeMLPs.MLP-RBF using less hidden layers and/or neurons per layer can yield comparable or even higher approximation accuracy than other MLPs equipped with more layers or neurons.

Contributions of internal climate variability in driving global and ocean temperature variations using multi-layer perceptron neural network

Roles of internal climate variabilities regulating global and ocean temperature changes is a hot but complex issue of scientific concern,infuencing the comprehensive policy-making in response to global and regional warming.In this study,the time series of monthly global and ocean mean surface temperature(GST and OST,respectively)since 1866 is successflly reconstructed via natural and anthropogenic forcing factors and internal climate variability by using a Multi-Layer Perceptron(MLP)neural network technique.The MLP demonstrates prominent monthly GST and OST reconstruction skills on both interannual and annual time scales.Most of the warming in GST and OST since 1866 is found to be attributable to anthropogenic forcing,while the multidecadal and interannual GST and OST variations are considerably dominated by Atlantic Multidecadal Oscillation(AMO).Internal climate variabilities like Interdecadal Pacific Oscillation(IPO)can amplify the GST and OST changes and explain the global warming slowdown since 1998.Southern Oscillation Index(SOI)performs a similar role as IPO but to a lesser extent.Changes in OST caused by solar forcing are more considerable than those in GST.Moreover,the"biased warmth"during the Second World War is successfully reconstructed in MLP.AMO and IPO can explain most annual and even sub-annual temperature variations during this period,offering an explanation for the existence of this abnormal warm period other than that it was entirely caused by instrumental errors.The generally high accuracy of reconstructions on interannual and annual time scales can enhance the ability to monitor the prompt feedback of specific external radiative forcings and internal variabilities to changes in climate.

Design optimization of multilayer perceptron neural network by ant colony optimization applied to engine emissions data

A multilayer perceptron(MLP) artificial neural network(ANN) model has been optimized by the multi-objective ant colony optimization(MOACO) algorithm, which uses three objective functions. A sensitivity analysis to choose MOACO parameter values is carried out by calculating hypervolume metric, and the proposed approach adopts the Vlsekriterijumska Optimizacija I Kompromisno Resenje(VIKOR) decision method to choose final compromised solution on the Pareto front obtained from MOACO. As a result, we used the MLP-MOACO developed model to estimate the value of engine emissions of NOxin a four stroke, spark ignition(SI) gasoline engine and observed acceptable correlation coefficient(R^2) of 0.99978.

A Novel Method for Solving Ordinary Differential Equations with Artificial Neural Networks

This research work investigates the use of Artificial Neural Network (ANN) based on models for solving first and second order linear constant coefficient ordinary differential equations with initial conditions. In particular, we employ a feed-forward Multilayer Perceptron Neural Network (MLPNN), but bypass the standard back-propagation algorithm for updating the intrinsic weights. A trial solution of the differential equation is written as a sum of two parts. The first part satisfies the initial or boundary conditions and contains no adjustable parameters. The second part involves a feed-forward neural network to be trained to satisfy the differential equation. Numerous works have appeared in recent times regarding the solution of differential equations using ANN, however majority of these employed a single hidden layer perceptron model, incorporating a back-propagation algorithm for weight updation. For the homogeneous case, we assume a solution in exponential form and compute a polynomial approximation using statistical regression. From here we pick the unknown coefficients as the weights from input layer to hidden layer of the associated neural network trial solution. To get the weights from hidden layer to the output layer, we form algebraic equations incorporating the default sign of the differential equations. We then apply the Gaussian Radial Basis function (GRBF) approximation model to achieve our objective. The weights obtained in this manner need not be adjusted. We proceed to develop a Neural Network algorithm using MathCAD software, which enables us to slightly adjust the intrinsic biases. We compare the convergence and the accuracy of our results with analytic solutions, as well as well-known numerical methods and obtain satisfactory results for our example ODE problems.

Artificial Neural Networks for Prediction of COVID-19 in Saudi Arabia

In this study,we have proposed an artificial neural network(ANN)model to estimate and forecast the number of confirmed and recovered cases of COVID-19 in the upcoming days until September 17,2020.The proposed model is based on the existing data(training data)published in the Saudi Arabia Coronavirus disease(COVID-19)situation—Demographics.The Prey-Predator algorithm is employed for the training.Multilayer perceptron neural network(MLPNN)is used in this study.To improve the performance of MLPNN,we determined the parameters of MLPNN using the prey-predator algorithm(PPA).The proposed model is called the MLPNN–PPA.The performance of the proposed model has been analyzed by the root mean squared error(RMSE)function,and correlation coefficient(R).Furthermore,we tested the proposed model using other existing data recorded in Saudi Arabia(testing data).It is demonstrated that the MLPNN-PPA model has the highest performance in predicting the number of infected and recovering in Saudi Arabia.The results reveal that the number of infected persons will increase in the coming days and become a minimum of 9789.The number of recoveries will be 2000 to 4000 per day.

Identification and Prediction of Internet Traffic Using Artificial Neural Networks

This paper presents the development of an artificial neural network (ANN) model based on the multi-layer perceptron (MLP) for analyzing internet traffic data over IP networks. We applied the ANN to analyze a time series of measured data for network response evaluation. For this reason, we used the input and output data of an internet traffic over IP networks to identify the ANN model, and we studied the performance of some training algorithms used to estimate the weights of the neuron. The comparison between some training algorithms demonstrates the efficiency and the accu-racy of the Levenberg-Marquardt (LM) and the Resilient back propagation (Rp) algorithms in term of statistical crite-ria. Consequently, the obtained results show that the developed models, using the LM and the Rp algorithms, can successfully be used for analyzing internet traffic over IP networks, and can be applied as an excellent and fundamental tool for the management of the internet traffic at different times.

Applying Neural Network Architecture for Inverse Kinematics Problem in Robotics

One of the most important problems in robot kinematics and control is, finding the solution of Inverse Kinematics. Inverse kinematics computation has been one of the main problems in robotics research. As the Complexity of robot increases, obtaining the inverse kinematics is difficult and computationally expensive. Traditional methods such as geometric, iterative and algebraic are inadequate if the joint structure of the manipulator is more complex. As alternative approaches, neural networks and optimal search methods have been widely used for inverse kinematics modeling and control in robotics This paper proposes neural network architecture that consists of 6 sub-neural networks to solve the inverse kinematics problem for robotics manipulators with 2 or higher degrees of freedom. The neural networks utilized are multi-layered perceptron (MLP) with a back-propagation training algorithm. This approach will reduce the complexity of the algorithm and calculation (matrix inversion) faced when using the Inverse Geometric Models implementation (IGM) in robotics. The obtained results are presented and analyzed in order to prove the efficiency of the proposed approach.

Determination of penetration depth at high velocity impact using finite element method and artificial neural network tools

Determination of ballistic performance of an armor solution is a complicated task and evolved significantly with the application of finite element methods(FEM) in this research field.The traditional armor design studies performed with FEM requires sophisticated procedures and intensive computational effort,therefore simpler and accurate numerical approaches are always worthwhile to decrease armor development time.This study aims to apply a hybrid method using FEM simulation and artificial neural network(ANN) analysis to approximate ballistic limit thickness for armor steels.To achieve this objective,a predictive model based on the artificial neural networks is developed to determine ballistic resistance of high hardness armor steels against 7.62 mm armor piercing ammunition.In this methodology,the FEM simulations are used to create training cases for Multilayer Perceptron(MLP) three layer networks.In order to validate FE simulation methodology,ballistic shot tests on 20 mm thickness target were performed according to standard Stanag 4569.Afterwards,the successfully trained ANN(s) is used to predict the ballistic limit thickness of 500 HB high hardness steel armor.Results show that even with limited number of data,FEM-ANN approach can be used to predict ballistic penetration depth with adequate accuracy.

Performance Comparison of Neural Networks for HRTFs Approximation

0 ＩｎｔｒｏｄｕｃｔｉｏｎＨｅａｄｒｅｌａｔｅｄｔｒａｎｓｆｅｒｆｕｎｃｔｉｏｎｓ(ＨＲＴＦｓ)ｒｅｆｅｒｔｏｔｈｅｓｐｅｃｔｒａｌｆｉｌｔｅｒｉｎｇｆｒｏｍｓｏｕｎｄｓｏｕｒｃｅｓｔｏｌｉｓｔｅｎｅｒｓ’ｅａｒｄｒｕｍｓ.ＳｉｎｃｅＨＲＴＦｓ(ｎｏｎ?..

Comparative Appraisal of Response Surface Methodology and Artificial Neural Network Method for Stabilized Turbulent Confined Jet Diffusion Flames Using Bluff-Body Burners

The present study was conducted to present the comparative modeling, predictive and generalization abilities of response surface methodology (RSM) and artificial neural network (ANN) for the thermal structure of stabilized confined jet diffusion flames in the presence of different geometries of bluff-body burners. Two stabilizer disc burners tapered at 30° and 60° and another frustum cone of 60°/30° inclination angle were employed all having the same diameter of 80 (mm) acting as flame holders. The measured radial mean temperature profiles of the developed stabilized flames at different normalized axial distances (x/dj) were considered as the model example of the physical process. The RSM and ANN methods analyze the effect of the two operating parameters namely (r), the radial distance from the center line of the flame, and (x/dj) on the measured temperature of the flames, to find the predicted maximum temperature and the corresponding process variables. A three-layered Feed Forward Neural Network in conjugation with the hyperbolic tangent sigmoid (tansig) as transfer function and the optimized topology of 2:10:1 (input neurons: hidden neurons: output neurons) was developed. Also the ANN method has been employed to illustrate such effects in the three and two dimensions and shows the location of the predicted maximum temperature. The results indicated the superiority of ANN in the prediction capability as the ranges of R2 and F Ratio are 0.868 - 0.947 and 231.7 - 864.1 for RSM method compared to 0.964 - 0.987 and 2878.8 7580.7 for ANN method beside lower values for error analysis terms.

An Improved SPSA Algorithm for System Identification Using Fuzzy Rules for Training Neural Networks

Simultaneous perturbation stochastic approximation （SPSA） belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper describes an improved SPSA algorithm, which entails fuzzy adaptive gain sequences, gradient smoothing, and a step rejection procedure to enhance convergence and stability. The proposed fuzzy adaptive simultaneous perturbation approximation （FASPA） algorithm is particularly well suited to problems involving a large number of parameters such as those encountered in nonlinear system identification using neural networks （NNs）. Accordingly, a multilayer perceptron （MLP） network with popular training algorithms was used to predicate the system response. We found that an MLP trained by FASPSA had the desired accuracy that was comparable to results obtained by traditional system identification algorithms. Simulation results for typical nonlinear systems demonstrate that the proposed NN architecture trained with FASPSA yields improved system identification as measured by reduced time of convergence and a smaller identification error.

Neural Network Based on SET Inverter Structures: Neuro-Inspired Memory

This paper presents a basic block for building large-scale single-electron neural networks. This macro block is completely composed of SET inverter circuits. We present and discuss the basic parts of this device. The full design and simulation results were done using MATLAB and SIMON, which are a single-electron tunnel device and circuit simulator based on a Monte Carlo method. Special measures had to be taken in order to simulate this circuit correctly in SIMON and compare results with those of SPICE simulation done before. Moreover, we study part of the network as a memory cell with the idea of combining the extremely low-power properties of the SET and the compact design.

混沌自适应非洲秃鹫优化算法训练多层感知器

针对训练多层感知器(MLP)时,算法对初始值敏感、易陷入局部最优和收敛速度慢等问题,对新型启发式算法非洲秃鹫优化算法提出改进算法IAVOA。在初始化种群时引入Logistic混沌映射,增加种群的多样性;对最优秃鹫和次优秃鹫增加自适应权重系数,自动调整这两类秃鹫对普通秃鹫的引导作用;IAVOA用于MLP的训练,采用均方误差的平均值作为适应度函数寻找MLP的连接权重和偏差的最佳组合。选取4个不同复杂度的分类数据集,比较IAVOA算法与现有启发式算法对MLP训练后,MLP对数据分类的性能,仿真结果表明,IAVOA算法训练的MLP在数据分类准确率、全局搜索能力、收敛速度和稳定性方面均具有良好的性能。