Prediction of diabetes and hypertension using multi-layer perceptron neural networks

Background:Diabetes and hypertension are two of the commonest diseases in the world.As they unfavorably affect people of different age groups,they have become a cause of concern and must be predicted and diagnosed well in advance.Objective:This research aims to determine the effectiveness of artificial neural networks(ANNs)in predicting diabetes and blood pressure diseases and to point out the factors which have a high impact on these diseases.Sample:This work used two online datasets which consist of data collected from 768 individuals.We applied neural network algorithms to predict if the individuals have those two diseases based on some factors.Diabetes prediction is based on five factors:age,weight,fat-ratio,glucose,and insulin,while blood pressure prediction is based on six factors:age,weight,fat-ratio,blood pressure,alcohol,and smoking.Method:A model based on the Multi-Layer Perceptron Neural Network(MLP)was implemented.The inputs of the network were the factors for each disease,while the output was the prediction of the disease’s occurrence.The model performance was compared with other classifiers such as Support Vector Machine(SVM)and K-Nearest Neighbors(KNN).We used performance metrics measures to assess the accuracy and performance of MLP.Also,a tool was implemented to help diagnose the diseases and to understand the results.Result:The model predicted the two diseases with correct classification rate(CCR)of 77.6%for diabetes and 68.7%for hypertension.The results indicate that MLP correctly predicts the probability of being diseased or not,and the performance can be significantly increased compared with both SVM and KNN.This shows MLPs effectiveness in early disease prediction.

Contributions of internal climate variability in driving global and ocean temperature variations using multi-layer perceptron neural network

Roles of internal climate variabilities regulating global and ocean temperature changes is a hot but complex issue of scientific concern,infuencing the comprehensive policy-making in response to global and regional warming.In this study,the time series of monthly global and ocean mean surface temperature(GST and OST,respectively)since 1866 is successflly reconstructed via natural and anthropogenic forcing factors and internal climate variability by using a Multi-Layer Perceptron(MLP)neural network technique.The MLP demonstrates prominent monthly GST and OST reconstruction skills on both interannual and annual time scales.Most of the warming in GST and OST since 1866 is found to be attributable to anthropogenic forcing,while the multidecadal and interannual GST and OST variations are considerably dominated by Atlantic Multidecadal Oscillation(AMO).Internal climate variabilities like Interdecadal Pacific Oscillation(IPO)can amplify the GST and OST changes and explain the global warming slowdown since 1998.Southern Oscillation Index(SOI)performs a similar role as IPO but to a lesser extent.Changes in OST caused by solar forcing are more considerable than those in GST.Moreover,the"biased warmth"during the Second World War is successfully reconstructed in MLP.AMO and IPO can explain most annual and even sub-annual temperature variations during this period,offering an explanation for the existence of this abnormal warm period other than that it was entirely caused by instrumental errors.The generally high accuracy of reconstructions on interannual and annual time scales can enhance the ability to monitor the prompt feedback of specific external radiative forcings and internal variabilities to changes in climate.

Efficient Training of Multi-Layer Neural Networks to Achieve Faster Validation

Artificial neural networks(ANNs)are one of the hottest topics in computer science and artificial intelligence due to their potential and advantages in analyzing real-world problems in various disciplines,including but not limited to physics,biology,chemistry,and engineering.However,ANNs lack several key characteristics of biological neural networks,such as sparsity,scale-freeness,and small-worldness.The concept of sparse and scale-free neural networks has been introduced to fill this gap.Network sparsity is implemented by removing weak weights between neurons during the learning process and replacing them with random weights.When the network is initialized,the neural network is fully connected,which means the number of weights is four times the number of neurons.In this study,considering that a biological neural network has some degree of initial sparsity,we design an ANN with a prescribed level of initial sparsity.The neural network is tested on handwritten digits,Arabic characters,CIFAR-10,and Reuters newswire topics.Simulations show that it is possible to reduce the number of weights by up to 50%without losing prediction accuracy.Moreover,in both cases,the testing time is dramatically reduced compared with fully connected ANNs.

Hausdorff Dimension of Multi-Layer Neural Networks

This elucidation investigates the Hausdorff dimension of the output space of multi-layer neural networks. When the factor map from the covering space of the output space to the output space has a synchronizing word, the Hausdorff dimension of the output space relates to its topological entropy. This clarifies the geometrical structure of the output space in more details.

Learning Performance of Linear and Exponential Activity Function with Multi-layered Neural Networks

This paper presents a study on the improvement of MLNNs(multi-layer neural networks)performance by an activity function for multi logic training patterns.Our model network has L hidden layers of two inputs and three,four to six output training using BP(backpropagation)neural network.We used logic functions of XOR(exclusive OR),OR,AND,NAND(not AND),NXOR(not exclusive OR)and NOR(not OR)as the multi logic teacher signals to evaluate the training performance of MLNNs by an activity function for information and data enlargement in signal processing(synaptic divergence state).We specifically used four activity functions from which we modified one and called it L&exp.function as it could give the highest training abilities compared to the original activity functions of Sigmoid,ReLU and Step during simulation and training in the network.And finally,we propose L&exp.function as being good for MLNNs and it may be applicable for signal processing of data and information enlargement because of its performance training characteristics with multiple training logic patterns hence can be adopted in machine deep learning.

Improving Performance of Recurrent Neural Networks Using Simulated Annealing for Vertical Wind Speed Estimation

An accurate vertical wind speed(WS)data estimation is required to determine the potential for wind farm installation.In general,the vertical extrapolation of WS at different heights must consider different parameters fromdifferent locations,such as wind shear coefficient,roughness length,and atmospheric conditions.The novelty presented in this article is the introduction of two steps optimization for the Recurrent Neural Networks(RNN)model to estimate WS at different heights using measurements from lower heights.The first optimization of the RNN is performed to minimize a differentiable cost function,namely,mean squared error(MSE),using the Broyden-Fletcher-Goldfarb-Shanno algorithm.Secondly,the RNN is optimized to reduce a non-differentiable cost function using simulated annealing(RNN-SA),namely mean absolute error(MAE).Estimation ofWS vertically at 50 m height is done by training RNN-SA with the actualWS data a 10–40 m heights.The estimatedWS at height of 50 m and the measured WS at 10–40 heights are further used to train RNN-SA to obtain WS at 60 m height.This procedure is repeated continuously until theWS is estimated at a height of 180 m.The RNN-SA performance is compared with the standard RNN,Multilayer Perceptron(MLP),Support Vector Machine(SVM),and state of the art methods like convolutional neural networks(CNN)and long short-term memory(LSTM)networks to extrapolate theWS vertically.The estimated values are also compared with realWS dataset acquired using LiDAR and tested using four error metrics namely,mean squared error(MSE),mean absolute percentage error(MAPE),mean bias error(MBE),and coefficient of determination(R2).The numerical experimental results show that the MSE values between the estimated and actualWS at 180mheight for the RNN-SA,RNN,MLP,and SVM methods are found to be 2.09,2.12,2.37,and 2.63,respectively.

Preliminary Biometrics of ECG Signal Based on Temporal Organization through the Implementation of a Multilayer Perceptron Neural Network

The attributes of the ECG signal signifying the unique electrical properties of the heart offer the opportunity to expand the realm of biometrics, which pertains the identification of an individual based on physical characteristics. The temporal organization of the ECG signal offers a basis for composing a machine learning feature set. The four attributes of the feature set are derived through software automation enabled by Python. These four attributes are the temporal differential of the P wave maximum and T wave maximum relative to the R wave maximum and the Q wave minimum and S wave minimum relative to the R wave maximum. The multilayer perceptron neural network was applied and evaluated in terms of classification accuracy and time to develop the model. Superior performance was achieved with respect to a reduced feature set considering only the temporal differential of the P wave maximum and T wave maximum relative to the R wave maximum by comparison to all four attributes applied to the feature set and the temporal differential of the Q wave minimum and S wave minimum relative to the R wave maximum. With these preliminary findings and the advent of portable and wearable devices for the acquisition of the ECG signal, the temporal organization of the ECG signal offers robust potential for the field of biometrics.

Classification of frozen soil blastability by using perceptron neural network

Influence factors of frozen soil blastability are analyzed which mainly conclude the strain energy coefficient, tensile strength, compressive strength, longitudinal wave velocity and transverse wave velocity. According to the principle of perceptron neural network, at first the index factors are standardized by the aid of the efficient function theory, then the blastability of frozen sand at -7, -12 and -17 ℃ are classified three categories. Through adjusting the weight value and threshold value, we can obtain that the clay blastability at -7 ℃ is close to the sand blastability at -12 ℃, they belong to the second category, the clay blastability at -12 ℃ is close to the sand blastability at -17 ℃, thus they are divided into the third category.

The development of a knowledge base in an expert system based on the four-layer perceptron neural network

Owing to continuous production lines with large amount of consecutive controls, various control signals and huge logistic relations, this paper introduced the methods and principles of the development of knowledge base in a fault diagnosis expert system that was based on machine learning by the four-layer perceptron neural network. An example was presented. By combining differential function with not differential function and back propagation of error with back propagation of expectation, the four-layer perceptron neural network was established. And it was good for solving such a bottleneck problem in knowledge acquisition in expert system and enhancing real-time on-line diagnosis. A method of synthetic back propagation was designed, which broke the limit to non-differentiable function in BP neural network.

Medical Image Compression Method Using Lightweight Multi-Layer Perceptron for Mobile Healthcare Applications

As video compression is one of the core technologies required to enable seamless medical data streaming in mobile healthcare applications,there is a need to develop powerful media codecs that can achieve minimum bitrates while maintaining high perceptual quality.Versatile Video Coding(VVC)is the latest video coding standard that can provide powerful coding performance with a similar visual quality compared to the previously developed method that is High Efficiency Video Coding(HEVC).In order to achieve this improved coding performance,VVC adopted various advanced coding tools,such as flexible Multi-type Tree(MTT)block structure which uses Binary Tree(BT)split and Ternary Tree(TT)split.However,VVC encoder requires heavy computational complexity due to the excessive Ratedistortion Optimization(RDO)processes used to determine the optimalMTT block mode.In this paper,we propose a fast MTT decision method with two Lightweight Neural Networks(LNNs)using Multi-layer Perceptron(MLP),which are applied to determine the early termination of the TT split within the encoding process.Experimental results show that the proposed method significantly reduced the encoding complexity up to 26%with unnoticeable coding loss compared to the VVC TestModel(VTM).

Updated Lithological Map in the Forest Zone of the Centre, South and East Regions of Cameroon Using Multilayer Perceptron Neural Network and Landsat Images

The Multilayer Perceptron Neural Network (MLPNN) induction technique has been successfully applied to a variety of machine learning tasks, including the extraction and classification of image features. However, not much has been done in the application of MLPNN on images obtained by remote sensing. In this article, two automatic classification systems used in image feature extraction and classification from remote sensing data are presented. The first is a combination of two models: a MLPNN induction technique, integrated under ENVI (Environment for Visualizing Images) platform for classification, and a pre-processing model including dark subtraction for the calibration of the image, the Principal Components Analysis (PCA) for band selections and Independent Components Analysis (ICA) as blind source separator for feature extraction of the Landsat image. The second classification system is a MLPNN induction technique based on the Keras platform. In this case, there was no need for pre-processing model. Experimental results show the two classification systems to outperform other typical feature extraction and classification methods in terms of accuracy for some lithological classes including Granite1 class with the highest class accuracies of 96.69% and 92.69% for the first and second classification system respectively. Meanwhile, the two classification systems perform almost equally with the overall accuracies of 53.01% and 49.98% for the first and second models respectively though the keras model has the advantage of not integrating the pre-processing model, hence increasing its efficiency. The application of these two systems to the study area resulted in the generation of an updated geological mapping with six lithological classes detected including the Gneiss, the Micaschist, the Schist and three versions of Granites (Granite1, Granite2 and Granite3).

Dynamic interwell connectivity analysis of multi-layer waterflooding reservoirs based on an improved graph neural network

The analysis of interwell connectivity plays an important role in the formulation of oilfield development plans and the description of residual oil distribution. In fact, sandstone reservoirs in China's onshore oilfields generally have the characteristics of thin and many layers, so multi-layer joint production is usually adopted. It remains a challenge to ensure the accuracy of splitting and dynamic connectivity in each layer of the injection-production wells with limited field data. The three-dimensional well pattern of multi-layer reservoir and the relationship between injection-production wells can be equivalent to a directional heterogeneous graph. In this paper, an improved graph neural network is proposed to construct an interacting process mimics the real interwell flow regularity. In detail, this method is used to split injection and production rates by combining permeability, porosity and effective thickness, and to invert the dynamic connectivity in each layer of the injection-production wells by attention mechanism.Based on the material balance and physical information, the overall connectivity from the injection wells,through the water injection layers to the production layers and the output of final production wells is established. Meanwhile, the change of well pattern caused by perforation, plugging and switching of wells at different times is achieved by updated graph structure in spatial and temporal ways. The effectiveness of the method is verified by a combination of reservoir numerical simulation examples and field example. The method corresponds to the actual situation of the reservoir, has wide adaptability and low cost, has good practical value, and provides a reference for adjusting the injection-production relationship of the reservoir and the development of the remaining oil.

Machine learning for pore-water pressure time-series prediction:Application of recurrent neural networks

Knowledge of pore-water pressure(PWP)variation is fundamental for slope stability.A precise prediction of PWP is difficult due to complex physical mechanisms and in situ natural variability.To explore the applicability and advantages of recurrent neural networks(RNNs)on PWP prediction,three variants of RNNs,i.e.,standard RNN,long short-term memory(LSTM)and gated recurrent unit(GRU)are adopted and compared with a traditional static artificial neural network(ANN),i.e.,multi-layer perceptron(MLP).Measurements of rainfall and PWP of representative piezometers from a fully instrumented natural slope in Hong Kong are used to establish the prediction models.The coefficient of determination(R^2)and root mean square error(RMSE)are used for model evaluations.The influence of input time series length on the model performance is investigated.The results reveal that MLP can provide acceptable performance but is not robust.The uncertainty bounds of RMSE of the MLP model range from 0.24 kPa to 1.12 k Pa for the selected two piezometers.The standard RNN can perform better but the robustness is slightly affected when there are significant time lags between PWP changes and rainfall.The GRU and LSTM models can provide more precise and robust predictions than the standard RNN.The effects of the hidden layer structure and the dropout technique are investigated.The single-layer GRU is accurate enough for PWP prediction,whereas a double-layer GRU brings extra time cost with little accuracy improvement.The dropout technique is essential to overfitting prevention and improvement of accuracy.

Performance Comparison of Neural Networks for HRTFs Approximation

0 ＩｎｔｒｏｄｕｃｔｉｏｎＨｅａｄｒｅｌａｔｅｄｔｒａｎｓｆｅｒｆｕｎｃｔｉｏｎｓ(ＨＲＴＦｓ)ｒｅｆｅｒｔｏｔｈｅｓｐｅｃｔｒａｌｆｉｌｔｅｒｉｎｇｆｒｏｍｓｏｕｎｄｓｏｕｒｃｅｓｔｏｌｉｓｔｅｎｅｒｓ’ｅａｒｄｒｕｍｓ.ＳｉｎｃｅＨＲＴＦｓ(ｎｏｎ?..

Identification and Prediction of Internet Traffic Using Artificial Neural Networks

This paper presents the development of an artificial neural network (ANN) model based on the multi-layer perceptron (MLP) for analyzing internet traffic data over IP networks. We applied the ANN to analyze a time series of measured data for network response evaluation. For this reason, we used the input and output data of an internet traffic over IP networks to identify the ANN model, and we studied the performance of some training algorithms used to estimate the weights of the neuron. The comparison between some training algorithms demonstrates the efficiency and the accu-racy of the Levenberg-Marquardt (LM) and the Resilient back propagation (Rp) algorithms in term of statistical crite-ria. Consequently, the obtained results show that the developed models, using the LM and the Rp algorithms, can successfully be used for analyzing internet traffic over IP networks, and can be applied as an excellent and fundamental tool for the management of the internet traffic at different times.

Applying Neural Network Architecture for Inverse Kinematics Problem in Robotics

One of the most important problems in robot kinematics and control is, finding the solution of Inverse Kinematics. Inverse kinematics computation has been one of the main problems in robotics research. As the Complexity of robot increases, obtaining the inverse kinematics is difficult and computationally expensive. Traditional methods such as geometric, iterative and algebraic are inadequate if the joint structure of the manipulator is more complex. As alternative approaches, neural networks and optimal search methods have been widely used for inverse kinematics modeling and control in robotics This paper proposes neural network architecture that consists of 6 sub-neural networks to solve the inverse kinematics problem for robotics manipulators with 2 or higher degrees of freedom. The neural networks utilized are multi-layered perceptron (MLP) with a back-propagation training algorithm. This approach will reduce the complexity of the algorithm and calculation (matrix inversion) faced when using the Inverse Geometric Models implementation (IGM) in robotics. The obtained results are presented and analyzed in order to prove the efficiency of the proposed approach.

Estimating stock closing indices using a GA-weighted condensed polynomial neural network

Accurate forecasting of changes in stock market indices can provide financial managers and individual investors with strategically valuable information.However,predicting the closing prices of stock indices remains a challenging task because stock price movements are characterized by high volatility and nonlinearity.This paper proposes a novel condensed polynomial neural network(CPNN)for the task of forecasting stock closing price indices.We developed a model that uses partial descriptions(PDs)and is limited to only two layers for the PNN architecture.The outputs of these PDs along with the original features are fed to a single output neuron,and the synaptic weight values and biases of the CPNN are optimized by a genetic algorithm.The proposed model was evaluated by predicting the next day’s closing price of five fast-growing stock indices:the BSE,DJIA,NASDAQ,FTSE,and TAIEX.In comparative testing,the proposed model proved its ability to provide closing price predictions with superior accuracy.Further,the Deibold-Mariano test justified the statistical significance of the model,establishing that this approach can be adopted as a competent financial forecasting tool.

An Improved SPSA Algorithm for System Identification Using Fuzzy Rules for Training Neural Networks

Simultaneous perturbation stochastic approximation （SPSA） belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper describes an improved SPSA algorithm, which entails fuzzy adaptive gain sequences, gradient smoothing, and a step rejection procedure to enhance convergence and stability. The proposed fuzzy adaptive simultaneous perturbation approximation （FASPA） algorithm is particularly well suited to problems involving a large number of parameters such as those encountered in nonlinear system identification using neural networks （NNs）. Accordingly, a multilayer perceptron （MLP） network with popular training algorithms was used to predicate the system response. We found that an MLP trained by FASPSA had the desired accuracy that was comparable to results obtained by traditional system identification algorithms. Simulation results for typical nonlinear systems demonstrate that the proposed NN architecture trained with FASPSA yields improved system identification as measured by reduced time of convergence and a smaller identification error.

A Novel Method for Solving Ordinary Differential Equations with Artificial Neural Networks

This research work investigates the use of Artificial Neural Network (ANN) based on models for solving first and second order linear constant coefficient ordinary differential equations with initial conditions. In particular, we employ a feed-forward Multilayer Perceptron Neural Network (MLPNN), but bypass the standard back-propagation algorithm for updating the intrinsic weights. A trial solution of the differential equation is written as a sum of two parts. The first part satisfies the initial or boundary conditions and contains no adjustable parameters. The second part involves a feed-forward neural network to be trained to satisfy the differential equation. Numerous works have appeared in recent times regarding the solution of differential equations using ANN, however majority of these employed a single hidden layer perceptron model, incorporating a back-propagation algorithm for weight updation. For the homogeneous case, we assume a solution in exponential form and compute a polynomial approximation using statistical regression. From here we pick the unknown coefficients as the weights from input layer to hidden layer of the associated neural network trial solution. To get the weights from hidden layer to the output layer, we form algebraic equations incorporating the default sign of the differential equations. We then apply the Gaussian Radial Basis function (GRBF) approximation model to achieve our objective. The weights obtained in this manner need not be adjusted. We proceed to develop a Neural Network algorithm using MathCAD software, which enables us to slightly adjust the intrinsic biases. We compare the convergence and the accuracy of our results with analytic solutions, as well as well-known numerical methods and obtain satisfactory results for our example ODE problems.

E-mail Spam Classification Using Grasshopper Optimization Algorithm and Neural Networks

Spam has turned into a big predicament these days,due to the increase in the number of spam emails,as the recipient regularly receives piles of emails.Not only is spam wasting users’time and bandwidth.In addition,it limits the storage space of the email box as well as the disk space.Thus,spam detection is a challenge for individuals and organizations alike.To advance spam email detection,this work proposes a new spam detection approach,using the grasshopper optimization algorithm(GOA)in training a multilayer perceptron(MLP)classifier for categorizing emails as ham and spam.Hence,MLP and GOA produce an artificial neural network(ANN)model,referred to(GOAMLP).Two corpora are applied Spam Base and UK-2011Web spam for this approach.Finally,the finding represents evidence that the proposed spam detection approach has achieved a better level in spam detection than the status of the art.