A Newton learning method for a neural network of multilayer perceptrons is proposed in this paper. Furthermore, a hybrid learning method id legitimately developed in combination of the backpropagation method proposed ...A Newton learning method for a neural network of multilayer perceptrons is proposed in this paper. Furthermore, a hybrid learning method id legitimately developed in combination of the backpropagation method proposed by Rumelhart et al with the Newton learning method. Finally, the hybrid learning algorithm is compared with the backpropagation algorithm by some illustrations, and the results show that this hybrid leaming algorithm bas the characteristics of rapid convergence.展开更多
The attributes of the ECG signal signifying the unique electrical properties of the heart offer the opportunity to expand the realm of biometrics, which pertains the identification of an individual based on physical c...The attributes of the ECG signal signifying the unique electrical properties of the heart offer the opportunity to expand the realm of biometrics, which pertains the identification of an individual based on physical characteristics. The temporal organization of the ECG signal offers a basis for composing a machine learning feature set. The four attributes of the feature set are derived through software automation enabled by Python. These four attributes are the temporal differential of the P wave maximum and T wave maximum relative to the R wave maximum and the Q wave minimum and S wave minimum relative to the R wave maximum. The multilayer perceptron neural network was applied and evaluated in terms of classification accuracy and time to develop the model. Superior performance was achieved with respect to a reduced feature set considering only the temporal differential of the P wave maximum and T wave maximum relative to the R wave maximum by comparison to all four attributes applied to the feature set and the temporal differential of the Q wave minimum and S wave minimum relative to the R wave maximum. With these preliminary findings and the advent of portable and wearable devices for the acquisition of the ECG signal, the temporal organization of the ECG signal offers robust potential for the field of biometrics.展开更多
The Multilayer Perceptron Neural Network (MLPNN) induction technique has been successfully applied to a variety of machine learning tasks, including the extraction and classification of image features. However, not mu...The Multilayer Perceptron Neural Network (MLPNN) induction technique has been successfully applied to a variety of machine learning tasks, including the extraction and classification of image features. However, not much has been done in the application of MLPNN on images obtained by remote sensing. In this article, two automatic classification systems used in image feature extraction and classification from remote sensing data are presented. The first is a combination of two models: a MLPNN induction technique, integrated under ENVI (Environment for Visualizing Images) platform for classification, and a pre-processing model including dark subtraction for the calibration of the image, the Principal Components Analysis (PCA) for band selections and Independent Components Analysis (ICA) as blind source separator for feature extraction of the Landsat image. The second classification system is a MLPNN induction technique based on the Keras platform. In this case, there was no need for pre-processing model. Experimental results show the two classification systems to outperform other typical feature extraction and classification methods in terms of accuracy for some lithological classes including Granite1 class with the highest class accuracies of 96.69% and 92.69% for the first and second classification system respectively. Meanwhile, the two classification systems perform almost equally with the overall accuracies of 53.01% and 49.98% for the first and second models respectively </span><span style="font-family:Verdana;">though the keras model has the advantage of not integrating the pre-processing</span><span style="font-family:Verdana;"> model, hence increasing its efficiency. The application of these two systems to the study area resulted in the generation of an updated geological mapping with six lithological classes detected including the Gneiss, the Micaschist, the Schist and three versions of Granites (Granite1, Granite2 and Granite3).展开更多
An accurate vertical wind speed(WS)data estimation is required to determine the potential for wind farm installation.In general,the vertical extrapolation of WS at different heights must consider different parameters ...An accurate vertical wind speed(WS)data estimation is required to determine the potential for wind farm installation.In general,the vertical extrapolation of WS at different heights must consider different parameters fromdifferent locations,such as wind shear coefficient,roughness length,and atmospheric conditions.The novelty presented in this article is the introduction of two steps optimization for the Recurrent Neural Networks(RNN)model to estimate WS at different heights using measurements from lower heights.The first optimization of the RNN is performed to minimize a differentiable cost function,namely,mean squared error(MSE),using the Broyden-Fletcher-Goldfarb-Shanno algorithm.Secondly,the RNN is optimized to reduce a non-differentiable cost function using simulated annealing(RNN-SA),namely mean absolute error(MAE).Estimation ofWS vertically at 50 m height is done by training RNN-SA with the actualWS data a 10–40 m heights.The estimatedWS at height of 50 m and the measured WS at 10–40 heights are further used to train RNN-SA to obtain WS at 60 m height.This procedure is repeated continuously until theWS is estimated at a height of 180 m.The RNN-SA performance is compared with the standard RNN,Multilayer Perceptron(MLP),Support Vector Machine(SVM),and state of the art methods like convolutional neural networks(CNN)and long short-term memory(LSTM)networks to extrapolate theWS vertically.The estimated values are also compared with realWS dataset acquired using LiDAR and tested using four error metrics namely,mean squared error(MSE),mean absolute percentage error(MAPE),mean bias error(MBE),and coefficient of determination(R2).The numerical experimental results show that the MSE values between the estimated and actualWS at 180mheight for the RNN-SA,RNN,MLP,and SVM methods are found to be 2.09,2.12,2.37,and 2.63,respectively.展开更多
文摘A Newton learning method for a neural network of multilayer perceptrons is proposed in this paper. Furthermore, a hybrid learning method id legitimately developed in combination of the backpropagation method proposed by Rumelhart et al with the Newton learning method. Finally, the hybrid learning algorithm is compared with the backpropagation algorithm by some illustrations, and the results show that this hybrid leaming algorithm bas the characteristics of rapid convergence.
文摘The attributes of the ECG signal signifying the unique electrical properties of the heart offer the opportunity to expand the realm of biometrics, which pertains the identification of an individual based on physical characteristics. The temporal organization of the ECG signal offers a basis for composing a machine learning feature set. The four attributes of the feature set are derived through software automation enabled by Python. These four attributes are the temporal differential of the P wave maximum and T wave maximum relative to the R wave maximum and the Q wave minimum and S wave minimum relative to the R wave maximum. The multilayer perceptron neural network was applied and evaluated in terms of classification accuracy and time to develop the model. Superior performance was achieved with respect to a reduced feature set considering only the temporal differential of the P wave maximum and T wave maximum relative to the R wave maximum by comparison to all four attributes applied to the feature set and the temporal differential of the Q wave minimum and S wave minimum relative to the R wave maximum. With these preliminary findings and the advent of portable and wearable devices for the acquisition of the ECG signal, the temporal organization of the ECG signal offers robust potential for the field of biometrics.
文摘The Multilayer Perceptron Neural Network (MLPNN) induction technique has been successfully applied to a variety of machine learning tasks, including the extraction and classification of image features. However, not much has been done in the application of MLPNN on images obtained by remote sensing. In this article, two automatic classification systems used in image feature extraction and classification from remote sensing data are presented. The first is a combination of two models: a MLPNN induction technique, integrated under ENVI (Environment for Visualizing Images) platform for classification, and a pre-processing model including dark subtraction for the calibration of the image, the Principal Components Analysis (PCA) for band selections and Independent Components Analysis (ICA) as blind source separator for feature extraction of the Landsat image. The second classification system is a MLPNN induction technique based on the Keras platform. In this case, there was no need for pre-processing model. Experimental results show the two classification systems to outperform other typical feature extraction and classification methods in terms of accuracy for some lithological classes including Granite1 class with the highest class accuracies of 96.69% and 92.69% for the first and second classification system respectively. Meanwhile, the two classification systems perform almost equally with the overall accuracies of 53.01% and 49.98% for the first and second models respectively </span><span style="font-family:Verdana;">though the keras model has the advantage of not integrating the pre-processing</span><span style="font-family:Verdana;"> model, hence increasing its efficiency. The application of these two systems to the study area resulted in the generation of an updated geological mapping with six lithological classes detected including the Gneiss, the Micaschist, the Schist and three versions of Granites (Granite1, Granite2 and Granite3).
文摘An accurate vertical wind speed(WS)data estimation is required to determine the potential for wind farm installation.In general,the vertical extrapolation of WS at different heights must consider different parameters fromdifferent locations,such as wind shear coefficient,roughness length,and atmospheric conditions.The novelty presented in this article is the introduction of two steps optimization for the Recurrent Neural Networks(RNN)model to estimate WS at different heights using measurements from lower heights.The first optimization of the RNN is performed to minimize a differentiable cost function,namely,mean squared error(MSE),using the Broyden-Fletcher-Goldfarb-Shanno algorithm.Secondly,the RNN is optimized to reduce a non-differentiable cost function using simulated annealing(RNN-SA),namely mean absolute error(MAE).Estimation ofWS vertically at 50 m height is done by training RNN-SA with the actualWS data a 10–40 m heights.The estimatedWS at height of 50 m and the measured WS at 10–40 heights are further used to train RNN-SA to obtain WS at 60 m height.This procedure is repeated continuously until theWS is estimated at a height of 180 m.The RNN-SA performance is compared with the standard RNN,Multilayer Perceptron(MLP),Support Vector Machine(SVM),and state of the art methods like convolutional neural networks(CNN)and long short-term memory(LSTM)networks to extrapolate theWS vertically.The estimated values are also compared with realWS dataset acquired using LiDAR and tested using four error metrics namely,mean squared error(MSE),mean absolute percentage error(MAPE),mean bias error(MBE),and coefficient of determination(R2).The numerical experimental results show that the MSE values between the estimated and actualWS at 180mheight for the RNN-SA,RNN,MLP,and SVM methods are found to be 2.09,2.12,2.37,and 2.63,respectively.
