基于不同算法优化的back propagation神经网络在三元乙丙橡胶混炼胶门尼黏度预测中的应用

分别采用遗传算法(GA)和粒子群算法(PSO)优化的back propagation(BP)神经网络建立了三元乙丙橡胶(EPDM)混炼胶门尼黏度的预测模型,并对预测结果的误差进行了对比分析。结果表明,两种算法优化后的BP神经网络模型的预测值与实测值均保持较高的拟合度和相关性;相比单一的BP神经网络,GA优化后BP神经网络模型的精度提高了58.9%,PSO优化后BP神经网络模型的精度提高了3.57%,说明两种算法优化后的预测模型,特别是GA优化的BP神经网络预测模型对EPDM混炼胶门尼黏度的预测精度改善明显。

FORCE RIPPLE SUPPRESSION TECHNOLOGY FOR LINEAR MOTORS BASED ON BACK PROPAGATION NEURAL NETWORK

Various force disturbances influence the thrust force of linear motors when a linear motor （LM） is running. Among all of force disturbances, the force ripple is the dominant while a linear motor runs in low speed. In order to suppress the force ripple, back propagation（BP） neural network is proposed to learn the function of the force ripple of linear motors, and the acquisition method of training samples is proposed based on a disturbance observer. An off-line BP neural network is used mainly because of its high running efficiency and the real-time requirement of the servo control system of a linear motor. By using the function, the force ripple is on-line compensated according to the position of the LM. The experimental results show that the force ripple is effectively suppressed by the compensation of the BP neural network.

Simulation of phytoplankton biomass in Quanzhou Bay using a back propagation network model and sensitivity analysis for environmental variables

Prediction and sensitivity models,to elucidate the response of phytoplankton biomass to environmental factors in Quanzhou Bay,Fujian,China,were developed using a back propagation(BP) network.The environmental indicators of coastal phytoplankton biomass were determined and monitoring data for the bay from 2008 was used to train,test and build a three-layer BP artificial neural network with multi-input and single-output.Ten water quality parameters were used to forecast phytoplankton biomass(measured as chlorophyll-a concentration).Correlation coefficient between biomass values predicted by the model and those observed was 0.964,whilst the average relative error of the network was-3.46% and average absolute error was 10.53%.The model thus has high level of accuracy and is suitable for analysis of the influence of aquatic environmental factors on phytoplankton biomass.A global sensitivity analysis was performed to determine the influence of different environmental indicators on phytoplankton biomass.Indicators were classified according to the sensitivity of response and its risk degree.The results indicate that the parameters most relevant to phytoplankton biomass are estuary-related and include pH,sea surface temperature,sea surface salinity,chemical oxygen demand and ammonium.

Fashion Color Forecasting by Applying an Improved Back Propagation Neural Network

Fashion color forecasting is one of the most important factors for fashion marketing and manufacturing. Several models have been applied by previous researchers to conduct fashion color forecasting. However, few convincing forecasting systems have been established. A prediction model for fashion color forecasting was established by applying an improved back propagation neural network (BPNN) model in this paper. Successive six-year fashion color palettes, released by INTERCOLOR, were used as learning information for the neural network to develop a reliable prediction model. Colors in the palettes were quantified by PANTONE color system. Additionally, performance of the established model was compared with other GM(1, 1) models. Results show that the improved BPNN model is suitable to predict future fashion color trend.

Pseudo Random Number Generator Based on Back Propagation Neural Network

Random numbers play an increasingly important role in secure wire and wireless communication. Thus the design quality of random number generator(RNG) is significant in information security. A novel pseudo RNG is proposed for improving the security of network communication. The back propagation neural network(BPNN) is nonlinear, which can be used to improve the traditional RNG. The novel pseudo RNG is based on BPNN techniques. The result of test suites standardized by the U.S shows that the RNG can satisfy the security of communication.

Projected change in precipitation forms in the Chinese Tianshan Mountains based on the Back Propagation Neural Network Model

In the context of global warming,precipitation forms are likely to transform from snowfall to rainfall with a more pronounced trend.The change in precipitation forms will inevitably affect the processes of regional runoff generation and confluence as well as the annual distribution of runoff.Most researchers used precipitation data from the CMIP5 model directly to study future precipitation trends without distinguishing between snowfall and rainfall.CMIP5 models have been proven to have better performance in simulating temperature but poorer performance in simulating precipitation.To overcome the above limitations,this paper used a Back Propagation Neural Network(BNN)to predict the rainfall-to-precipitation ratio(RPR)in months experiencing freezing-thawing transitions(FTTs).We utilized the meteorological(air pressure,air temperature,evaporation,relative humidity,wind speed,sunshine hours,surface temperature),topographic(altitude,slope,aspect)and geographic(longitude,latitude)data from 28 meteorological stations in the Chinese Tianshan Mountains region(CTMR)from 1961 to 2018 to calculate the RPR and constructed an index system of impact factors.Based on the BNN,decision-making trial and evaluation laboratory method(BP-DEMATEL),the key factors driving the transformation of the RPR in the CTMR were identified.We found that temperature was the only key factor affecting the transformation of the RPR in the BP-DEMATEL model.Considering the relationship between temperature and the RPR,the future temperature under different representative concentration pathways(RCPs)(RCP2.6/RCP4.5/RCP8.5)provided by 21 CMIP5 models and the meteorological factors from meteorological stations were input into the BNN model to acquire the future RPR from 2011 to 2100.The results showed that under the three scenarios,the RPR in the number of months experiencing FTTs during 2011-2100 will be higher than that in the historical period(1981-2010)in the CTMR.Furthermore,in terms of spatial variation,the RPR values on the south slope will be larger than those on the north slope under the three emission scenarios.Moreover,the RPR values exhibited different variation characteristics under different emission scenarios.Under the low-emission scenario(RCP2.6),as time passed,the RPR values changed slightly at more stations.Under the mediumemission scenario(RCP4.5),the RPR increased in the whole CTMR and stabilized on the north slope by the end of this century.Under the high-emission scenario(RCP8.5),the RPR values increased significantly through the 21 st century in the whole CTMR.This study may help to provide a scientific management basis for agricultural production and hydrology.

A Method for Solving Computer-Aided Product Design Optimization Problem Based on Back Propagation Neural Network

Because of the powerful mapping ability, back propagation neural network (BP-NN) has been employed in computer-aided product design (CAPD) to establish the property prediction model. The backward problem in CAPD is to search for the appropriate structure or composition of the product with desired property, which is an optimization problem. In this paper, a global optimization method of using the a BB algorithm to solve the backward problem is presented. In particular, a convex lower bounding function is constructed for the objective function formulated with BP-NN model, and the calculation of the key parameter a is implemented by recurring to the interval Hessian matrix of the objective function. Two case studies involving the design of dopamine β-hydroxylase (DβH) inhibitors and linear low density polyethylene (LLDPE) nano composites are investigated using the proposed method.

Gear Fault Detection Analysis Method Based on Fractional Wavelet Transform and Back Propagation Neural Network

A gear fault detection analysis method based on Fractional Wavelet Transform(FRWT)and Back Propagation Neural Network(BPNN)is proposed.Taking the changing order as the variable,the optimal order of gear vibration signals is determined by discrete fractional Fourier transform.Under the optimal order,the fractional wavelet transform is applied to eliminate noise from gear vibration signals.In this way,useful components of vibration signals can be successfully separated from background noise.Then,a set of feature vectors obtained by calculating the characteristic parameters for the de-noised signals are used to characterize the gear vibration features.Finally,the feature vectors are divided into two groups,including training samples and testing samples,which are input into the BPNN for learning and classification.Experimental results showed that this gear fault detection analysis method could well maintain the useful signal components related to gear faults and effectively extract the weak fault feature.The accuracy rate reached 96.67%in the identification of the type of gear fault.

Combinatorial Optimization Based Analog Circuit Fault Diagnosis with Back Propagation Neural Network

Electronic components' reliability has become the key of the complex system mission execution. Analog circuit is an important part of electronic components. Its fault diagnosis is far more challenging than that of digital circuit. Simulations and applications have shown that the methods based on BP neural network are effective in analog circuit fault diagnosis. Aiming at the tolerance of analog circuit,a combinatorial optimization diagnosis scheme was proposed with back propagation( BP) neural network( BPNN).The main contributions of this scheme included two parts:( 1) the random tolerance samples were added into the nominal training samples to establish new training samples,which were used to train the BP neural network based diagnosis model;( 2) the initial weights of the BP neural network were optimized by genetic algorithm( GA) to avoid local minima,and the BP neural network was tuned with Levenberg-Marquardt algorithm( LMA) in the local solution space to look for the optimum solution or approximate optimal solutions. The experimental results show preliminarily that the scheme substantially improves the whole learning process approximation and generalization ability,and effectively promotes analog circuit fault diagnosis performance based on BPNN.

A Back Propagation-Type Neural Network Architecture for Solving the Complete n ×n Nonlinear Algebraic System of Equations

The objective of this research is the presentation of a neural network capable of solving complete nonlinear algebraic systems of n equations with n unknowns. The proposed neural solver uses the classical back propagation algorithm with the identity function as the output function, and supports the feature of the adaptive learning rate for the neurons of the second hidden layer. The paper presents the fundamental theory associated with this approach as well as a set of experimental results that evaluate the performance and accuracy of the proposed method against other methods found in the literature.

Shallow water bathymetry based on a back propagation neural network and ensemble learning using multispectral satellite imagery

The back propagation(BP)neural network method is widely used in bathymetry based on multispectral satellite imagery.However,the classical BP neural network method faces a potential problem because it easily falls into a local minimum,leading to model training failure.This study confirmed that the local minimum problem of the BP neural network method exists in the bathymetry field and cannot be ignored.Furthermore,to solve the local minimum problem of the BP neural network method,a bathymetry method based on a BP neural network and ensemble learning(BPEL)is proposed.First,the remote sensing imagery and training sample were used as input datasets,and the BP method was used as the base learner to produce multiple water depth inversion results.Then,a new ensemble strategy,namely the minimum outlying degree method,was proposed and used to integrate the water depth inversion results.Finally,an ensemble bathymetric map was acquired.Anda Reef,northeastern Jiuzhang Atoll,and Pingtan coastal zone were selected as test cases to validate the proposed method.Compared with the BP neural network method,the root-mean-square error and the average relative error of the BPEL method can reduce by 0.65–2.84 m and 16%–46%in the three test cases at most.The results showed that the proposed BPEL method could solve the local minimum problem of the BP neural network method and obtain highly robust and accurate bathymetric maps.

Classification of Epileptic Electroencephalograms Using Time-Frequency and Back Propagation Methods

Today,electroencephalography is used to measure brain activity by creating signals that are viewed on a monitor.These signals are frequently used to obtain information about brain neurons and may detect disorders that affect the brain,such as epilepsy.Electroencephalogram(EEG)signals are however prone to artefacts.These artefacts must be removed to obtain accurate and meaningful signals.Currently,computer-aided systems have been used for this purpose.These systems provide high computing power,problem-specific development,and other advantages.In this study,a new clinical decision support system was developed for individuals to detect epileptic seizures using EEG signals.Comprehensive classification results were obtained for the extracted filtered features from the time-frequency domain.The classification accuracies of the time-frequency features obtained from discrete continuous transform(DCT),fractional Fourier transform(FrFT),and Hilbert transform(HT)are compared.Artificial neural networks(ANN)were applied,and back propagation(BP)was used as a learning method.Many studies in the literature describe a single BP algorithm.In contrast,we looked at several BP algorithms including gradient descent with momentum(GDM),scaled conjugate gradient(SCG),and gradient descent with adaptive learning rate(GDA).The most successful algorithm was tested using simulations made on three separate datasets(DCT_EEG,FrFT_EEG,and HT_EEG)that make up the input data.The HT algorithm was the most successful EEG feature extractor in terms of classification accuracy rates in each EEG dataset and had the highest referred accuracy rates of the algorithms.As a result,HT_EEG gives the highest accuracy for all algorithms,and the highest accuracy of 87.38%was produced by the SCG algorithm.

Prediction of SMILE surgical cutting formula based on back propagation neural network

AIM:To predict cutting formula of small incision lenticule extraction(SMILE)surgery and assist clinicians in identifying candidates by deep learning of back propagation(BP)neural network.METHODS:A prediction program was developed by a BP neural network.There were 13188 pieces of data selected as training validation.Another 840 eye samples from 425 patients were recruited for reverse verification of training results.Precision of prediction by BP neural network and lenticule thickness error between machine learning and the actual lenticule thickness in the patient data were measured.RESULTS:After training 2313 epochs,the predictive SMILE cutting formula BP neural network models performed best.The values of mean squared error and gradient are 0.248 and 4.23,respectively.The scatterplot with linear regression analysis showed that the regression coefficient in all samples is 0.99994.The final error accuracy of the BP neural network is-0.003791±0.4221102μm.CONCLUSION:With the help of the BP neural network,the program can calculate the lenticule thickness and residual stromal thickness of SMILE surgery accurately.Combined with corneal parameters and refraction of patients,the program can intelligently and conveniently integrate medical information to identify candidates for SMILE surgery.

Improving the accuracy of heart disease diagnosis with an augmented back propagation algorithm

A multilayer perceptron neural network system is established to support the diagnosis for five most common heart diseases (coronary heart disease, rheumatic valvular heart disease, hypertension, chronic cor pulmonale and congenital heart disease). Momentum term, adaptive learning rate, the forgetting mechanics, and conjugate gradients method are introduced to improve the basic BP algorithm aiming to speed up the convergence of the BP algorithm and enhance the accuracy for diagnosis. A heart disease database consisting of 352 samples is applied to the training and testing courses of the system. The performance of the system is assessed by cross-validation method. It is found that as the basic BP algorithm is improved step by step, the convergence speed and the classification accuracy of the network are enhanced, and the system has great application prospect in supporting heart diseases diagnosis.

Classification Using Two Layer Neural Network Back Propagation Algorithm

Worldwide breast cancer is the most common form of cancer death occurring in 12.6% of women. This paper presents a cost effective approach to classify the normal, malignant and benign tumor using two layer neural network back propagation algorithm. Back propagation algorithm is used to train the neural network. Parallelization techniques speed up the computation process and as a result two layer neural networks outperform the previous work in terms of accuracy. Breast cancer tumor database used for the testing purpose is from the CIA machine learning repository. The highest accuracy of 97.12% is achieved using the two layer neural network back propagation algorithm.

Hybrid algorithm combining genetic algorithm with back propagation neural network for extracting the characteristics of multi-peak Brillouin scattering spectrum

In this study, a hybrid algorithm combining genetic algorithm （GA） with back propagation （BP） neural network （GA-BP） was proposed for extracting the characteristics of multi-peak Brillouin scattering spectrum. Simulations and experimental results show that the GA-BP hybrid algorithm can accurately identify the position and amount of peaks in multi-peak Brillouin scattering spectrum. Moreover, the proposed algorithm obtains a fitting degree of 0.9923 and a mean square error of 0.0094. Therefore, the GA-BP hybrid algorithm possesses a good fitting precision and is suitable for extracting the characteristics of multi-peak Brillouin scattering spectrum.

Porosity Prediction from Well Logs Using Back Propagation Neural Network Optimized by Genetic Algorithm in One Heterogeneous Oil Reservoirs of Ordos Basin, China

A reliable and effective model for reservoir physical property prediction is a key to reservoir characterization and management.At present,using well logging data to estimate reservoir physical parameters is an important means for reservoir evaluation.Based on the characteristics of large quantity and complexity of estimating process,we have attempted to design a nonlinear back propagation neural network model optimized by genetic algorithm(BPNNGA)for reservoir porosity prediction.This model is with the advantages of self-learning and self-adaption of back propagation neural network(BPNN),structural parameters optimizing and global searching optimal solution of genetic algorithm(GA).The model is applied to the Chang 8 oil group tight sandstone of Yanchang Formation in southwestern Ordos Basin.According to the correlations between well logging data and measured core porosity data,5 well logging curves(gamma ray,deep induction,density,acoustic,and compensated neutron)are selected as the input neurons while the measured core porosity is selected as the output neurons.The number of hidden layer neurons is defined as 20 by the method of multiple calibrating optimizations.Modeling results demonstrate that the average relative error of the model output is 10.77%,indicating the excellent predicting effect of the model.The predicting results of the model are compared with the predicting results of conventional multivariate stepwise regression algorithm,and BPNN model.The average relative errors of the above models are 12.83%,12.9%,and 13.47%,respectively.Results show that the predicting results of the BPNNGA model are more accurate than that of the other two,and BPNNGA is a more applicable method to estimate the reservoir porosity parameters in the study area.

A Study of Maneuvering Control for an Air Cushion Vehicle Based on Back Propagation Neural Network

A back propagation （BP） neural network mathematical model was established to investigate the maneuvering control of an air cushion vehicle （ACV）. The calculation was based on four-freedom-degree model experiments of hydrodynamics and aerodynamics. It is necessary for the ACV to control the velocity and the yaw rate as well as the velocity angle at the same time. The yaw rate and the velocity angle must be controlled correspondingly because of the whipping, which is a special characteristic for the ACV. The calculation results show that it is an efficient way for the ACV＇s maneuvering control by using a BP neural network to adjust PID parameters online.

A Review on Back-Propagation Neural Networks in the Application of Remote Sensing Image Classification

ANNs （Artificial neural networks） are used extensively in remote sensing image processing. It has been proven that BPNNs （back-propagation neural networks） have high attainable classification accuracy. However, there is a noticeable variation in the achieved accuracies due to different network designs and implementations. Hence, researchers usually need to conduct several experimental trials before they can finalize the network design. This is a time consuming process which significantly reduces the effectiveness of using BPNNs and the final design may still not be optimal. Therefore, there is a need to see whether there are some common guidelines for effective design and implementation of BPNNs. With this aim in mind, this paper attempts to find and summarize the common guidelines suggested by different authors through literature review and discussion of the findings. To provide readers with background and contextual information, some ANN fundamentals are also introduced.

Age and Gender Classification Using Backpropagation and Bagging Algorithms

Voice classification is important in creating more intelligent systems that help with student exams,identifying criminals,and security systems.The main aim of the research is to develop a system able to predicate and classify gender,age,and accent.So,a newsystem calledClassifyingVoice Gender,Age,and Accent(CVGAA)is proposed.Backpropagation and bagging algorithms are designed to improve voice recognition systems that incorporate sensory voice features such as rhythm-based features used to train the device to distinguish between the two gender categories.It has high precision compared to other algorithms used in this problem,as the adaptive backpropagation algorithm had an accuracy of 98%and the Bagging algorithm had an accuracy of 98.10%in the gender identification data.Bagging has the best accuracy among all algorithms,with 55.39%accuracy in the voice common dataset and age classification and accent accuracy in a speech accent of 78.94%.