A novel real coded improved genetic algorithm (GA) of training feed forward neural network is proposed to realize nonlinear system forecast. The improved GA employs a generation alternation model based the minimal gen...A novel real coded improved genetic algorithm (GA) of training feed forward neural network is proposed to realize nonlinear system forecast. The improved GA employs a generation alternation model based the minimal generation gap (MGP) and blend crossover operators (BLX α). Compared with traditional GA implemented in binary number, the processing time of the improved GA is faster because coding and decoding are unnecessary. In addition, it needn t set parameters such as the probability value of crossove...展开更多
An artificial neural network (ANN) model was developed for simulating and predicting critical dimension dc of glass forming alloys. A group of Zr-Al-Ni-Cu and Cu-Zr-Ti-Ni bulk metallic glasses were designed based on...An artificial neural network (ANN) model was developed for simulating and predicting critical dimension dc of glass forming alloys. A group of Zr-Al-Ni-Cu and Cu-Zr-Ti-Ni bulk metallic glasses were designed based on the dc and their de values were predicted by the ANN model. Zr-Al-Ni-Cu and Cu-Zr-Ti-Ni bulk metallic glasses were prepared by injecting into copper mold. The amorphous structures and the determination of the dc of as-cast alloys were ascertained using X-ray diffraction. The results show that the predicted de values of glass forming alloys are in agreement with the corresponding experimental values. Thus the developed ANN model is reliable and adequate for designing the composition and predicting the de of glass forming alloy.展开更多
Aim To eliminate the influences of backlash nonlinear characteristics generally existing in servo systems, a nonlinear compensation method using backpropagation neural networks(BPNN) is presented. Methods Based on s...Aim To eliminate the influences of backlash nonlinear characteristics generally existing in servo systems, a nonlinear compensation method using backpropagation neural networks(BPNN) is presented. Methods Based on some weapon tracking servo system, a three layer BPNN was used to off line identify the backlash characteristics, then a nonlinear compensator was designed according to the identification results. Results The simulation results show that the method can effectively get rid of the sustained oscillation(limit cycle) of the system caused by the backlash characteristics, and can improve the system accuracy. Conclusion The method is effective on sloving the problems produced by the backlash characteristics in servo systems, and it can be easily accomplished in engineering.展开更多
The problem of blind separation of signals in post nonlinear mixture is addressed in this paper. The post nonlinear mixture is formed by a component wise nonlinear distortion after the linear mixture. Hence a nonlin...The problem of blind separation of signals in post nonlinear mixture is addressed in this paper. The post nonlinear mixture is formed by a component wise nonlinear distortion after the linear mixture. Hence a nonlinear adjusting part placed in front of the linear separation structure is needed to compensate for the distortion in separating such signals. The learning rules for the post nonlinear separation structure are derived by a maximum likelihood approach. An algorithm for blind separation of post nonlinearly mixed sub and super Gaussian signals is proposed based on some previous work. Multilayer perceptrons are used in this algorithm to model the nonlinear part of the separation structure. The algorithm switches between sub and super Gaussian probability models during learning according to a stability condition and operates in a block adaptive manner. The effectiveness of the algorithm is verified by experiments on simulated and real world signals.展开更多
The identification problem of Hammerstein model with extension to the multi input multi output (MIMO) case is studied. The proposed identification method uses a hybrid neural network (HNN) which consists of a mult...The identification problem of Hammerstein model with extension to the multi input multi output (MIMO) case is studied. The proposed identification method uses a hybrid neural network (HNN) which consists of a multi layer feed forward neural network (MFNN) in cascade with a linear neural network (LNN). A unified back propagation (BP) algorithm is proposed to estimate the weights and the biases of the MFNN and the LNN simultaneously. Numerical examples are provided to show the efficiency of the proposed method.展开更多
A new method is presented in this paper for fitting VFC*ss (voltage to frequency converter) output functions by using high order neural networks. The nonlinear estimation is implemented when the VFC110 is used at a...A new method is presented in this paper for fitting VFC*ss (voltage to frequency converter) output functions by using high order neural networks. The nonlinear estimation is implemented when the VFC110 is used at a full scale output frequency of 4 MHz. Two kinds of on line dynamic calibrating circuits are designed to improve the sampling precision. This method can also be applied to different industrial applications.展开更多
A new type controller, fuzzy neural networks sliding mode controller (FNNSMC), is developed for a class of large scale systems with unknown bounds of high order interconnections and disturbances. Although sliding mod...A new type controller, fuzzy neural networks sliding mode controller (FNNSMC), is developed for a class of large scale systems with unknown bounds of high order interconnections and disturbances. Although sliding mode control is simple and insensitive to uncertainties and disturbances, there are two main problems in the sliding mode controller (SMC): control input chattering and the assumption of known bounds of uncertainties and disturbances. The FNNSMC, which incorporates the fuzzy neural networks (FNN) and the SMC, can eliminate the chattering by using the continuous output of the FNN to replace the discontinuous sign term in the SMC. The bounds of uncertainties and disturbances are also not required in the FNNSMC design. The simulation results show that the FNNSMC has more robustness than the SMC.展开更多
Aim To study the identification and control of nonlinear systems using neural networks. Methods A new type of neural network in which the dynamical error feedback is used to modify the inputs of the network was empl...Aim To study the identification and control of nonlinear systems using neural networks. Methods A new type of neural network in which the dynamical error feedback is used to modify the inputs of the network was employed to reduce the inherent network approximation error. Results A new identification model constructed by the proposed network and stable filters was derived for continuous time nonlinear systems, and a stable adaptive control scheme based on the proposed networks was developed. Conclusion Theory and simulation results show that the modified neural network is feasible to control a class of nonlinear systems.展开更多
Recently, wavelet neural networks have become a popular tool for non-linear functional approximation. Wavelet neural networks, which basis functions are orthonormal scalling functions, are more suitable in approximati...Recently, wavelet neural networks have become a popular tool for non-linear functional approximation. Wavelet neural networks, which basis functions are orthonormal scalling functions, are more suitable in approximating to function. Based on it, approximating to NLAR(p) with wavelet neural networks is studied.展开更多
This paper investigates the problem of the model validation in identifying discrete-time-nonlinear dynamic systems by using neural networks with a single hidden layer.Based on the estimation theory,a synthetic error-i...This paper investigates the problem of the model validation in identifying discrete-time-nonlinear dynamic systems by using neural networks with a single hidden layer.Based on the estimation theory,a synthetic error-index(SEI)criterion for the neural network models has been developed.By using the powerful training algorithm of recursive prediction error (RPE),two simulated non-linear systems are studied,and the results show that the synthetic error-index criterion can be used to verify the dynamic neural network models.Furthermore,the proposed technique is much simple in calculation than that of the effective correlation tests.Finally,some problems required by further study are discussed.展开更多
A new type of nonlinear observer for nonlinear systems is presented. Instead of approximating thc cntire nonlinear system with the neural network (NN), only the un-modeled part left over after the lincarization is a...A new type of nonlinear observer for nonlinear systems is presented. Instead of approximating thc cntire nonlinear system with the neural network (NN), only the un-modeled part left over after the lincarization is approximated. Compared with the conventional linear observer, the observer provides more accurate estimation of the state. The state estimation error is proved to asymptotically approach zero with the Lyapunov method. The simulation result shows that the proposed observer scheme is effective and has a potential application ability in the fault detection and identification (FDI), and the state estimation.展开更多
Conventional artificial neural networks used to solve electrical resistivity imaging (ERI) inversion problem suffer from overfitting and local minima. To solve these problems, we propose to use a pruning Bayesian ne...Conventional artificial neural networks used to solve electrical resistivity imaging (ERI) inversion problem suffer from overfitting and local minima. To solve these problems, we propose to use a pruning Bayesian neural network (PBNN) nonlinear inversion method and a sample design method based on the K-medoids clustering algorithm. In the sample design method, the training samples of the neural network are designed according to the prior information provided by the K-medoids clustering results; thus, the training process of the neural network is well guided. The proposed PBNN, based on Bayesian regularization, is used to select the hidden layer structure by assessing the effect of each hidden neuron to the inversion results. Then, the hyperparameter αk, which is based on the generalized mean, is chosen to guide the pruning process according to the prior distribution of the training samples under the small-sample condition. The proposed algorithm is more efficient than other common adaptive regularization methods in geophysics. The inversion of synthetic data and field data suggests that the proposed method suppresses the noise in the neural network training stage and enhances the generalization. The inversion results with the proposed method are better than those of the BPNN, RBFNN, and RRBFNN inversion methods as well as the conventional least squares inversion.展开更多
A nonlinear feedback term is introduced into the evaluation equation of weights of the backpropagation algorithm for neural network, the network becomes a chaotic one. For the purpose of that we can investigate how th...A nonlinear feedback term is introduced into the evaluation equation of weights of the backpropagation algorithm for neural network, the network becomes a chaotic one. For the purpose of that we can investigate how the different feedback terms affect the process of learning and forecasting, we use the model to forecast the nonlinear time series which is produced by Makey-Glass equation. By selecting the suitable feedback term, the system can escape from the local minima and converge to the global minimum or its approximate solutions, and the forecasting results are better than those of backpropagation algorithm.展开更多
The cellular neural/nonlinear network (CNN) is a powerful tool for image and video signal processing,robotic and biological visions. This paper discusses a general method for designing template of the global connectiv...The cellular neural/nonlinear network (CNN) is a powerful tool for image and video signal processing,robotic and biological visions. This paper discusses a general method for designing template of the global connectivitydetection (GCD) CNN, which provides parameter inequalities for determining parameter intervals for implementing thecorresponding functions. The GCD CNN has stronger ability and faster rate for determining global connectivity in binarypatterns than the GCD CNN proposed by Zarandy. An example for detecting the connectivity in complex patterns isgiven.展开更多
Since there were few chaotic neural networks applicable to the global optimization, in this paper, we propose a new neural network model ? chaotic parameters disturbance annealing (CPDA) network, which is superior to ...Since there were few chaotic neural networks applicable to the global optimization, in this paper, we propose a new neural network model ? chaotic parameters disturbance annealing (CPDA) network, which is superior to other existing neural networks, genetic algorithms, and simulated annealing algorithms in global optimization. In the present CPDA network, we add some chaotic parameters in the energy function, which make the Hopfield neural network escape from the attraction of a local minimal solution and with the parameter annealing, our model will converge to the global optimal solutions quickly and steadily. The converge ability and other characters are also analyzed in this paper. The benchmark examples show the present CPDA neural network's merits in nonlinear global optimization.展开更多
BP( Back Propagation) neural network and PSO( Particle Swarm Optimization) are two main heuristic optimization methods,and are usually used as nonlinear inversion methods in geophysics. The authors applied BP neural n...BP( Back Propagation) neural network and PSO( Particle Swarm Optimization) are two main heuristic optimization methods,and are usually used as nonlinear inversion methods in geophysics. The authors applied BP neural network and BP neural network optimized with PSO into the inversion of 3D density interface respectively,and a comparison was drawn to demonstrate the inversion results. To start with,a synthetic density interface model was created and we used the proceeding inversion methods to test their effectiveness. And then two methods were applied into the inversion of the depth of Moho interface. According to the results,it is clear to find that the application effect of PSO-BP is better than that of BP network. The BP network structures used in both synthetic and field data are consistent in order to obtain preferable inversion results. The applications in synthetic and field tests demonstrate that PSO-BP is a fast and effective method in the inversion of 3D density interface and the optimization effect is evident compared with BP neural network merely,and thus,this method has practical value.展开更多
The non-linear relationships between the contents of ginsenoside Rg 1, Rb 1, Rd and Panax notoginseng saponins(PNS) in Panax notoginseng root herb and the near infrared(NIR) diffuse reflectance spectra of the herb wer...The non-linear relationships between the contents of ginsenoside Rg 1, Rb 1, Rd and Panax notoginseng saponins(PNS) in Panax notoginseng root herb and the near infrared(NIR) diffuse reflectance spectra of the herb were established by means of artificial neural networks(ANNs). Four three-layered perception feed-forward networks were trained with an error back-propagation algorithm. The significant principal components of the NIR spectral data matrix were utilized as the input of the networks. The networks architecture and parameters were selected so as to offer less prediction errors. Relative prediction errors for Rg 1, Rb 1, Rd and PNS obtained with the optimum ANN models were 8.99%, 6.54%, 8.29%, and 5.17%, respectively, which were superior to those obtained with PLSR methods. It is verified that ANN is a suitable approach to model this complex non-linearity. The developed method is fast, non-destructive and accurate and it provides a new efficient approach for determining the active components in the complex system of natural herbs.展开更多
文摘A novel real coded improved genetic algorithm (GA) of training feed forward neural network is proposed to realize nonlinear system forecast. The improved GA employs a generation alternation model based the minimal generation gap (MGP) and blend crossover operators (BLX α). Compared with traditional GA implemented in binary number, the processing time of the improved GA is faster because coding and decoding are unnecessary. In addition, it needn t set parameters such as the probability value of crossove...
基金Project(50874045)supported by the National Natural Science Foundation of China
文摘An artificial neural network (ANN) model was developed for simulating and predicting critical dimension dc of glass forming alloys. A group of Zr-Al-Ni-Cu and Cu-Zr-Ti-Ni bulk metallic glasses were designed based on the dc and their de values were predicted by the ANN model. Zr-Al-Ni-Cu and Cu-Zr-Ti-Ni bulk metallic glasses were prepared by injecting into copper mold. The amorphous structures and the determination of the dc of as-cast alloys were ascertained using X-ray diffraction. The results show that the predicted de values of glass forming alloys are in agreement with the corresponding experimental values. Thus the developed ANN model is reliable and adequate for designing the composition and predicting the de of glass forming alloy.
文摘Aim To eliminate the influences of backlash nonlinear characteristics generally existing in servo systems, a nonlinear compensation method using backpropagation neural networks(BPNN) is presented. Methods Based on some weapon tracking servo system, a three layer BPNN was used to off line identify the backlash characteristics, then a nonlinear compensator was designed according to the identification results. Results The simulation results show that the method can effectively get rid of the sustained oscillation(limit cycle) of the system caused by the backlash characteristics, and can improve the system accuracy. Conclusion The method is effective on sloving the problems produced by the backlash characteristics in servo systems, and it can be easily accomplished in engineering.
文摘The problem of blind separation of signals in post nonlinear mixture is addressed in this paper. The post nonlinear mixture is formed by a component wise nonlinear distortion after the linear mixture. Hence a nonlinear adjusting part placed in front of the linear separation structure is needed to compensate for the distortion in separating such signals. The learning rules for the post nonlinear separation structure are derived by a maximum likelihood approach. An algorithm for blind separation of post nonlinearly mixed sub and super Gaussian signals is proposed based on some previous work. Multilayer perceptrons are used in this algorithm to model the nonlinear part of the separation structure. The algorithm switches between sub and super Gaussian probability models during learning according to a stability condition and operates in a block adaptive manner. The effectiveness of the algorithm is verified by experiments on simulated and real world signals.
文摘The identification problem of Hammerstein model with extension to the multi input multi output (MIMO) case is studied. The proposed identification method uses a hybrid neural network (HNN) which consists of a multi layer feed forward neural network (MFNN) in cascade with a linear neural network (LNN). A unified back propagation (BP) algorithm is proposed to estimate the weights and the biases of the MFNN and the LNN simultaneously. Numerical examples are provided to show the efficiency of the proposed method.
文摘A new method is presented in this paper for fitting VFC*ss (voltage to frequency converter) output functions by using high order neural networks. The nonlinear estimation is implemented when the VFC110 is used at a full scale output frequency of 4 MHz. Two kinds of on line dynamic calibrating circuits are designed to improve the sampling precision. This method can also be applied to different industrial applications.
文摘A new type controller, fuzzy neural networks sliding mode controller (FNNSMC), is developed for a class of large scale systems with unknown bounds of high order interconnections and disturbances. Although sliding mode control is simple and insensitive to uncertainties and disturbances, there are two main problems in the sliding mode controller (SMC): control input chattering and the assumption of known bounds of uncertainties and disturbances. The FNNSMC, which incorporates the fuzzy neural networks (FNN) and the SMC, can eliminate the chattering by using the continuous output of the FNN to replace the discontinuous sign term in the SMC. The bounds of uncertainties and disturbances are also not required in the FNNSMC design. The simulation results show that the FNNSMC has more robustness than the SMC.
文摘Aim To study the identification and control of nonlinear systems using neural networks. Methods A new type of neural network in which the dynamical error feedback is used to modify the inputs of the network was employed to reduce the inherent network approximation error. Results A new identification model constructed by the proposed network and stable filters was derived for continuous time nonlinear systems, and a stable adaptive control scheme based on the proposed networks was developed. Conclusion Theory and simulation results show that the modified neural network is feasible to control a class of nonlinear systems.
文摘Recently, wavelet neural networks have become a popular tool for non-linear functional approximation. Wavelet neural networks, which basis functions are orthonormal scalling functions, are more suitable in approximating to function. Based on it, approximating to NLAR(p) with wavelet neural networks is studied.
文摘This paper investigates the problem of the model validation in identifying discrete-time-nonlinear dynamic systems by using neural networks with a single hidden layer.Based on the estimation theory,a synthetic error-index(SEI)criterion for the neural network models has been developed.By using the powerful training algorithm of recursive prediction error (RPE),two simulated non-linear systems are studied,and the results show that the synthetic error-index criterion can be used to verify the dynamic neural network models.Furthermore,the proposed technique is much simple in calculation than that of the effective correlation tests.Finally,some problems required by further study are discussed.
文摘A new type of nonlinear observer for nonlinear systems is presented. Instead of approximating thc cntire nonlinear system with the neural network (NN), only the un-modeled part left over after the lincarization is approximated. Compared with the conventional linear observer, the observer provides more accurate estimation of the state. The state estimation error is proved to asymptotically approach zero with the Lyapunov method. The simulation result shows that the proposed observer scheme is effective and has a potential application ability in the fault detection and identification (FDI), and the state estimation.
基金supported by the National Natural Science Foundation of China(Grant No.41374118)the Research Fund for the Higher Education Doctoral Program of China(Grant No.20120162110015)+3 种基金the China Postdoctoral Science Foundation(Grant No.2015M580700)the Hunan Provincial Natural Science Foundation,the China(Grant No.2016JJ3086)the Hunan Provincial Science and Technology Program,China(Grant No.2015JC3067)the Scientific Research Fund of Hunan Provincial Education Department,China(Grant No.15B138)
文摘Conventional artificial neural networks used to solve electrical resistivity imaging (ERI) inversion problem suffer from overfitting and local minima. To solve these problems, we propose to use a pruning Bayesian neural network (PBNN) nonlinear inversion method and a sample design method based on the K-medoids clustering algorithm. In the sample design method, the training samples of the neural network are designed according to the prior information provided by the K-medoids clustering results; thus, the training process of the neural network is well guided. The proposed PBNN, based on Bayesian regularization, is used to select the hidden layer structure by assessing the effect of each hidden neuron to the inversion results. Then, the hyperparameter αk, which is based on the generalized mean, is chosen to guide the pruning process according to the prior distribution of the training samples under the small-sample condition. The proposed algorithm is more efficient than other common adaptive regularization methods in geophysics. The inversion of synthetic data and field data suggests that the proposed method suppresses the noise in the neural network training stage and enhances the generalization. The inversion results with the proposed method are better than those of the BPNN, RBFNN, and RRBFNN inversion methods as well as the conventional least squares inversion.
文摘A nonlinear feedback term is introduced into the evaluation equation of weights of the backpropagation algorithm for neural network, the network becomes a chaotic one. For the purpose of that we can investigate how the different feedback terms affect the process of learning and forecasting, we use the model to forecast the nonlinear time series which is produced by Makey-Glass equation. By selecting the suitable feedback term, the system can escape from the local minima and converge to the global minimum or its approximate solutions, and the forecasting results are better than those of backpropagation algorithm.
文摘The cellular neural/nonlinear network (CNN) is a powerful tool for image and video signal processing,robotic and biological visions. This paper discusses a general method for designing template of the global connectivitydetection (GCD) CNN, which provides parameter inequalities for determining parameter intervals for implementing thecorresponding functions. The GCD CNN has stronger ability and faster rate for determining global connectivity in binarypatterns than the GCD CNN proposed by Zarandy. An example for detecting the connectivity in complex patterns isgiven.
文摘Since there were few chaotic neural networks applicable to the global optimization, in this paper, we propose a new neural network model ? chaotic parameters disturbance annealing (CPDA) network, which is superior to other existing neural networks, genetic algorithms, and simulated annealing algorithms in global optimization. In the present CPDA network, we add some chaotic parameters in the energy function, which make the Hopfield neural network escape from the attraction of a local minimal solution and with the parameter annealing, our model will converge to the global optimal solutions quickly and steadily. The converge ability and other characters are also analyzed in this paper. The benchmark examples show the present CPDA neural network's merits in nonlinear global optimization.
基金Supported by National High-tech Research&Development Program of China(863 Project)(No.2014AA06A613)
文摘BP( Back Propagation) neural network and PSO( Particle Swarm Optimization) are two main heuristic optimization methods,and are usually used as nonlinear inversion methods in geophysics. The authors applied BP neural network and BP neural network optimized with PSO into the inversion of 3D density interface respectively,and a comparison was drawn to demonstrate the inversion results. To start with,a synthetic density interface model was created and we used the proceeding inversion methods to test their effectiveness. And then two methods were applied into the inversion of the depth of Moho interface. According to the results,it is clear to find that the application effect of PSO-BP is better than that of BP network. The BP network structures used in both synthetic and field data are consistent in order to obtain preferable inversion results. The applications in synthetic and field tests demonstrate that PSO-BP is a fast and effective method in the inversion of 3D density interface and the optimization effect is evident compared with BP neural network merely,and thus,this method has practical value.
文摘The non-linear relationships between the contents of ginsenoside Rg 1, Rb 1, Rd and Panax notoginseng saponins(PNS) in Panax notoginseng root herb and the near infrared(NIR) diffuse reflectance spectra of the herb were established by means of artificial neural networks(ANNs). Four three-layered perception feed-forward networks were trained with an error back-propagation algorithm. The significant principal components of the NIR spectral data matrix were utilized as the input of the networks. The networks architecture and parameters were selected so as to offer less prediction errors. Relative prediction errors for Rg 1, Rb 1, Rd and PNS obtained with the optimum ANN models were 8.99%, 6.54%, 8.29%, and 5.17%, respectively, which were superior to those obtained with PLSR methods. It is verified that ANN is a suitable approach to model this complex non-linearity. The developed method is fast, non-destructive and accurate and it provides a new efficient approach for determining the active components in the complex system of natural herbs.