As it is well known,it is difficult to identify a nonlinear time varying system using traditional identification approaches,especially under unknown nonlinear function.Neural networks have recently emerged as a succes...As it is well known,it is difficult to identify a nonlinear time varying system using traditional identification approaches,especially under unknown nonlinear function.Neural networks have recently emerged as a successful tool in the area of identification and control of time invariant nonlinear systems.However,it is still difficult to apply them to complicated time varying system identification.In this paper we present a learning algorithm for identification of the nonlinear time varying system using feedforward neural networks.The main idea of this approach is that we regard the weights of the network as a state of a time varying system,then use a Kalman filter to estimate the state.Thus the network implements nonlinear and time varying mapping.We derived both the global and local learning algorithms.Simulation results demonstrate the effectiveness of this approach.展开更多
A new method for identifying nonlinear time varying systems with unknown structure is presented. The method extends the application area of basis sequence identification. The essential idea is to utilize the learning ...A new method for identifying nonlinear time varying systems with unknown structure is presented. The method extends the application area of basis sequence identification. The essential idea is to utilize the learning and nonlinear approximating ability of neural networks to model the non linearity of the system, characterize time varying dynamics of the system by the time varying parametric vector of the network, then the parametric vector of the network is approximated by a weighted sum of known basis sequences. Because of black box modeling ability of neural networks, the presented method can identify nonlinear time varying systems with unknown structure. In order to improve the real time capability of the algorithm, the neural network is trained by a simple fast learning algorithm based on local least squares presented by the authors. The effectiveness and the performance of the method are demonstrated by some simulation results.展开更多
Aim To study the identification and control of nonlinear systems using neural networks. Methods A new type of neural network in which the dynamical error feedback is used to modify the inputs of the network was empl...Aim To study the identification and control of nonlinear systems using neural networks. Methods A new type of neural network in which the dynamical error feedback is used to modify the inputs of the network was employed to reduce the inherent network approximation error. Results A new identification model constructed by the proposed network and stable filters was derived for continuous time nonlinear systems, and a stable adaptive control scheme based on the proposed networks was developed. Conclusion Theory and simulation results show that the modified neural network is feasible to control a class of nonlinear systems.展开更多
Simultaneous perturbation stochastic approximation (SPSA) belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper descri...Simultaneous perturbation stochastic approximation (SPSA) belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper describes an improved SPSA algorithm, which entails fuzzy adaptive gain sequences, gradient smoothing, and a step rejection procedure to enhance convergence and stability. The proposed fuzzy adaptive simultaneous perturbation approximation (FASPA) algorithm is particularly well suited to problems involving a large number of parameters such as those encountered in nonlinear system identification using neural networks (NNs). Accordingly, a multilayer perceptron (MLP) network with popular training algorithms was used to predicate the system response. We found that an MLP trained by FASPSA had the desired accuracy that was comparable to results obtained by traditional system identification algorithms. Simulation results for typical nonlinear systems demonstrate that the proposed NN architecture trained with FASPSA yields improved system identification as measured by reduced time of convergence and a smaller identification error.展开更多
The models of noallnear systems are idendried by recmeive pedctive ermrs(RPE) methed based on thelayered neural networks. To improve the identification precision, gain callcient and arentUm factor are itheucedinto the...The models of noallnear systems are idendried by recmeive pedctive ermrs(RPE) methed based on thelayered neural networks. To improve the identification precision, gain callcient and arentUm factor are itheucedinto the algorithm for the data are dids by noses and vny suddnly. this lerthm is applied to the twcmedeiling of rolling and pitchng angles of ndssiles. Simulation results shoW tha the proposed algurithm is sultable forthe modelling of nodrinear systems.展开更多
The identification problem of Hammerstein model with extension to the multi input multi output (MIMO) case is studied. The proposed identification method uses a hybrid neural network (HNN) which consists of a mult...The identification problem of Hammerstein model with extension to the multi input multi output (MIMO) case is studied. The proposed identification method uses a hybrid neural network (HNN) which consists of a multi layer feed forward neural network (MFNN) in cascade with a linear neural network (LNN). A unified back propagation (BP) algorithm is proposed to estimate the weights and the biases of the MFNN and the LNN simultaneously. Numerical examples are provided to show the efficiency of the proposed method.展开更多
A laser beam is a heat source with a high energy density;this technol-ogy has been rapidly developed and applied in thefield of welding owing to its potential advantages,and supplements traditional welding techniques.A...A laser beam is a heat source with a high energy density;this technol-ogy has been rapidly developed and applied in thefield of welding owing to its potential advantages,and supplements traditional welding techniques.An in-depth analysis of its operating process could establish a good foundation for its application in China.It is widely understood that the welding process is a highly nonlinear and multi-variable coupling process;it comprises a significant number of complex processes with random uncertain factors.Because of their nonlinear mapping and self-learning characteristics,artificial neural networks(ANNs)have certain advantages in comparison to traditional methods in thefield of welding.Laser welding is a nonlinear dynamic process;these processes still pose a major challenge in thefield of control.Therefore,establishing a stable model is a pre-requisite for achieving accurate control.In this study,the identification and con-trol of radial basis function neural networks in laser welding processes and self-tuning PID control methods are proposed to improve weld quality.Using a MATLAB simulation,it is shown that the proposed method can obtain a good description of the level of nonlinear dynamic control,and that the algorithm iden-tification accuracy is high,practical,and effective.Using this method,the weld width quickly reaches the expected value and the system remains stable,with good robustness.Further,it ensures the stability and dynamic performance of the welding process and improves weld quality.展开更多
This paper presents an improved nonlinear system identification scheme using di?erential evolution (DE), neural network (NN) and Levenberg Marquardt algorithm (LM). With a view to achieve better convergence of ...This paper presents an improved nonlinear system identification scheme using di?erential evolution (DE), neural network (NN) and Levenberg Marquardt algorithm (LM). With a view to achieve better convergence of NN weights optimization during the training, the DE and LM are used in a combined framework to train the NN. We present the convergence analysis of the DE and demonstrate the efficacy of the proposed improved system identification algorithm by exploiting the combined DE and LM training of the NN and suitably implementing it together with other system identification methods, namely NN and DE+NN on a number of examples including a practical case study. The identification results obtained through a series of simulation studies of these methods on different nonlinear systems demonstrate that the proposed DE and LM trained NN approach to nonlinear system identification can yield better identification results in terms of time of convergence and less identification error.展开更多
This paper develops a feedforward neural network based input output model for a general unknown nonlinear dynamic system identification when only the inputs and outputs are accessible observations. In the developed m...This paper develops a feedforward neural network based input output model for a general unknown nonlinear dynamic system identification when only the inputs and outputs are accessible observations. In the developed model, the size of the input space is directly related to the system order. By monitoring the identification error characteristic curve, we are able to determine the system order and subsequently an appropriate network structure for systems identification. Simulation results are promising and show that generic nonlinear systems can be identified, different cases of the same system can also be discriminated by our model.展开更多
Industrial noise can be successfully mitigated with the combined use of passive and Active Noise Control (ANC) strategies. In a noisy area, a practical solution for noise attenuation may include both the use of baffle...Industrial noise can be successfully mitigated with the combined use of passive and Active Noise Control (ANC) strategies. In a noisy area, a practical solution for noise attenuation may include both the use of baffles and ANC. When the operator is required to stay in movement in a delimited spatial area, conventional ANC is usually not able to adequately cancel the noise over the whole area. New control strategies need to be devised to achieve acceptable spatial coverage. A three-dimensional actuator model is proposed in this paper. Active Noise Control (ANC) usually requires a feedback noise measurement for the proper response of the loop controller. In some situations, especially where the real-time tridimensional positioning of a feedback transducer is unfeasible, the availability of a 3D precise noise level estimator is indispensable. In our previous works [1,2], using a vibrating signal of the primary source of noise as an input reference for spatial noise level prediction proved to be a very good choice. Another interesting aspect observed in those previous works was the need for a variable-structure linear model, which is equivalent to a sort of a nonlinear model, with unknown analytical equivalence until now. To overcome this in this paper we propose a model structure based on an Artificial Neural Network (ANN) as a nonlinear black-box model to capture the dynamic nonlinear behaveior of the investigated process. This can be used in a future closed loop noise cancelling strategy. We devise an ANN architecture and a corresponding training methodology to cope with the problem, and a MISO (Multi-Input Single-Output) model structure is used in the identification of the system dynamics. A metric is established to compare the obtained results with other works elsewhere. The results show that the obtained model is consistent and it adequately describes the main dynamics of the studied phenomenon, showing that the MISO approach using an ANN is appropriate for the simulation of the investigated process. A clear conclusion is reached highlighting the promising results obtained using this kind of modeling for ANC.展开更多
The prediction methods for nonlinear dynamic systems which are decided by chaotic time series are mainly studied as well as structures of nonlinear self-related chaotic models and their dimensions. By combining neural...The prediction methods for nonlinear dynamic systems which are decided by chaotic time series are mainly studied as well as structures of nonlinear self-related chaotic models and their dimensions. By combining neural networks and wavelet theories, the structures of wavelet transform neural networks were studied and also a wavelet neural networks learning method was given. Based on wavelet networks, a new method for parameter identification was suggested, which can be used selectively to extract different scales of frequency and time in time series in order to realize prediction of tendencies or details of original time series. Through pre-treatment and comparison of results before and after the treatment, several useful conclusions are reached: High accurate identification can be guaranteed by applying wavelet networks to identify parameters of self-related chaotic models and more valid prediction of the chaotic time series including noise can be achieved accordingly.展开更多
Lookup table is widely used in automotive industry for the design of engine control units(ECU).Together with a proportional-integral controller,a feed-forward and feedback control scheme is often adopted for automotiv...Lookup table is widely used in automotive industry for the design of engine control units(ECU).Together with a proportional-integral controller,a feed-forward and feedback control scheme is often adopted for automotive engine management system(EMS).Usually,an ECU has a structure of multi-input and single-output(MISO).Therefore,if there are multiple objectives proposed in EMS,there would be corresponding numbers of ECUs that need to be designed.In this situation,huge efforts and time were spent on calibration.In this work,a multi-input and multi-out(MIMO) approach based on model predictive control(MPC) was presented for the automatic cruise system of automotive engine.The results show that the tracking of engine speed command and the regulation of air/fuel ratio(AFR) can be achieved simultaneously under the new scheme.The mean absolute error(MAE) for engine speed control is 0.037,and the MAE for air fuel ratio is 0.069.展开更多
During the transient process of gas drilling conditions,the monitoring data often has obvious nonlinear fluctuation features,which leads to large classification errors and time delays in the commonly used intelligent ...During the transient process of gas drilling conditions,the monitoring data often has obvious nonlinear fluctuation features,which leads to large classification errors and time delays in the commonly used intelligent classification models.Combined with the structural features of data samples obtained from monitoring while drilling,this paper uses convolution algorithm to extract the correlation features of multiple monitoring while drilling parameters changing with time,and applies RBF network with nonlinear classification ability to classify the features.In the training process,the loss function component based on distance mean square error is used to effectively adjust the best clustering center in RBF.Many field applications show that,the recognition accuracy of the above nonlinear classification network model for gas production,water production and drill sticking is 97.32%,95.25%and 93.78%.Compared with the traditional convolutional neural network(CNN)model,the network structure not only improves the classification accuracy of conditions in the transition stage of conditions,but also greatly advances the time points of risk identification,especially for the three common risk identification points of gas production,water production and drill sticking,which are advanced by 56,16 and 8 s.It has won valuable time for the site to take correct risk disposal measures in time,and fully demonstrated the applicability of nonlinear classification neural network in oil and gas field exploration and development.展开更多
There is still an obstacle to prevent neural network from wider and more effective applications, i.e., the lack of effective theories of models identification. Based on information theory and its generalization, this ...There is still an obstacle to prevent neural network from wider and more effective applications, i.e., the lack of effective theories of models identification. Based on information theory and its generalization, this paper introduces a universal method to achieve nonlinear models identification. Two key quantities, which are called nonlinear irreducible auto-correlation (NIAC) and generalized nonlinear irreducible auto-correlation (GNIAC), are defined and discussed. NIAC and GNIAC correspond with intrinstic irreducible auto-(dependency) (IAD) and generalized irreducible auto-(dependency) (GIAD) of time series respectively. By investigating the evolving trend of NIAC and GNIAC, the optimal auto-regressive order of nonlinear auto-regressive models could be determined naturally. Subsequently, an efficient algorithm computing NIAC and GNIAC is discussed. Experiments on simulating data sets and typical nonlinear prediction models indicate remarkable correlation between optimal auto-regressive order and the highest order that NIAC-GNIAC have a remarkable non-zero value, therefore demonstrate the validity of the proposal in this paper.展开更多
基金National Natural Science Foundation of China!(No.6 97740 33)
文摘As it is well known,it is difficult to identify a nonlinear time varying system using traditional identification approaches,especially under unknown nonlinear function.Neural networks have recently emerged as a successful tool in the area of identification and control of time invariant nonlinear systems.However,it is still difficult to apply them to complicated time varying system identification.In this paper we present a learning algorithm for identification of the nonlinear time varying system using feedforward neural networks.The main idea of this approach is that we regard the weights of the network as a state of a time varying system,then use a Kalman filter to estimate the state.Thus the network implements nonlinear and time varying mapping.We derived both the global and local learning algorithms.Simulation results demonstrate the effectiveness of this approach.
文摘A new method for identifying nonlinear time varying systems with unknown structure is presented. The method extends the application area of basis sequence identification. The essential idea is to utilize the learning and nonlinear approximating ability of neural networks to model the non linearity of the system, characterize time varying dynamics of the system by the time varying parametric vector of the network, then the parametric vector of the network is approximated by a weighted sum of known basis sequences. Because of black box modeling ability of neural networks, the presented method can identify nonlinear time varying systems with unknown structure. In order to improve the real time capability of the algorithm, the neural network is trained by a simple fast learning algorithm based on local least squares presented by the authors. The effectiveness and the performance of the method are demonstrated by some simulation results.
文摘Aim To study the identification and control of nonlinear systems using neural networks. Methods A new type of neural network in which the dynamical error feedback is used to modify the inputs of the network was employed to reduce the inherent network approximation error. Results A new identification model constructed by the proposed network and stable filters was derived for continuous time nonlinear systems, and a stable adaptive control scheme based on the proposed networks was developed. Conclusion Theory and simulation results show that the modified neural network is feasible to control a class of nonlinear systems.
文摘Simultaneous perturbation stochastic approximation (SPSA) belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper describes an improved SPSA algorithm, which entails fuzzy adaptive gain sequences, gradient smoothing, and a step rejection procedure to enhance convergence and stability. The proposed fuzzy adaptive simultaneous perturbation approximation (FASPA) algorithm is particularly well suited to problems involving a large number of parameters such as those encountered in nonlinear system identification using neural networks (NNs). Accordingly, a multilayer perceptron (MLP) network with popular training algorithms was used to predicate the system response. We found that an MLP trained by FASPSA had the desired accuracy that was comparable to results obtained by traditional system identification algorithms. Simulation results for typical nonlinear systems demonstrate that the proposed NN architecture trained with FASPSA yields improved system identification as measured by reduced time of convergence and a smaller identification error.
文摘The models of noallnear systems are idendried by recmeive pedctive ermrs(RPE) methed based on thelayered neural networks. To improve the identification precision, gain callcient and arentUm factor are itheucedinto the algorithm for the data are dids by noses and vny suddnly. this lerthm is applied to the twcmedeiling of rolling and pitchng angles of ndssiles. Simulation results shoW tha the proposed algurithm is sultable forthe modelling of nodrinear systems.
文摘The identification problem of Hammerstein model with extension to the multi input multi output (MIMO) case is studied. The proposed identification method uses a hybrid neural network (HNN) which consists of a multi layer feed forward neural network (MFNN) in cascade with a linear neural network (LNN). A unified back propagation (BP) algorithm is proposed to estimate the weights and the biases of the MFNN and the LNN simultaneously. Numerical examples are provided to show the efficiency of the proposed method.
基金This work was supported by the Youth Backbone Teacher’s training program for Henan colleges and universities under Grant No.2016ggjs-287the Science and Technology Project of Henan province,under Grant Nos.172102210124 and 202102210269the Key Scientific Research Projects in Colleges and Universities in Henan,Grant No.18B460003.
文摘A laser beam is a heat source with a high energy density;this technol-ogy has been rapidly developed and applied in thefield of welding owing to its potential advantages,and supplements traditional welding techniques.An in-depth analysis of its operating process could establish a good foundation for its application in China.It is widely understood that the welding process is a highly nonlinear and multi-variable coupling process;it comprises a significant number of complex processes with random uncertain factors.Because of their nonlinear mapping and self-learning characteristics,artificial neural networks(ANNs)have certain advantages in comparison to traditional methods in thefield of welding.Laser welding is a nonlinear dynamic process;these processes still pose a major challenge in thefield of control.Therefore,establishing a stable model is a pre-requisite for achieving accurate control.In this study,the identification and con-trol of radial basis function neural networks in laser welding processes and self-tuning PID control methods are proposed to improve weld quality.Using a MATLAB simulation,it is shown that the proposed method can obtain a good description of the level of nonlinear dynamic control,and that the algorithm iden-tification accuracy is high,practical,and effective.Using this method,the weld width quickly reaches the expected value and the system remains stable,with good robustness.Further,it ensures the stability and dynamic performance of the welding process and improves weld quality.
文摘This paper presents an improved nonlinear system identification scheme using di?erential evolution (DE), neural network (NN) and Levenberg Marquardt algorithm (LM). With a view to achieve better convergence of NN weights optimization during the training, the DE and LM are used in a combined framework to train the NN. We present the convergence analysis of the DE and demonstrate the efficacy of the proposed improved system identification algorithm by exploiting the combined DE and LM training of the NN and suitably implementing it together with other system identification methods, namely NN and DE+NN on a number of examples including a practical case study. The identification results obtained through a series of simulation studies of these methods on different nonlinear systems demonstrate that the proposed DE and LM trained NN approach to nonlinear system identification can yield better identification results in terms of time of convergence and less identification error.
文摘This paper develops a feedforward neural network based input output model for a general unknown nonlinear dynamic system identification when only the inputs and outputs are accessible observations. In the developed model, the size of the input space is directly related to the system order. By monitoring the identification error characteristic curve, we are able to determine the system order and subsequently an appropriate network structure for systems identification. Simulation results are promising and show that generic nonlinear systems can be identified, different cases of the same system can also be discriminated by our model.
基金CAPES and CNPq(Brazilian federal research agencies)for their financial support.
文摘Industrial noise can be successfully mitigated with the combined use of passive and Active Noise Control (ANC) strategies. In a noisy area, a practical solution for noise attenuation may include both the use of baffles and ANC. When the operator is required to stay in movement in a delimited spatial area, conventional ANC is usually not able to adequately cancel the noise over the whole area. New control strategies need to be devised to achieve acceptable spatial coverage. A three-dimensional actuator model is proposed in this paper. Active Noise Control (ANC) usually requires a feedback noise measurement for the proper response of the loop controller. In some situations, especially where the real-time tridimensional positioning of a feedback transducer is unfeasible, the availability of a 3D precise noise level estimator is indispensable. In our previous works [1,2], using a vibrating signal of the primary source of noise as an input reference for spatial noise level prediction proved to be a very good choice. Another interesting aspect observed in those previous works was the need for a variable-structure linear model, which is equivalent to a sort of a nonlinear model, with unknown analytical equivalence until now. To overcome this in this paper we propose a model structure based on an Artificial Neural Network (ANN) as a nonlinear black-box model to capture the dynamic nonlinear behaveior of the investigated process. This can be used in a future closed loop noise cancelling strategy. We devise an ANN architecture and a corresponding training methodology to cope with the problem, and a MISO (Multi-Input Single-Output) model structure is used in the identification of the system dynamics. A metric is established to compare the obtained results with other works elsewhere. The results show that the obtained model is consistent and it adequately describes the main dynamics of the studied phenomenon, showing that the MISO approach using an ANN is appropriate for the simulation of the investigated process. A clear conclusion is reached highlighting the promising results obtained using this kind of modeling for ANC.
文摘The prediction methods for nonlinear dynamic systems which are decided by chaotic time series are mainly studied as well as structures of nonlinear self-related chaotic models and their dimensions. By combining neural networks and wavelet theories, the structures of wavelet transform neural networks were studied and also a wavelet neural networks learning method was given. Based on wavelet networks, a new method for parameter identification was suggested, which can be used selectively to extract different scales of frequency and time in time series in order to realize prediction of tendencies or details of original time series. Through pre-treatment and comparison of results before and after the treatment, several useful conclusions are reached: High accurate identification can be guaranteed by applying wavelet networks to identify parameters of self-related chaotic models and more valid prediction of the chaotic time series including noise can be achieved accordingly.
基金Project supported by the Centre for Smart Grid and Information Convergence(CeSGIC)at Xi’an Jiaotong-Liverpool University,China
文摘Lookup table is widely used in automotive industry for the design of engine control units(ECU).Together with a proportional-integral controller,a feed-forward and feedback control scheme is often adopted for automotive engine management system(EMS).Usually,an ECU has a structure of multi-input and single-output(MISO).Therefore,if there are multiple objectives proposed in EMS,there would be corresponding numbers of ECUs that need to be designed.In this situation,huge efforts and time were spent on calibration.In this work,a multi-input and multi-out(MIMO) approach based on model predictive control(MPC) was presented for the automatic cruise system of automotive engine.The results show that the tracking of engine speed command and the regulation of air/fuel ratio(AFR) can be achieved simultaneously under the new scheme.The mean absolute error(MAE) for engine speed control is 0.037,and the MAE for air fuel ratio is 0.069.
基金supported by the National Key R&D Program of China(2019YFA0708303)the Sichuan Science and Technology Program(2021YFG0318)+2 种基金the Engineering Technology Joint Research Institute Project of CCDC-SWPU(CQXN-2021-03)the PetroChina Innovation Foundation(2020D-5007-0312)the Key projects of NSFC(61731016).
文摘During the transient process of gas drilling conditions,the monitoring data often has obvious nonlinear fluctuation features,which leads to large classification errors and time delays in the commonly used intelligent classification models.Combined with the structural features of data samples obtained from monitoring while drilling,this paper uses convolution algorithm to extract the correlation features of multiple monitoring while drilling parameters changing with time,and applies RBF network with nonlinear classification ability to classify the features.In the training process,the loss function component based on distance mean square error is used to effectively adjust the best clustering center in RBF.Many field applications show that,the recognition accuracy of the above nonlinear classification network model for gas production,water production and drill sticking is 97.32%,95.25%and 93.78%.Compared with the traditional convolutional neural network(CNN)model,the network structure not only improves the classification accuracy of conditions in the transition stage of conditions,but also greatly advances the time points of risk identification,especially for the three common risk identification points of gas production,water production and drill sticking,which are advanced by 56,16 and 8 s.It has won valuable time for the site to take correct risk disposal measures in time,and fully demonstrated the applicability of nonlinear classification neural network in oil and gas field exploration and development.
文摘There is still an obstacle to prevent neural network from wider and more effective applications, i.e., the lack of effective theories of models identification. Based on information theory and its generalization, this paper introduces a universal method to achieve nonlinear models identification. Two key quantities, which are called nonlinear irreducible auto-correlation (NIAC) and generalized nonlinear irreducible auto-correlation (GNIAC), are defined and discussed. NIAC and GNIAC correspond with intrinstic irreducible auto-(dependency) (IAD) and generalized irreducible auto-(dependency) (GIAD) of time series respectively. By investigating the evolving trend of NIAC and GNIAC, the optimal auto-regressive order of nonlinear auto-regressive models could be determined naturally. Subsequently, an efficient algorithm computing NIAC and GNIAC is discussed. Experiments on simulating data sets and typical nonlinear prediction models indicate remarkable correlation between optimal auto-regressive order and the highest order that NIAC-GNIAC have a remarkable non-zero value, therefore demonstrate the validity of the proposal in this paper.