The Role and Place of Artificial Neural Network Architectures Structural Redundancy in the Input Data Prototypes and Generalization Development

Neural Networks (NN) are the functional unit of Deep Learning and are known to mimic the behavior of the human brain to solve complex data-driven problems. Whenever we train our own neural networks, we need to take care of something called the generalization of the neural network. The performance of Artificial Neural Networks (ANN) mostly depends upon its generalization capability. In this paper, we propose an innovative approach to enhance the generalization capability of artificial neural networks (ANN) using structural redundancy. A novel perspective on handling input data prototypes and their impact on the development of generalization, which could improve to ANN architectures accuracy and reliability is described.

Adaptive output feedback control for nonlinear time-delay systems using neural network

This paper extends the adaptive neural network （NN） control approaches to a class of unknown output feedback nonlinear time-delay systems. An adaptive output feedback NN tracking controller is designed by backstepping technique. NNs are used to approximate unknown functions dependent on time delay, Delay-dependent filters are introduced for state estimation. The domination method is used to deal with the smooth time-delay basis functions. The adaptive bounding technique is employed to estimate the upper bound of the NN approximation errors. Based on Lyapunov- Krasovskii functional, the semi-global uniform ultimate boundedness of all the signals in the closed-loop system is proved, The feasibility is investigated by two illustrative simulation examples.

Nonlinear Dynamics and Stability of Neural Networks with Delay-Time

In this paper we study the dynamic properties and stabilities of neural networks with delay-time (which includes the time-varying case) by differential inequalities and Lyapunov function approaches. The criteria of connective stability, robust stability, Lyapunov stability, asymptotic atability, exponential stability and Lagrange stability of neural networks with delay-time are established, and the results obtained are very useful for the design, implementation and application of adaptive learning neural networks.

The adaptive control using BP neural networks for a nonlinear servo-motor

The servo-motor possesses a strongly nonlinear property due to the effect of the stimulating input voltage, load-torque and environmental operating conditions. So it is rather difficult to derive a traditional mathematical model which is capable of expressing both its dynamics and steady-state characteristics. A neural network-based adaptive control strategy is proposed in this paper. In this method, two neural networks have been adopted for system identification （NNI） and control （NNC）, respectively. Then, the commonly-used specialized learning has been modified, by taking the NNI output as the approximation output of the servo-motor during the weights training to get sensitivity information. Moreover, the rule for choosing the learning rate is given on the basis of the analysis of Lyapunov stability. Finally, an example of applying the proposed control strategy on a servo-motor is presented to show its effectiveness.

Neural network based adaptive sliding mode control of uncertain nonlinear systems

The purpose of this paper is the design of neural network-based adaptive sliding mode controller for uncertain unknown nonlinear systems. A special architecture adaptive neural network, with hyperbolic tangent activation functions, is used to emulate the equivalent and switching control terms of the classic sliding mode control （SMC）. Lyapunov stability theory is used to guarantee a uniform ultimate boundedness property for the tracking error, as well as of all other signals in the closed loop. In addition to keeping the stability and robustness properties of the SMC, the neural network-based adaptive sliding mode controller exhibits perfect rejection of faults arising during the system operating. Simulation studies are used to illustrate and clarify the theoretical results.

Wavelet neural network based fault diagnosis in nonlinear analog circuits

The theories of diagnosing nonlinear analog circuits by means of the transient response testing are studied. Wavelet analysis is made to extract the transient response signature of nonlinear circuits and compress the signature dada. The best wavelet function is selected based on the between-category total scatter of signature. The fault dictionary of nonlinear circuits is constructed based on improved back-propagation(BP) neural network. Experimental results demonstrate that the method proposed has high diagnostic sensitivity and fast fault identification and deducibility.

Nonlinear Decoupling PID Control Using Neural Networks and Multiple Models

For a class of complex industrial processes with strong nonlinearity, serious coupling and uncertainty, a nonlinear decoupling proportional-integral-differential （PID） controller is proposed, which consists of a traditional PID controller, a decoupling compensator and a feedforward compensator for the unmodeled dynamics. The parameters of such controller is selected based on the generalized minimum variance control law. The unmodeled dynamics is estimated and compensated by neural networks, a switching mechanism is introduced to improve tracking performance, then a nonlinear decoupling PID control algorithm is proposed. All signals in such switching system are globally bounded and the tracking error is convergent. Simulations show effectiveness of the algorithm.

Model algorithm control using neural networks for input delayed nonlinear control system

The performance of the model algorithm control method is partially based on the accuracy of the system＇s model. It is difficult to obtain a good model of a nonlinear system, especially when the nonlinearity is high. Neural networks have the ability to ＂learn＂the characteristics of a system through nonlinear mapping to represent nonlinear functions as well as their inverse functions. This paper presents a model algorithm control method using neural networks for nonlinear time delay systems. Two neural networks are used in the control scheme. One neural network is trained as the model of the nonlinear time delay system, and the other one produces the control inputs. The neural networks are combined with the model algorithm control method to control the nonlinear time delay systems. Three examples are used to illustrate the proposed control method. The simulation results show that the proposed control method has a good control performance for nonlinear time delay systems.

Adaptive RBF neural network control of robot with actuator nonlinearities

In this paper, an adaptive neural network control scheme for robot manipulators with actuator nonlinearities is presented. The control scheme consists of an adaptive neural network controller and an actuator nonlinearities compensator. Since the actuator nonlinearities are usually included in the robot driving motor, a compensator using radial basis function (RBF) network is proposed to estimate the actuator nonlinearities and eliminate their effects. Subsequently, an adaptive neural network controller that neither requires the evaluation of inverse dynamical model nor the time-consuming training process is given. In addition, GL matrix and its product operator are introduced to help prove the stability of the closed control system. Considering the adaptive neural network controller and the RBF network compensator as the whole control scheme, the closed-loop system is proved to be uniformly ultimately bounded (UUB). The whole scheme provides a general procedure to control the robot manipulators with actuator nonlinearities. Simulation results verify the effectiveness of the designed scheme and the theoretical discussion.

Adaptive neural network tracking control for a class of unknown nonlinear time-delay systems

For a class of unknown nonlinear time-delay systems, an adaptive neural network （NN） control design approach is proposed. Backstepping, domination and adaptive bounding design technique are combined to construct a robust memoryless adaptive NN tracking controller. Unknown time-delay functions are approximated by NNs, such that the requirement on the nonlinear time-delay functions is relaxed. Based on Lyapunov-Krasoviskii functional, the sem-global uniformly ultimately boundedness （UUB） of all the signals in the closed-loop system is proved. The arbitrary output tracking accuracy is achieved by tuning the design parameters. The feasibility is investigated by an illustrative simulation example.

Adaptive Neural Network-Based Control for a Class of Nonlinear Pure-Feedback Systems With Time-Varying Full State Constraints

In this paper, an adaptive neural network(NN)control approach is proposed for nonlinear pure-feedback systems with time-varying full state constraints. The pure-feedback systems of this paper are assumed to possess nonlinear function uncertainties. By using the mean value theorem, pure-feedback systems can be transformed into strict feedback forms. For the newly generated systems, NNs are employed to approximate unknown items. Based on the adaptive control scheme and backstepping algorithm, an intelligent controller is designed. At the same time, time-varying Barrier Lyapunov functions(BLFs)with error variables are adopted to avoid violating full state constraints in every step of the backstepping design. All closedloop signals are uniformly ultimately bounded and the output tracking error converges to the neighborhood of zero, which can be verified by using the Lyapunov stability theorem. Two simulation examples reveal the performance of the adaptive NN control approach.

Adaptive Neural Network Dynamic Surface Control for Perturbed Nonlinear Time-delay Systems

This paper proposes an adaptive neural network control method for a class of perturbed strict-feedback nonlinear systems with unknown time delays. Radial basis function neural networks are used to approximate unknown intermediate control signals. By constructing appropriate Lyapunov-Krasovskii functionals, the unknown time delay terms have been compensated. Dynamic surface control technique is used to overcome the problem of ＂explosion of complexity＂ in backstepping design procedure. In addition, the semiglobal uniform ultimate boundedness of all the signals in the closed-loop system is proved. A main advantage of the proposed controller is that both problems of ＂curse of dimensionality＂ and ＂explosion of complexity＂ are avoided simultaneously. Finally, simulation results are presented to demonstrate the effectiveness of the approach.

Design of performance robustness for uncertain nonlinear time-delay systems via neural network

Performance robustness problems via the state feedback controller are investigated for a class of uncertain nonlinear systems with time-delay in both state and control, in which the neural networks are used to model the nonlinearities. By using an appropriate uncertainty description and the linear difference inclusion technique, sufficient conditions for existence of such controller are derived based on the linear matrix inequalities （LMIs）. Using solutions of LMIs, a state feedback control law is proposed to stabilize the perturbed system and guarantee an upper bound of system performance, which is applicable to arbitrary time-delays.

Fault-Tolerant Control of Nonlinear Systems Based on Fuzzy Neural Networks

Due to its great potential value in theory and application,fault-tolerant control strategies of nonlinear systems,especially combining with intelligent control methods,have been a focus in the academe.A fault-tolerant control method based on fuzzy neural networks was presented for nonlinear systems in this paper.The fault parameters were designed to detect the fault,adaptive updating method was introduced to estimate and track fault,and fuzzy neural networks were used to adjust the fault parameters and construct automated fault diagnosis.And the fault compensation control force,which was given by fault estimation,was used to realize adaptive fault-tolerant control.This framework leaded to a simple structure,an accurate detection,and a high robustness.The simulation results in induction motor show that it is still able to work well with high dynamic performance and control precision under the condition of motor parameters' variation fault and load torque disturbance.

Synchronization of a Class of Delayed Neural Networks with Sector Nonlinearity

在这份报纸，全球同步与变化时间、分布式的延期为推迟的神经网络的一个一般的班被讨论。而且，在神经网络的激活函数能是不同类型。基于开车反应概念和 Lyapunov 稳定性定理，甚至当物理限制引起的输入扇区非线性在反应系统被介绍时，一些足够的标准被获得保证考虑模型的全球同步。最后，一个典型例子也被给说明建议同步计划的有效性。

Nonlinear Time Series Prediction Using Chaotic Neural Networks

A nonlinear feedback term is introduced into the evaluation equation of weights of the backpropagation algorithm for neural network, the network becomes a chaotic one. For the purpose of that we can investigate how the different feedback terms affect the process of learning and forecasting, we use the model to forecast the nonlinear time series which is produced by Makey-Glass equation. By selecting the suitable feedback term, the system can escape from the local minima and converge to the global minimum or its approximate solutions, and the forecasting results are better than those of backpropagation algorithm.

Neural Network Based Adaptive Tracking Control for a Class of Pure Feedback Nonlinear Systems With Input Saturation

In this paper, an adaptive neural networks(NNs)tracking controller is proposed for a class of single-input/singleoutput(SISO) non-affine pure-feedback non-linear systems with input saturation. In the proposed approach, the original input saturated nonlinear system is augmented by a low pass filter.Then, new system states are introduced to implement states transformation of the augmented model. The resulting new model in affine Brunovsky form permits direct and simpler controller design by avoiding back-stepping technique and its complexity growing as done in existing methods in the literature.In controller design of the proposed approach, a state observer,based on the strictly positive real(SPR) theory, is introduced and designed to estimate the new system states, and only two neural networks are used to approximate the uncertain nonlinearities and compensate for the saturation nonlinearity of actuator. The proposed approach can not only provide a simple and effective way for construction of the controller in adaptive neural networks control of non-affine systems with input saturation, but also guarantee the tracking performance and the boundedness of all the signals in the closed-loop system. The stability of the control system is investigated by using the Lyapunov theory. Simulation examples are presented to show the effectiveness of the proposed controller.

A Fuzzy-Neural Network Control of Nonlinear Dynamic Systems

In this paper, an adaptive dynamic control scheme based on a fuzzy neural network is presented, that presents utilizes both feed-forward and feedback controller elements. The former of the two elements comprises a neural network with both identification and control role, and the latter is a fuzzy neural algorithm, which is introduced to provide additional control enhancement. The feedforward controller provides only coarse control, whereas the feedback controller can generate on-line conditional proposition rule automatically to improve the overall control action. These properties make the design very versatile and applicable to a range of industrial applications.

Adaptive Output-feedback Regulation for Nonlinear Delayed Systems Using Neural Network

A novel adaptive neural network （NN） output-feedback regulation algorithm for a class of nonlinear time-varying timedelay systems is proposed. Both the designed observer and controller are independent of time delay. Different from the existing results, where the upper bounding functions of time-delay terms are assumed to be known, we only use an NN to compensate for all unknown upper bounding functions without that assumption. The proposed design method is proved to be able to guarantee semi-global uniform ultimate boundedness of all the signals in the closed system, and the system output is proved to converge to a small neighborhood of the origin. The simulation results verify the effectiveness of the control scheme.