Predicting Model for Complex Production Process Based on Dynamic Neural Network

Based on the comparison of several methods of time series predicting, this paper points out that it is necessary to use dynamic neural network in modeling of complex production process. Because self feedback and mutual feedback are adopted among nodes at the same layer in Elman network, it has stronger ability of dynamic approximation, and can describe any non linear dynamic system. After the structure and mathematical description being given, dynamic back propagation (BP) algorithm of training weights of Elman neural network is deduced. At last, the network is used to predict ash content of black amber in jigging production process. The results show that this neural network is powerful in predicting and suitable for modeling, predicting, and controling of complex production process.

L_2-L_∞ learning of dynamic neural networks

This paper proposes an y2-y∞ learning law as a new learning method for dynamic neural networks with external disturbance. Based on linear matrix inequality （LMI） formulation, the y2-y∞ learning law is presented to not only guarantee asymptotical stability of dynamic neural networks but also reduce the effect of external disturbance to an y2-y∞ induced norm constraint. It is shown that the design of the y2-y∞ learning law for such neural networks can be achieved by solving LMIs, which can be easily facilitated by using some standard numerical packages. A numerical example is presented to demonstrate the validity of the proposed learning law.

Study on Ecological Change Remote Sensing Monitoring Method Based on Elman Dynamic Recurrent Neural Network

In this paper, Hailin City of Heilongjiang Province, China is taken as the research area. As an important city in Heilongjiang Province, China, the sustainable development of its ecological environment is related to the opening up, economic prosperity and social stability of Northeast China. In this paper, the remote sensing ecological index (RSEI) of Hailin City in recent 20 years was calculated by using Landsat 5/8/9 series satellite images, and the temporal and spatial changes of the ecological environment in Hailin City were further analyzed and the influencing factors were discussed. From 2003 to 2023, the mean value of RSEI in Hailin City decreased and increased, and the ecological environment decreased slightly as a whole. RSEI declined most significantly from 2003 to 2008, and it increased from 2008 to 2013, decreased from 2013 to 2018, and increased from 2018 to 2023 again, with higher RSEI value in the south and lower RSEI value in the northwest. It is suggested to appropriately increase vegetation coverage in the northwest to improve ecological quality. As a result, the predicted value of Elman dynamic recurrent neural network model is consistent with the change trend of the mean value, and the prediction error converges quickly, which can accurately predict the ecological environment quality in the future study area.

DyPipe: A Holistic Approach to Accelerating Dynamic Neural Networks with Dynamic Pipelining

Dynamic neural network(NN)techniques are increasingly important because they facilitate deep learning techniques with more complex network architectures.However,existing studies,which predominantly optimize the static computational graphs by static scheduling methods,usually focus on optimizing static neural networks in deep neural network(DNN)accelerators.We analyze the execution process of dynamic neural networks and observe that dynamic features introduce challenges for efficient scheduling and pipelining in existing DNN accelerators.We propose DyPipe,a holistic approach to optimizing dynamic neural network inferences in enhanced DNN accelerators.DyPipe achieves significant performance improvements for dynamic neural networks while it introduces negligible overhead for static neural networks.Our evaluation demonstrates that DyPipe achieves 1.7x speedup on dynamic neural networks and maintains more than 96%performance for static neural networks.

Recursive recurrent neural network:A novel model for manipulator control with different levels of physical constraints

Manipulators actuate joints to let end effectors to perform precise path tracking tasks.Recurrent neural network which is described by dynamic models with parallel processing capability,is a powerful tool for kinematic control of manipulators.Due to physical limitations and actuation saturation of manipulator joints,the involvement of joint constraints for kinematic control of manipulators is essential and critical.However,current existing manipulator control methods based on recurrent neural networks mainly handle with limited levels of joint angular constraints,and to the best of our knowledge,methods for kinematic control of manipulators with higher order joint constraints based on recurrent neural networks are not yet reported.In this study,for the first time,a novel recursive recurrent network model is proposed to solve the kinematic control issue for manipulators with different levels of physical constraints,and the proposed recursive recurrent neural network can be formulated as a new manifold system to ensure control solution within all of the joint constraints in different orders.The theoretical analysis shows the stability and the purposed recursive recurrent neural network and its convergence to solution.Simulation results further demonstrate the effectiveness of the proposed method in end‐effector path tracking control under different levels of joint constraints based on the Kuka manipulator system.Comparisons with other methods such as the pseudoinverse‐based method and conventional recurrent neural network method substantiate the superiority of the proposed method.

Hybrid Dynamic Neural Network and PID Control of Pneumatic Artificial Muscle Using the PSO Algorithm

Pneumatic artificial muscles(PAM)have been recently considered as a prominent challenge regarding pneumatic actuators specifically for rehabilitation and medical applications.Since accomplishing accurate control of the PAM is comparatively complicated due to time-varying behavior,elasticity and ambiguous characteristics,a high performance and efficient control approach should be adopted.Besides of the mentioned challenges,limited course length is another predicament with the PAM control.In this regard,this paper proposes a new hybrid dynamic neural network(DNN)and proportional integral derivative(PID)controller for the position of the PAM.In order to enhance the proficiency of the controller,the problem under study is designed in the form of an optimization trend.Considering the potential of particle swarm optimization,it has been applied to optimally tune the PID-DNN parameters.To verify the performance of the proposed controller,it has been implemented on a real-time system and compared to a conventional sliding mode controller.Simulation and experimental results show the effectiveness of the proposed controller in tracking the reference signals in the entire course of the PAM.

Dynamic Back-Propagation Neural Net for Adaptive Controller

A kind of single-input single-output neural net adaptive controller (SISO-NNC) and its algorithm have been presented. For the computer simulation and the special requirements of control problem, we have improved traditional BP algorithm and solved the problem of local minimum to some extent. Using the SISO-NNC to control time-varying system, the simulation results show advantages of neural net controller in control field.

Hybrid dynamic model of polymer electrolyte membrane fuel cell stack using variable neural network

The polymer electrolyte membrane（PEM） fuel cell has been regarded as a potential alternative power source,and a model is necessary for its design,control and power management.A hybrid dynamic model of PEM fuel cell,which combines the advantages of mechanism model and black-box model,is proposed in this paper.To improve the performance,the static neural network and variable neural network are used to build the black-box model.The static neural network can significantly improve the static performance of the hybrid model,and the variable neural network makes the hybrid dynamic model predict the real PEM fuel cell behavior with required accuracy.Finally,the hybrid dynamic model is validated with a 500 W PEM fuel cell.The static and transient experiment results show that the hybrid dynamic model can predict the behavior of the fuel cell stack accurately and therefore can be effectively utilized in practical application.

Design and performance analysis of tracking controller for uncertain nonlinear composite system using neural networks

Based on high order dynamic neural network, this paper presents the tracking problem for uncertain nonlinear composite system, which contains external disturbance, whose nonlinearities are assumed to be unknown. A smooth controller is designed to guarantee a uniform ultimate boundedness property for the tracking error and all other signals in the dosed loop. Certain measures are utilized to test its performance. No a priori knowledge of an upper bound on the “optimal” weight and modeling error is required; the weights of neural networks are updated on-line. Numerical simulations performed on a simple example illustrate and clarify the approach.

A dynamical neural network approach for distributionally robust chance-constrained Markov decision process

In this paper,we study the distributionally robust joint chance-constrained Markov decision process.Utilizing the logarithmic transformation technique,we derive its deterministic reformulation with bi-convex terms under the moment-based uncertainty set.To cope with the non-convexity and improve the robustness of the solution,we propose a dynamical neural network approach to solve the reformulated optimization problem.Numerical results on a machine replacement problem demonstrate the efficiency of the proposed dynamical neural network approach when compared with the sequential convex approximation approach.

Neural Dynamics for Distributed Collaborative Control of Manipulators With Time Delays

Time-delay phenomena extensively exist in practical systems,e.g.,multi-agent systems,bringing negative impacts on their stabilities.This work analyzes a collaborative control problem of redundant manipulators with time delays and proposes a time-delayed and distributed neural dynamics scheme.Under assumptions that the network topology is fixed and connected and the existing maximal time delay is no more than a threshold value,it is proved that all manipulators in the distributed network are able to reach a desired motion.The proposed distributed scheme with time delays considered is converted into a time-variant optimization problem,and a neural dynamics solver is designed to solve it online.Then,the proposed neural dynamics solver is proved to be stable,convergent and robust.Additionally,the allowable threshold value of time delay that ensures the proposed scheme’s stability is calculated.Illustrative examples and comparisons are provided to intuitively prove the validity of the proposed neural dynamics scheme and solver.

Frequency Switches at Transition Temperature in Voltage-Gated Ion Channel Dynamics of Neural Oscillators

Understanding of the mechanisms of neural phase transitions is crucial for clarifying cognitive processes in the brain. We investigate a neural oscillator that undergoes different bifurcation transitions from the big saddle homoclinic orbit type to the saddle node on an invariant circle type, and the saddle node on an invariant circle type to the small saddle homoclinic orbit type. The bifurcation transitions are accompanied by an increase in thermodynamic temperature that affects the voltage-gated ion channel in the neural oscillator. We show that nonlinear and thermodynamical mechanisms are responsible for different switches of the frequency in the neural oscillator. We report a dynamical role of the phase response curve in switches of the frequency, in terms of slopes of frequency-temperature curve at each bifurcation transition. Adopting the transition state theory of voltagegated ion channel dynamics, we confirm that switches of the frequency occur in the first-order phase transition temperature states and exhibit different features of their potential energy derivatives in the ion channel. Each bifurcation transition also creates a discontinuity in the Arrhenius plot used to compute the time constant of the ion channel.

Regulation of neural stem cell fate decisions by mitochondrial dynamics

Stem cells possess the ability to divide symmetrically or asymmet- rically to allow for maintenance of the stem cell pool or become committed progenitors and differentiate into various cell lineages. The unique self-renewal capabilities and pluripotency of stem cells are integral to tissue regeneration and repair （Oh et al., 2014）. Mul- tiple mechanisms including intracellular programs and extrinsic cues are reported to regulate neural stem cell （NSC） fate （Bond et al., 2015）. A recent study, published in Cell Stern Cell, identified a novel mechanism whereby mitochondrial dynamics drive NSC fate （Khacho et al., 2016）.

Adaptive Kalman filter and dynamic recurrent neural networks-based control design of macro-micro manipulator

In this paper, a composite control scheme for macro-micro dual-drive positioning stage with high accel- eration and high precision is proposed. The objective of control is to improve the precision by reducing the influence of system vibration and external noise. The positioning stage is composed of voice coil motor （VCM） as macro driver and piezoelectric actuator （PEA） as micro driver. The precision of the macro drive positioning stage is improved by the com- bined PID control with adaptive Kalman filter （AKF）. AKF is used to compensate VCM vibration （as the virtual noise） and the external noise. The control scheme of the micro drive positioning stage is presented as the integrated one with PID and intelligent adaptive inverse control approach to compensate the positioning error caused by macro drive positioning stage. A dynamic recurrent neural networks （DRNN） based inverse control approach is proposed to offset the hysteresis nonlinearity of PEA. Simulations show the positioning precision of macro-micro dual-drive stage is clearly improved via the proposed control scheme.

Online Learning Control for Hybrid Electric Vehicle

Improvements in hybrid electric vehicle (HEV) fuel economy and emissions heavily depend on an efficient energy management strategy (EMS). However, the uncertainty of future driving conditions generally cannot be easily tackled in EMS design. Most existing EMSs act upon fixed parameters and cannot adapt to varying driving conditions. Therefore, they usually fail to fully explore the potential of these advanced vehicles. In this paper, a novel EMS design procedure based on neural dynamic programming (NDP) is proposed. The NDP is a generic online learning algorithm, which combines stochastic dynamic programming (SDP) and the temporal difference (TD) method. Instead of computing the utility function and optimal control actions through Bellman equations, the NDP algorithm uses two neural networks to approximate them. The weights of these neural networks are updated online by the TD method. It avoids the high computational cost that SDP suffers from and is suitable for real-time implementation. The main advantages of NDP EMS is that it does not rely on prior information related to future driving conditions, and can self-tune with a wide variance in operating conditions. The NDP EMS has been applied to “Qianghua-I”, a prototype of a parallel HEV, using a revolving drum test bench for verification. Experiment results illustrate the potential of the proposed EMS in terms of fuel economy and in keeping state of charge (SOC) deviations at a low level. The proposed research ensures the optimality of NDP EMS, as well as real-time applicability.

Control strategy for an intelligent shearer height adjusting system

An intelligent shearer height adjusting system is a key technology for mining at a man-less working face. A control strategy for a shearer height adjusting system based on a mathematical model of the height adjusting mechanism is proposed. It considers the non-linearity and time variations in the control process and uses Dynamic Fuzzy Neural Networks （D-FNN）. The inverse characteristics of the system are studied. An adaptive on-line learning and error compensation mechanism guarantees sys- tem real-time performance and reliability. Parameters from a German Eickhoff SL500 shearer were used with Maflab/Simulink to simulate a height adjusting control system. Simulation shows that the trace error of a D-FNN controller is smaller than that of a PID controller. Also, the D-FNN control scheme has good generalization and tracking performance, which allow it to satisfy the needs of a shearer height adjusting system.

Vision-based Stabilization of Nonholonomic Mobile Robots by Integrating Sliding-mode Control and Adaptive Approach

Vision-based pose stabilization of nonholonomic mobile robots has received extensive attention. At present, most of the solutions of the problem do not take the robot dynamics into account in the controller design, so that these controllers are difficult to realize satisfactory control in practical application. Besides, many of the approaches suffer from the initial speed and torque jump which are not practical in the real world. Considering the kinematics and dynamics, a two-stage visual controller for solving the stabilization problem of a mobile robot is presented, applying the integration of adaptive control, sliding-mode control, and neural dynamics. In the first stage, an adaptive kinematic stabilization controller utilized to generate the command of velocity is developed based on Lyapunov theory. In the second stage, adopting the sliding-mode control approach, a dynamic controller with a variable speed function used to reduce the chattering is designed, which is utilized to generate the command of torque to make the actual velocity of the mobile robot asymptotically reach the desired velocity. Furthermore, to handle the speed and torque jump problems, the neural dynamics model is integrated into the above mentioned controllers. The stability of the proposed control system is analyzed by using Lyapunov theory. Finally, the simulation of the control law is implemented in perturbed case, and the results show that the control scheme can solve the stabilization problem effectively. The proposed control law can solve the speed and torque jump problems, overcome external disturbances, and provide a new solution for the vision-based stabilization of the mobile robot.

Compensation for secondary uncertainty in electro-hydraulic servo system by gain adaptive sliding mode variable structure control

Based on consideration of the differential relations between the immeasurable variables and measurable variables in electro-hydraulic servo system,adaptive dynamic recurrent fuzzy neural networks(ADRFNNs) were employed to identify the primary uncertainty and the mathematic model of the system was turned into an equivalent linear model with terms of secondary uncertainty.At the same time,gain adaptive sliding mode variable structure control(GASMVSC) was employed to synthesize the control effort.The results show that the unrealization problem caused by some system's immeasurable state variables in traditional fuzzy neural networks(TFNN) taking all state variables as its inputs is overcome.On the other hand,the identification by the ADRFNNs online with high accuracy and the adaptive function of the correction term's gain in the GASMVSC make the system possess strong robustness and improved steady accuracy,and the chattering phenomenon of the control effort is also suppressed effectively.

Simultaneous hybrid modeling of a nosiheptide fermentation process using particle swarm optimization

Hybrid modeling approaches have recently been investigated as an attractive alternative to model fermentation processes. Normally, these approaches require estimation data to train the empirical model part of a hybrid model. This may result in decreasing the generalization ability of the derived hybrid model. Therefore, a simultaneous hybrid modeling approach is presented in this paper. It transforms the training of the empirical model part into a dynamic system parameter identification problem, and thus allows training the empirical model part with only measured data. An adaptive escaping particle swarm optimization(AEPSO) algorithm with escaping and adaptive inertia weight adjustment strategies is constructed to solve the resulting parameter identification problem, and thereby accomplish the training of the empirical model part. The uniform design method is used to determine the empirical model structure. The proposed simultaneous hybrid modeling approach has been used in a lab-scale nosiheptide batch fermentation process. The results show that it is effective and leads to a more consistent model with better generalization ability when compared to existing ones. The performance of AEPSO is also demonstrated.

A hybrid tracking control strategy for an unmanned underwater vehicle aided with bioinspired neural dynamics

Tracking control has been a vital research topic in robotics.This paper presents a novel hybrid control strategy for an unmanned underwater vehicle(UUV)based on a bio-inspired neural dynamics model.An enhanced backstepping kinematic control strategy is first developed to avoid sharp velocity jumps and provides smooth velocity commands relative to conventional methods.Then,a novel sliding mode control is proposed,which is capable of providing smooth and continuous torque commands free from chattering.In comparative studies,the proposed combined hybrid control strategy has ensured control signal smoothness,which is critical in real‐world applications,especially for a UUV that needs to operate in complex underwater environments.