Learning the parameters of a class of stochastic Lotka-Volterra systems with neural networks

In this paper,we propose a neural network approach to learn the parameters of a class of stochastic Lotka-Volterra systems.Approximations of the mean and covariance matrix of the observational variables are obtained from the Euler-Maruyama discretization of the underlying stochastic differential equations(SDEs),based on which the loss function is built.The stochastic gradient descent method is applied in the neural network training.Numerical experiments demonstrate the effectiveness of our method.

Time-varying parameters estimation with adaptive neural network EKF for missile-dual control system

In this paper, a filtering method is presented to estimate time-varying parameters of a missile dual control system with tail fins and reaction jets as control variables. In this method, the long-short-term memory(LSTM) neural network is nested into the extended Kalman filter(EKF) to modify the Kalman gain such that the filtering performance is improved in the presence of large model uncertainties. To avoid the unstable network output caused by the abrupt changes of system states,an adaptive correction factor is introduced to correct the network output online. In the process of training the network, a multi-gradient descent learning mode is proposed to better fit the internal state of the system, and a rolling training is used to implement an online prediction logic. Based on the Lyapunov second method, we discuss the stability of the system, the result shows that when the training error of neural network is sufficiently small, the system is asymptotically stable. With its application to the estimation of time-varying parameters of a missile dual control system, the LSTM-EKF shows better filtering performance than the EKF and adaptive EKF(AEKF) when there exist large uncertainties in the system model.

A Novel On-Site-Real-Time Method for Identifying Characteristic Parameters Using Ultrasonic Echo Groups and Neural Network

On-site and real-time non-destructive measurement of elastic constants for materials of a component in a in-service structure is a challenge due to structural complexities,such as ambiguous boundary,variable thickness,nonuniform material properties.This work develops for the first time a method that uses ultrasound echo groups and artificial neural network(ANN)for reliable on-site real-time identification of material parameters.The use of echo groups allows the use of lower frequencies,and hence more accommodative to structural complexity.To train the ANNs,a numerical model is established that is capable of computing the waveform of ultrasonic echo groups for any given set of material properties of a given structure.The waveform of an ultrasonic echo groups at an interest location on the surface the structure with material parameters varying in a predefined range are then computed using the numerical model.This results in a set of dataset for training the ANN model.Once the ANN is trained,the material parameters can be identified simultaneously using the actual measured echo waveform as input to the ANN.Intensive tests have been conducted both numerically and experimentally to evaluate the effectiveness and accuracy of the currently proposed method.The results show that the maximum identification error of numerical example is less than 2%,and the maximum identification error of experimental test is less than 7%.Compared with currently prevailing methods and equipment,the proposefy the density and thickness,in addition to the elastic constants.Moreover,the reliability and accuracy of inverse prediction is significantly improved.Thus,it has broad applications and enables real-time field measurements,which has not been fulfilled by any other available methods or equipment.

A New Chaotic Parameters Disturbance Annealing Neural Network for Solving Global Optimization Problems

Since there were few chaotic neural networks applicable to the global optimization, in this paper, we propose a new neural network model ? chaotic parameters disturbance annealing (CPDA) network, which is superior to other existing neural networks, genetic algorithms, and simulated annealing algorithms in global optimization. In the present CPDA network, we add some chaotic parameters in the energy function, which make the Hopfield neural network escape from the attraction of a local minimal solution and with the parameter annealing, our model will converge to the global optimal solutions quickly and steadily. The converge ability and other characters are also analyzed in this paper. The benchmark examples show the present CPDA neural network's merits in nonlinear global optimization.

Prediction of operational parameters effect on coal flotation using artificial neural network

Artificial neural network procedures were used to predict the combustible value （i.e. 100-Ash） and combustible recovery of coal flotation concentrate in different operational conditions. The pulp density,pH,rotation rate,coal particle size,dosage of collector,frother and conditioner were used as inputs to the network. Feed-forward artificial neural networks with 5-30-2-1 and 7-10-3-1 arrangements were capable to estimate the combustible value and combustible recovery of coal flotation concentrate respectively as the outputs. Quite satisfactory correlations of 1 and 0.91 in training and testing stages for combustible value and of 1 and 0.95 in training and testing stages for combustible recovery prediction were achieved. The proposed neural network models can be used to determine the most advantageous operational conditions for the expected concentrate assay and recovery in the coal flotation process.

Intelligent direct analysis of physical and mechanical parameters of tunnel surrounding rock based on adaptive immunity algorithm and BP neural network

Because of complexity and non-predictability of the tunnel surrounding rock, the problem with the determination of the physical and mechanical parameters of the surrounding rock has become a main obstacle to theoretical research and numerical analysis in tunnel engineering. During design, it is a frequent practice, therefore, to give recommended values by analog based on experience. It is a key point in current research to make use of the displacement back analytic method to comparatively accurately determine the parameters of the surrounding rock whereas artificial intelligence possesses an exceptionally strong capability of identifying, expressing and coping with such complex non-linear relationships. The parameters can be verified by searching the optimal network structure, using back analysis on measured data to search optimal parameters and performing direct computation of the obtained results. In the current paper, the direct analysis is performed with the biological emulation system and the software of Fast Lagrangian Analysis of Continua (FLAC3D. The high non-linearity, network reasoning and coupling ability of the neural network are employed. The output vector required of the training of the neural network is obtained with the numerical analysis software. And the overall space search is conducted by employing the Adaptive Immunity Algorithm. As a result, we are able to avoid the shortcoming that multiple parameters and optimized parameters are easy to fall into a local extremum. At the same time, the computing speed and efficiency are increased as well. Further, in the paper satisfactory conclusions are arrived at through the intelligent direct-back analysis on the monitored and measured data at the Erdaoya tunneling project. The results show that the physical and mechanical parameters obtained by the intelligent direct-back analysis proposed in the current paper have effectively improved the recommended values in the original prospecting data. This is of practical significance to the appraisal of stability and informationization design of the surrounding rock.

Development of a Novel Feedforward Neural Network Model Based on Controllable Parameters for Predicting Effluent Total Nitrogen

The problem of effluent total nitrogen(TN)at most of the wastewater treatment plants(WWTPs)in China is important for meeting the related water quality standards,even under the condition of high energy consumption.To achieve better prediction and control of effluent TN concentration,an efficient prediction model,based on controllable operation parameters,was constructed in a sequencing batch reactor process.Compared with previous models,this model has two main characteristics:①Superficial gas velocity and anoxic time are controllable operation parameters and are selected as the main input parameters instead of dissolved oxygen to improve the model controllability,and②the model prediction accuracy is improved on the basis of a feedforward neural network(FFNN)with algorithm optimization.The results demonstrated that the FFNN model was efficiently optimized by scaled conjugate gradient,and the performance was excellent compared with other models in terms of the correlation coefficient(R).The optimized FFNN model could provide an accurate prediction of effluent TN based on influent water parameters and key control parameters.This study revealed the possible application of the optimized FFNN model for the efficient removal of pollutants and lower energy consumption at most of the WWTPs.

STOCHASTIC STABILITY OF UNCERTAIN RECURRENT NEURAL NETWORKS WITH MARKOVIAN JUMPING PARAMETERS

In this paper, global robust stability of uncertain stochastic recurrent neural networks with Markovian jumping parameters is considered. A novel Linear matrix inequal- ity（LMI） based stability criterion is obtained to guarantee the asymptotic stability of uncertain stochastic recurrent neural networks with Markovian jumping parameters. The results are derived by using the Lyapunov functional technique, Lipchitz condition and S-procuture. Finally, numerical examples are given to demonstrate the correctness of the theoretical results. Our results are also compared with results discussed in [31] and [34] to show the effectiveness and conservativeness.

Stability of stochastic neural networks with Markovian jumping parameters

The global asymptotical stability for a class of stochastic delayed neural networks （SDNNs） with Maxkovian jumping parameters is considered. By applying Lyapunov functional method and Ito＇s differential rule, new delay-dependent stability conditions are derived. All results are expressed in terms of linear matrix inequality （LMI）, and a numerical example is presented to illustrate the correctness and less conservativeness of the proposed method.

Prediction of Superconductivity for Oxides Based on Structural Parameters and Artificial Neural Network Method

Superconductive properties for oxides were predicted by artificial neural network (ANN) method with structural and chemical parameters as inputs. The predicted properties include superconductivity for oxides, distributed ranges of the superconductive transition temperature (Tc) for complex oxides, and Tc values for cuprate superconductors. The calculated results indicated that the adjusted ANN can be used to predict superconductive properties for unknown oxides.

Improved delay-dependent globally asymptotic stability of delayed uncertain recurrent neural networks with Markovian jumping parameters

In this paper, we have improved delay-dependent stability criteria for recurrent neural networks with a delay varying over a range and Markovian jumping parameters. The criteria improve over some previous ones in that they have fewer matrix variables yet less conservatism. In addition, a numerical example is provided to illustrate the applicability of the result using the linear matrix inequality toolbox in MATLAB.

Optimization of Processing Parameters of Power Spinning for Bushing Based on Neural Network and Genetic Algorithms

A neural network model of key process parameters and forming quality is developed based on training samples which are obtained from the orthogonal experiment and the finite element numerical simulation. Optimization of the process parameters is conducted using the genetic algorithm (GA). The experimental results have shown that a surface model of the neural network can describe the nonlinear implicit relationship between the parameters of the power spinning process:the wall margin and amount of expansion. It has been found that the process of determining spinning technological parameters can be accelerated using the optimization method developed based on the BP neural network and the genetic algorithm used for the process parameters of power spinning formation. It is undoubtedly beneficial towards engineering applications.

Effects of aging parameters on hardness and electrical conductivity of Cu-Cr-Sn-Zn alloy by artificial neural network

In order to predict and control the properties of Cu-Cr-Sn-Zn alloy,a model of aging processes via an artificial neural network(ANN) method to map the non-linear relationship between parameters of aging process and the hardness and electrical conductivity properties of the Cu-Cr-Sn-Zn alloy was set up.The results show that the ANN model is a very useful and accurate tool for the property analysis and prediction of aging Cu-Cr-Sn-Zn alloy.Aged at 470-510 ℃ for 4-1 h,the optimal combinations of hardness 110-117(HV) and electrical conductivity 40.6-37.7 S/m are available respectively.

Inversion of Oceanic Parameters Represented by CTD Utilizing Seismic Multi-Attributes Based on Convolutional Neural Network

In Recent years,seismic data have been widely used in seismic oceanography for the inversion of oceanic parameters represented by conductivity temperature depth(CTD).Using this technique,researchers can identify the water structure with high horizontal resolution,which compensates for the deficiencies of CTD data.However,conventional inversion methods are modeldriven,such as constrained sparse spike inversion(CSSI)and full waveform inversion(FWI),and typically require prior deterministic mapping operators.In this paper,we propose a novel inversion method based on a convolutional neural network(CNN),which is purely data-driven.To solve the problem of multiple solutions,we use stepwise regression to select the optimal attributes and their combination and take two-dimensional images of the selected attributes as input data.To prevent vanishing gradients,we use the rectified linear unit(ReLU)function as the activation function of the hidden layer.Moreover,the Adam and mini-batch algorithms are combined to improve stability and efficiency.The inversion results of field data indicate that the proposed method is a robust tool for accurately predicting oceanic parameters.

Parameters Optimization of the Heating Furnace Control Systems Based on BP Neural Network Improved by Genetic Algorithm

The heating technological requirement of the conventional PID control is difficult to guarantee which based on the precise mathematical model,because the heating furnace for heating treatment with the big inertia,the pure time delay and nonlinear time-varying.Proposed one kind optimized variable method of PID controller based on the genetic algorithm with improved BP network that better realized the completely automatic intelligent control of the entire thermal process than the classics critical purporting(Z-N)method.A heating furnace for the object was simulated with MATLAB,simulation results show that the control system has the quicker response characteristic,the better dynamic characteristic and the quite stronger robustness,which has some promotional value for the control of industrial furnace.

PARAMETERS INVERSION OF FLUID-SATURATED POROUS MEDIA BASED ON NEURAL NETWORKS

The multi- layers feedforward neural network is used for inversion ofmaterial constants of fluid-saturated porous media. The direct analysis of fluid-saturated porousmedia is carried out with the boundary element method. The dynamic displacement responses obtainedfrom direct analysis for prescribed material parameters constitute the sample sets training neuralnetwork. By virtue of the effective L-M training algorithm and the Tikhonov regularization method aswell as the GCV method for an appropriate selection of regu-larization parameter, the inversemapping from dynamic displacement responses to material constants is performed. Numerical examplesdemonstrate the validity of the neural network method.

Finite-time Mittag-Leffler synchronization of fractional-order delayed memristive neural networks with parameters uncertainty and discontinuous activation functions

The finite-time Mittag-Leffler synchronization is investigated for fractional-order delayed memristive neural networks(FDMNN)with parameters uncertainty and discontinuous activation functions.The relevant results are obtained under the framework of Filippov for such systems.Firstly,the novel feedback controller,which includes the discontinuous functions and time delays,is proposed to investigate such systems.Secondly,the conditions on finite-time Mittag-Leffler synchronization of FDMNN are established according to the properties of fractional-order calculus and inequality analysis technique.At the same time,the upper bound of the settling time for Mittag-Leffler synchronization is accurately estimated.In addition,by selecting the appropriate parameters of the designed controller and utilizing the comparison theorem for fractional-order systems,the global asymptotic synchronization is achieved as a corollary.Finally,a numerical example is given to indicate the correctness of the obtained conclusions.

Parameters optimization for exponentially weighted moving average control chart using generalized regression neural network

As a useful alternative of Shewhart control chart, exponentially weighted moving average （EWMA） control chat has been applied widely to quality control, process monitoring, forecast, etc. In this paper, a method was introduced for optimal design of EWMA and multivariate EWMA （MEWMA） control charts, in which the optimal parameter pair （ λ, k） or （ λ, h ） was searched by using the generalized regression neural network （GRNN）. The results indicate that the optimal parameter pair can be obtained effectively by the proposed strategy for a given in-control average running length （ARLo） and shift to detect under any conditions, removing the drawback of incompleteness existing in the tables that had been reported.

State estimation for neural neutral-type networks with mixed time-varying delays and Markovian jumping parameters

This paper is concerned with a delay-dependent state estimator for neutral-type neural networks with mixed timevarying delays and Markovian jumping parameters.The addressed neural networks have a finite number of modes,and the modes may jump from one to another according to a Markov process.By construction of a suitable Lyapunov-Krasovskii functional,a delay-dependent condition is developed to estimate the neuron states through available output measurements such that the estimation error system is globally asymptotically stable in a mean square.The criterion is formulated in terms of a set of linear matrix inequalities（LMIs）,which can be checked efficiently by use of some standard numerical packages.

A back-propagation neural-network-based displacement back analysis for the identification of the geomechanical parameters of the Yonglang landslide in China

Xigeda formation is a type of hundredmeter-thick lacustrine sediments of being prone to triggering landslides along the trunk channel and tributaries of the upper Yangtze River in China. The Yonglang landslide located near Yonglang Town of Dechang County in Sichuan Province of China, which was a typical Xigeda formation landslide, was stabilized by anti-slide piles. Loading tests on a loading-test pile were conducted to measure the displacements and moments. The uncertainty of the tested geomechanical parameters of the Yonglang landslide over certain ranges would be problematic during the evaluation of the landslide. Thus, uniform design was introduced in the experimental design,and by which, numerical analyses of the loading-test pile were performed using Fast Lagrangian Analysis of Continua(FLAC3D) to acquire a database of the geomechanical parameters of the Yonglang landslide and the corresponding displacements of the loadingtest pile. A three-layer back-propagation neural network was established and trained with the database, and then tested and verified for its accuracy and reliability in numerical simulations. Displacement back analysis was conducted by substituting the displacements of the loading-test pile to the well-trained three-layer back-propagation neural network so as to identify the geomechanical parameters of the Yonglang landslide. The neuralnetwork-based displacement back analysis method with the proposed methodology is verified to be accurate and reliable for the identification of the uncertain geomechanical parameters of landslides.