Nonlinear Decoupling PID Control Using Neural Networks and Multiple Models

For a class of complex industrial processes with strong nonlinearity, serious coupling and uncertainty, a nonlinear decoupling proportional-integral-differential （PID） controller is proposed, which consists of a traditional PID controller, a decoupling compensator and a feedforward compensator for the unmodeled dynamics. The parameters of such controller is selected based on the generalized minimum variance control law. The unmodeled dynamics is estimated and compensated by neural networks, a switching mechanism is introduced to improve tracking performance, then a nonlinear decoupling PID control algorithm is proposed. All signals in such switching system are globally bounded and the tracking error is convergent. Simulations show effectiveness of the algorithm.

Predicting the growth performance of growing-finishing pigs based on net energy and digestible lysine intake using multiple regression and artificial neural networks models

Backgrounds:Evaluating the growth performance of pigs in real-time is laborious and expensive,thus mathematical models based on easily accessible variables are developed.Multiple regression(MR)is the most widely used tool to build prediction models in swine nutrition,while the artificial neural networks(ANN)model is reported to be more accurate than MR model in prediction performance.Therefore,the potential of ANN models in predicting the growth performance of pigs was evaluated and compared with MR models in this study.Results:Body weight(BW),net energy(NE)intake,standardized ileal digestible lysine(SID Lys)intake,and their quadratic terms were selected as input variables to predict ADG and F/G among 10 candidate variables.In the training phase,MR models showed high accuracy in both ADG and F/G prediction(R^(2)_(ADG)=0.929,R^(2)_(F/G)=0.886)while ANN models with 4,6 neurons and radial basis activation function yielded the best performance in ADG and F/G prediction(R^(2)_(ADG)=0.964,R^(2)_(F/G)=0.932).In the testing phase,these ANN models showed better accuracy in ADG prediction(CCC:0.976 vs.0.861,R^(2):0.951 vs.0.584),and F/G prediction(CCC:0.952 vs.0.900,R^(2):0.905 vs.0.821)compared with the MR models.Meanwhile,the“over-fitting”occurred in MR models but not in ANN models.On validation data from the animal trial,ANN models exhibited superiority over MR models in both ADG and F/G prediction(P<0.01).Moreover,the growth stages have a significant effect on the prediction accuracy of the models.Conclusion:Body weight,NE intake and SID Lys intake can be used as input variables to predict the growth performance of growing-finishing pigs,with trained ANN models are more flexible and accurate than MR models.Therefore,it is promising to use ANN models in related swine nutrition studies in the future.

Analysis for Cohen-Grossberg neural networks with multiple delays

The stability analysis of Cohen-Grossberg neural networks with multiple delays is given. An approach combining the Lyapunov functional with the linear matrix inequality （LMI） is taken to obtain the sufficient conditions for the globally asymptotic stability of equilibrium point. By using the properties of matrix norm, a practical corollary is derived. All results are established without assuming the differentiability and monotonicity of activation functions. The simulation samples have proved the effectiveness of the conclusions.

Hybrid Deep Learning-Based Adaptive Multiple Access Schemes Underwater Wireless Networks

Achieving sound communication systems in Under Water Acoustic(UWA)environment remains challenging for researchers.The communication scheme is complex since these acoustic channels exhibit uneven characteristics such as long propagation delay and irregular Doppler shifts.The development of machine and deep learning algorithms has reduced the burden of achieving reli-able and good communication schemes in the underwater acoustic environment.This paper proposes a novel intelligent selection method between the different modulation schemes such as Code Division Multiple Access(CDMA),Time Divi-sion Multiple Access(TDMA),and Orthogonal Frequency Division Multiplexing(OFDM)techniques using the hybrid combination of the convolutional neural net-works(CNN)and ensemble single feedforward layers(SFL).The convolutional neural networks are used for channel feature extraction,and boosted ensembled feedforward layers are used for modulation selection based on the CNN outputs.The extensive experimentation is carried out and compared with other hybrid learning models and conventional methods.Simulation results demonstrate that the performance of the proposed hybrid learning model has achieved nearly 98%accuracy and a 30%increase in BER performance which outperformed the other learning models in achieving the communication schemes under dynamic underwater environments.

Toward Coordination Control of Multiple Fish-Like Robots:Real-Time Vision-Based Pose Estimation and Tracking via Deep Neural Networks

Controlling multiple multi-joint fish-like robots has long captivated the attention of engineers and biologists,for which a fundamental but challenging topic is to robustly track the postures of the individuals in real time.This requires detecting multiple robots,estimating multi-joint postures,and tracking identities,as well as processing fast in real time.To the best of our knowledge,this challenge has not been tackled in the previous studies.In this paper,to precisely track the planar postures of multiple swimming multi-joint fish-like robots in real time,we propose a novel deep neural network-based method,named TAB-IOL.Its TAB part fuses the top-down and bottom-up approaches for vision-based pose estimation,while the IOL part with long short-term memory considers the motion constraints among joints for precise pose tracking.The satisfying performance of our TAB-IOL is verified by testing on a group of freely swimming fish-like robots in various scenarios with strong disturbances and by a deed comparison of accuracy,speed,and robustness with most state-of-the-art algorithms.Further,based on the precise pose estimation and tracking realized by our TAB-IOL,several formation control experiments are conducted for the group of fish-like robots.The results clearly demonstrate that our TAB-IOL lays a solid foundation for the coordination control of multiple fish-like robots in a real working environment.We believe our proposed method will facilitate the growth and development of related fields.

Prediction of blast boulders in open pit mines via multiple regression and artificial neural networks

The most important objective of blasting in open pit mines is rock fragmentation.Prediction of produced boulders(oversized crushed rocks) is a key parameter in designing blast patterns.In this study,the amount of boulder produced in blasting operations of Golegohar iron ore open pit mine,Iran was predicted via multiple regression method and artificial neural networks.Results of 33 blasts in the mine were collected for modeling.Input variables were:joints spacing,density and uniaxial compressive strength of the intact rock,burden,spacing,stemming,bench height to burden ratio,and specific charge.The dependent variable was ratio of boulder volume to pattern volume.Both techniques were successful in predicting the ratio.In this study,the multiple regression method was superior with coefficient of determination and root mean squared error values of 0.89 and 0.19,respectively.

Multiple Lagrange stability and Lyapunov asymptotical stability of delayed fractional-order Cohen-Grossberg neural networks

This paper addresses the coexistence and local stability of multiple equilibrium points for fractional-order Cohen-Grossberg neural networks(FOCGNNs)with time delays.Based on Brouwer's fixed point theorem,sufficient conditions are established to ensure the existence of Πi=1^n(2Ki+1)equilibrium points for FOCGNNs.Through the use of Hardy inequality,fractional Halanay inequality,and Lyapunov theory,some criteria are established to ensure the local Lagrange stability and the local Lyapunov asymptotical stability of Πi=1^n(Ki+1)equilibrium points for FOCGNNs.The obtained results encompass those of integer-order Hopfield neural networks with or without delay as special cases.The activation functions are nonlinear and nonmonotonic.There could be many corner points in this general class of activation functions.The structure of activation functions makes FOCGNNs could have a lot of stable equilibrium points.Coexistence of multiple stable equilibrium points is necessary when neural networks come to pattern recognition and associative memories.Finally,two numerical examples are provided to illustrate the effectiveness of the obtained results.

Global exponential stability analysis of cellular neural networks with multiple time delays

Global exponential stability problems are investigated for cellular neural networks （CNN） with multiple time-varying delays. Several new criteria in linear matrix inequality form or in algebraic form are presented to ascertain the uniqueness and global exponential stability of the equilibrium point for CNN with multiple time-varying delays and with constant time delays. The proposed method has the advantage of considering the difference of neuronal excitatory and inhibitory effects, which is also computationally efficient as it can be solved numerically using the recently developed interior-point algorithm or be checked using simple algebraic calculation. In addition, the proposed results generalize and improve upon some previous works. Two numerical examples are used to show the effectiveness of the obtained results.

Modeling the Drilling Process of Aluminum Composites Using Multiple Regression Analysis and Artificial Neural Networks

In recent years, aluminum-matrix composites (AMCs) have been widely used to replace cast iron in aerospace and automotive industries. Machining of these composite materials requires better understanding of cutting processes re- garding accuracy and efficiency. This study addresses the modeling of the machinability of self-lubricated aluminum /alumina/graphite hybrid composites synthesized by the powder metallurgy method. In this study, multiple regression analysis (MRA) and artificial neural networks (ANN) were used to investigate the influence of some parameters on the thrust force and torque in the drilling processes of self-lubricated hybrid composite materials. The models were identi- fied by using cutting speed, feed, and volume fraction of the reinforcement particles as input data and the thrust force and torque as the output data. A comparison between two prediction methods was developed to compare the prediction accuracy. ANNs showed better predictability results compared to MRA due to the nonlinearity nature of ANNs. The statistical analysis accompanied with artificial neural network results showed that Al2O3, Gr and cutting feed (f) were the most significant parameters on the drilling process, while spindle speed seemed insignificant. Since the spindle speed was insignificant, it directed us to set it either at the highest spindle speed to obtain high material removal rate or at the lowest spindle speed to prolong the tool life depending on the need for the application.

Prediction of Anti-Inflammatory Activity of a Series of Pyrimidine Derivatives, by Multiple Linear Regression and Artificial Neural Networks

Anti-inflammatory activity of a series of tri-substituted pyrimidine derivatives was predicted using two Quantitative Structure-Activity Relationship models. These relationships were developed from molecular descriptors calculated using the DFT quantum chemistry method using the B3LYP/6-31G(d,p) level of theory and molecular lipophilicity. Thus, the four descriptors which are the dipole moment μD, the energy of the highest occupied molecular orbital EHOMO, the isotropic polarizability α and the ACD/logP lipophilicity were selected for this purpose. The Multiple Linear Regression (MLR) and Artificial Neural Network (ANN) models are respectively accredited with the following statistical indicators: R2=91.28%, R2aj=89.11%, RMCE = 0.2831, R2ext=86.50% and R2=98.22%, R2aj=97.75%, RMCE = 0.1131, R2ext=98.54%. The results obtained with the artificial neural network are better than those of the multiple linear regression. However, these results show that the two models developed have very good predictive performance of anti-inflammatory activity. These two models can therefore be used to predict anti-inflammatory activity of new similar pyrimidine derivatives.

Analysis for Robust Stability of Hopfield Neural Networks with Multiple Delays

The robust stability of a class of Hopfield neural networks with multiple delays and parameter perturbations is analyzed. The sufficient conditions for the global robust stability of equilibrium point are given by way of constructing a suitable Lyapunov functional. The conditions take the form of linear matrix inequality (LMI), so they are computable and verifiable efficiently. Furthermore, all the results are obtained without assuming the differentiability and monotonicity of activation functions. From the viewpoint of system analysis, our results provide sufficient conditions for the global robust stability in a manner that they specify the size of perturbation that Hopfield neural networks can endure when the structure of the network is given. On the other hand, from the viewpoint of system synthesis, our results can answer how to choose the parameters of neural networks to endure a given perturbation.

Using Neural Networks to Combine Multiple Features in Remote Sensing Image Classification

Remote sensing image classification is the basis of remote sensing image analysis and understanding.It aims to assign each pixel an object class label.To achieve satisfactory classification accuracy,single feature is not enough.Multiple features are usually integrated in remote sensing image classification.In this paper,a method based on neural network to combine multiple features was proposed.A single network was used to perform the task instead of ensemble of neural networks.A special architecture of network was designed to fit the task.The method effectively avoids the problems in direct conjunction of multiple features.Experiments on Indian93 data set show that the method has obvious advantages over conjunction of features on both recognition rate and training time.

Prediction of kiwifruit firmness using fruit mineral nutrient concentration by artificial neural network(ANN) and multiple linear regressions(MLR)

Many properties of fruit are influenced by plant nutrition. Fruit firmness is one of the most important fruit characteristics and determines post-harvest life of the fruit, in recent decades, artificial intelligence systems were employed for developing predictive models to estimate and predict many agriculture processes. In the present study, the predictive capabilities of multiple linear regressions （MLR） and artificial neural networks （ANNs） are evaluated to estimate fruit firmness in six months, including each of nutrients concentrations （nitrogen （N）, potassium （K）, calcium （Ca） and magnesium （Mg）） alone （P1）, com- bination of nutrients concentrations （P2）, nutrient concentration ratios alone （P3）, and combination of nutrient concentrations and nutrient concentration ratios （P4）. The results showed that MLR model estimated fruit firmness more accuracy than ANN model in three datasets （P1, P2 and P4）. However, the application of P3 （N/Ca ratio） as the input dataset in ANN model improved the prediction of fruit firmness than the MLR model. Correlation coefficient and root mean squared error （RMSE） were 0.850 and 0.539 between the measured and the estimated data by the ANN model, respectively. Generally, the ANN model showed greater potential in determining the relationship between 6-mon-fruit firmness and nutrients concentration.

Fast recognition using convolutional neural network for the coal particle density range based on images captured under multiple light sources

A method based on multiple images captured under different light sources at different incident angles was developed to recognize the coal density range in this study.The innovation is that two new images were constructed based on images captured under four single light sources.Reconstruction image 1 was constructed by fusing greyscale versions of the original images into one image,and Reconstruction image2 was constructed based on the differences between the images captured under the different light sources.Subsequently,the four original images and two reconstructed images were input into the convolutional neural network AlexNet to recognize the density range in three cases:-1.5(clean coal) and+1.5 g/cm^(3)(non-clean coal);-1.8(non-gangue) and+1.8 g/cm^(3)(gangue);-1.5(clean coal),1.5-1.8(middlings),and+1.8 g/cm^(3)(gangue).The results show the following:(1) The reconstructed images,especially Reconstruction image 2,can effectively improve the recognition accuracy for the coal density range compared with images captured under single light source.(2) The recognition accuracies for gangue and non-gangue,clean coal and non-clean coal,and clean coal,middlings,and gangue reached88.44%,86.72% and 77.08%,respectively.(3) The recognition accuracy increases as the density moves further away from the boundary density.

Prediction of Shear Wave Velocity Using Artificial Neural Network Technique, Multiple Regression and Petrophysical Data: A Case Study in Asmari Reservoir (SW Iran)

Shear wave velocity has numerous applications in geomechanical, petrophysical and geophysical studies of hydrocarbon reserves. However, data related to shear wave velocity isn’t available for all wells, especially old wells and it is very important to estimate this parameter using other well logging. Hence, lots of methods have been developed to estimate these data using other available information of reservoir. In this study, after processing and removing inappropriate petrophysical data, we estimated petrophysical properties affecting shear wave velocity of the reservoir and statistical methods were used to establish relationship between effective petrophysical properties and shear wave velocity. To predict (VS), first we used empirical relationships and then multivariate regression methods and neural networks were used. Multiple regression method is a powerful method that uses correlation between available information and desired parameter. Using this method, we can identify parameters affecting estimation of shear wave velocity. Neural networks can also be trained quickly and present a stable model for predicting shear wave velocity. For this reason, this method is known as “dynamic regression” compared with multiple regression. Neural network used in this study is not like a black box because we have used the results of multiple regression that can easily modify prediction of shear wave velocity through appropriate combination of data. The same information that was intended for multiple regression was used as input in neural networks, and shear wave velocity was obtained using compressional wave velocity and well logging data (neutron, density, gamma and deep resistivity) in carbonate rocks. The results show that methods applied in this carbonate reservoir was successful, so that shear wave velocity was predicted with about 92 and 95 percents of correlation coefficient in multiple regression and neural network method, respectively. Therefore, we propose using these methods to estimate shear wave velocity in wells without this parameter.

Advanced Feature Fusion Algorithm Based on Multiple Convolutional Neural Network for Scene Recognition

Scene recognition is a popular open problem in the computer vision field.Among lots of methods proposed in recent years,Convolutional Neural Network(CNN)based approaches achieve the best performance in scene recognition.We propose in this paper an advanced feature fusion algorithm using Multiple Convolutional Neural Network(Multi-CNN)for scene recognition.Unlike existing works that usually use individual convolutional neural network,a fusion of multiple different convolutional neural networks is applied for scene recognition.Firstly,we split training images in two directions and apply to three deep CNN model,and then extract features from the last full-connected(FC)layer and probabilistic layer on each model.Finally,feature vectors are fused with different fusion strategies in groups forwarded into SoftMax classifier.Our proposed algorithm is evaluated on three scene datasets for scene recognition.The experimental results demonstrate the effectiveness of proposed algorithm compared with other state-of-art approaches.

Multiple model tracking algorithms based on neural network and multiple process noise soft switching

A multiple model tracking algorithm based on neural network and multiple-process noise soft-switching for maneuvering targets is presented.In this algorithm, the＂current＂statistical model and neural network are running in parallel.The neural network algorithm is used to modify the adaptive noise filtering algorithm based on the mean value and variance of the＂current＂statistical model for maneuvering targets, and then the multiple model tracking algorithm of the multiple processing switch is used to improve the precision of tracking maneuvering targets.The modified algorithm is proved to be effective by simulation.

Uplink NOMA signal transmission with convolutional neural networks approach

Non-orthogonal multiple access(NOMA), featuring high spectrum efficiency, massive connectivity and low latency, holds immense potential to be a novel multi-access technique in fifth-generation(5G) communication. Successive interference cancellation(SIC) is proved to be an effective method to detect the NOMA signal by ordering the power of received signals and then decoding them. However, the error accumulation effect referred to as error propagation is an inevitable problem. In this paper,we propose a convolutional neural networks(CNNs) approach to restore the desired signal impaired by the multiple input multiple output(MIMO) channel. Especially in the uplink NOMA scenario,the proposed method can decode multiple users' information in a cluster instantaneously without any traditional communication signal processing steps. Simulation experiments are conducted in the Rayleigh channel and the results demonstrate that the error performance of the proposed learning system outperforms that of the classic SIC detection. Consequently, deep learning has disruptive potential to replace the conventional signal detection method.

Hole Cleaning Prediction in Foam Drilling Using Artificial Neural Network and Multiple Linear Regression

Foam drilling is increasingly used to develop low pressure reservoirs or highly depleted mature reservoirs because of minimizing the formation damage and potential hazardous drilling problems. Prediction of the cuttings concentration in the wellbore annulus as a function of operational drilling parameters such as wellbore geometry, pumping rate, drilling fluid rheology and density and maximum drilling rate is very important for optimizing these parameters. This paper describes a simple and more reliable artificial neural network (ANN) method and multiple linear regression (MLR) to predict cuttings concentration during foam drilling operation. This model is applicable for various borehole conditions using some critical parameters associated with foam velocity, foam quality, hole geometry, subsurface condition (pressure and temperature) and pipe rotation. The average absolute percent relative error (AAPE) between the experimental cuttings concentration and ANN model is less than 6%, and using MLR, AAPE is less than 9%. A comparison of the ANN and mechanistic model was done. The AAPE values for all datasets in this study were 3.2%, 8.5% and 10.3% for ANN model, MLR model and mechanistic model respectively. The results show high ability of ANN in prediction with respect to statistical methods.

Sound Quality Prediction of Vehicle Interior Noise under Multiple Working Conditions Using Back-Propagation Neural Network Model

This paper presents a back-propagation neural network model for sound quality prediction (BPNN-SQP) of multiple working conditions’ vehicle interior noise. According to the standards and regulations, four kinds of vehicle interior noises under operating conditions, including idle, constant speed, accelerating and braking, are acquired. The objective psychoacoustic parameters and subjective annoyance results are respectively used as the input and output of the BPNN-SQP model. With correlation analysis and significance test, some psychoacoustic parameters, such as loudness, A-weighted sound pressure level, roughness, articulation index and sharpness, are selected for modeling. The annoyance values of unknown noise samples estimated by the BPNN-SQP model are highly correlated with the subjective annoyances. Conclusion can be drawn that the proposed BPNN-SQP model has good generalization ability and can be applied in sound quality prediction of vehicle interior noise under multiple working conditions.