This paper is concerned with a delay-dependent state estimator for neutral-type neural networks with mixed timevarying delays and Markovian jumping parameters.The addressed neural networks have a finite number of mode...This paper is concerned with a delay-dependent state estimator for neutral-type neural networks with mixed timevarying delays and Markovian jumping parameters.The addressed neural networks have a finite number of modes,and the modes may jump from one to another according to a Markov process.By construction of a suitable Lyapunov-Krasovskii functional,a delay-dependent condition is developed to estimate the neuron states through available output measurements such that the estimation error system is globally asymptotically stable in a mean square.The criterion is formulated in terms of a set of linear matrix inequalities(LMIs),which can be checked efficiently by use of some standard numerical packages.展开更多
The prediction of slope stability is considered as one of the critical concerns in geotechnical engineering.Conventional stochastic analysis with spatially variable slopes is time-consuming and highly computation-dema...The prediction of slope stability is considered as one of the critical concerns in geotechnical engineering.Conventional stochastic analysis with spatially variable slopes is time-consuming and highly computation-demanding.To assess the slope stability problems with a more desirable computational effort,many machine learning(ML)algorithms have been proposed.However,most ML-based techniques require that the training data must be in the same feature space and have the same distribution,and the model may need to be rebuilt when the spatial distribution changes.This paper presents a new ML-based algorithm,which combines the principal component analysis(PCA)-based neural network(NN)and transfer learning(TL)techniques(i.e.PCAeNNeTL)to conduct the stability analysis of slopes with different spatial distributions.The Monte Carlo coupled with finite element simulation is first conducted for data acquisition considering the spatial variability of cohesive strength or friction angle of soils from eight slopes with the same geometry.The PCA method is incorporated into the neural network algorithm(i.e.PCA-NN)to increase the computational efficiency by reducing the input variables.It is found that the PCA-NN algorithm performs well in improving the prediction of slope stability for a given slope in terms of the computational accuracy and computational effort when compared with the other two algorithms(i.e.NN and decision trees,DT).Furthermore,the PCAeNNeTL algorithm shows great potential in assessing the stability of slope even with fewer training data.展开更多
Recent years,neural networks(NNs)have received increasing attention from both academia and industry.So far significant diversity among existing NNs as well as their hardware platforms makes NN programming a daunting t...Recent years,neural networks(NNs)have received increasing attention from both academia and industry.So far significant diversity among existing NNs as well as their hardware platforms makes NN programming a daunting task.In this paper,a domain-specific language(DSL)for NNs,neural network language(NNL)is proposed to deliver productivity of NN programming and portable performance of NN execution on different hardware platforms.The productivity and flexibility of NN programming are enabled by abstracting NNs as a directed graph of blocks.The language describes 4 representative and widely used NNs and runs them on 3 different hardware platforms(CPU,GPU and NN accelerator).Experimental results show that NNs written with the proposed language are,on average,14.5%better than the baseline implementations across these 3 platforms.Moreover,compared with the Caffe framework that specifically targets the GPU platform,the code can achieve similar performance.展开更多
We present our results by using a machine learning(ML)approach for the solution of the Riemann problem for the Euler equations of fluid dynamics.The Riemann problem is an initial-value problem with piecewise-constant ...We present our results by using a machine learning(ML)approach for the solution of the Riemann problem for the Euler equations of fluid dynamics.The Riemann problem is an initial-value problem with piecewise-constant initial data and it represents a mathematical model of the shock tube.The solution of the Riemann problem is the building block for many numerical algorithms in computational fluid dynamics,such as finite-volume or discontinuous Galerkin methods.Therefore,a fast and accurate approximation of the solution of the Riemann problem and construction of the associated numerical fluxes is of crucial importance.The exact solution of the shock tube problem is fully described by the intermediate pressure and mathematically reduces to finding a solution of a nonlinear equation.Prior to delving into the complexities of ML for the Riemann problem,we consider a much simpler formulation,yet very informative,problem of learning roots of quadratic equations based on their coefficients.We compare two approaches:(i)Gaussian process(GP)regressions,and(ii)neural network(NN)approximations.Among these approaches,NNs prove to be more robust and efficient,although GP can be appreciably more accurate(about 30\%).We then use our experience with the quadratic equation to apply the GP and NN approaches to learn the exact solution of the Riemann problem from the initial data or coefficients of the gas equation of state(EOS).We compare GP and NN approximations in both regression and classification analysis and discuss the potential benefits and drawbacks of the ML approach.展开更多
In this paper, we employ a fixed point theorem due to Krasnosel’skii to attain the existence of periodic solutions for neutral-type neural networks with delays on a periodic time scale. Some new sufficient conditions...In this paper, we employ a fixed point theorem due to Krasnosel’skii to attain the existence of periodic solutions for neutral-type neural networks with delays on a periodic time scale. Some new sufficient conditions are established to show that there exists a unique periodic solution by the contraction mapping principle.展开更多
In this paper, almost sure exponential stability of neutral delayed cellular neural networks which are in the noised environment is studied by decomposing the state space to sub-regions in view of the saturation linea...In this paper, almost sure exponential stability of neutral delayed cellular neural networks which are in the noised environment is studied by decomposing the state space to sub-regions in view of the saturation linearity of output functions of neurons of the cellular neural networks. Some algebraic criteria are obtained and easily verified. Some examples are given to illustrate the correctness of the results obtained.展开更多
The principle aim of this paper is to explore the existence of periodic solution of neural networks model with neutral delay. Sufficient and realistic conditions are obtained by means of an abstract continuous theorem...The principle aim of this paper is to explore the existence of periodic solution of neural networks model with neutral delay. Sufficient and realistic conditions are obtained by means of an abstract continuous theorem of k-set contractive operator and some analysis technique.展开更多
Fatigue life and reliability of aero-engine blade are always of important significance to flight safety.The establishment of damage model is one of the key factors in blade fatigue research.Conventional linear Miner'...Fatigue life and reliability of aero-engine blade are always of important significance to flight safety.The establishment of damage model is one of the key factors in blade fatigue research.Conventional linear Miner's sum method is not suitable for aero-engine because of its low accuracy.A back propagation neutral network(BPNN) based on the combination of Levenberg-Marquardt(LM) and finite element method(FEM) is used to describe process of nonlinear damage accumulation behavior in material and predict fatigue life of the blade.Fatigue tests of standard specimen made from TC4 are carried out to obtain material fatigue parameters and S-N curve.A nonlinear continuum damage model(CDM),based on the BPNN with one hidden layer and ten neurons,is built to investigate the nonlinear damage accumulation behavior,in which the results from the tests are used as training set.Comparing with linear models and previous nonlinear models,BPNN has the lowest calculation error in full load range.It has significant accuracy when the load is below 500 MPa.Especially,when the load is 350 MPa,the calculation error of the BPNN is only 0.4%.The accurate model of the blade is built by using 3D coordinate measurement technology.The loading cycle in fatigue analysis is defined from takeoff to cruise in 10 min,and the load history is obtained from finite element analysis(FEA).Then the fatigue life of the compressor blade is predicted by using the BPNN model.The final fatigue life of the aero-engine blade is 6.55 104 cycles(10 916 h) based on the BPNN model,which is effective for the virtual design of aero-engine blade.展开更多
Exponential estimates and sufficient conditions for the exponential synchronization of complex dynamical networks with bounded time-varying delays are given in terms of linear matrix inequalities (LMIs). A generaliz...Exponential estimates and sufficient conditions for the exponential synchronization of complex dynamical networks with bounded time-varying delays are given in terms of linear matrix inequalities (LMIs). A generalized complex networks model involving both neutral delays and retarded ones is presented. The exponential synchronization problem of the complex networks is converted equivalently into the exponential stability problem of a group of uncorrelated delay functional differential equations with mixed timevarying delays. By utilizing the free weighting matrix technique, a less conservative delay-dependent synchronization criterion is derived. An illustrative example is provided to demonstrate the effectiveness of the proposed method.展开更多
The neutral grounding mode of medium-voltage distribution network decides the reliability, overvoltage, relay protection and electrical safety. Therefore, a comprehensive consideration of the reliability, safety and e...The neutral grounding mode of medium-voltage distribution network decides the reliability, overvoltage, relay protection and electrical safety. Therefore, a comprehensive consideration of the reliability, safety and economy is particularly important for the decision of neutral grounding mode. This paper proposes a new decision method of neutral point grounding mode for mediumvoltage distribution network. The objective function is constructed for the decision according the life cycle cost. The reliability of the neutral point grounding mode is taken into account through treating the outage cost as an operating cost. The safety condition of the neutral point grounding mode is preserved as the constraint condition of decision models, so the decision method can generate the most economical and reliable scheme of neutral point grounding mode within a safe limit. The example is used to verify the feasibility and effectiveness of the decision method.展开更多
This paper presents the stability analysis for a class of neural networks with time varying delays that are represented by the Takagi^ugeno IT-S) model. The main results given here focus on the stability criteria usi...This paper presents the stability analysis for a class of neural networks with time varying delays that are represented by the Takagi^ugeno IT-S) model. The main results given here focus on the stability criteria using a new Lyapunov functional. New relaxed conditions and new linear matrix inequality-based designs are proposed that outperform the previous results found in the literature. Numerical examples are provided to show that the achieved conditions are less conservative than the existing ones in the literature.展开更多
The artificial neutral network(ANN) has the ability that self-study and self-remember, its 3 layers BP network has been applied extensively, but sometimes because of serious multi-correlation between the variables, an...The artificial neutral network(ANN) has the ability that self-study and self-remember, its 3 layers BP network has been applied extensively, but sometimes because of serious multi-correlation between the variables, and a few observations while many variables, there usually will result into paralyzing in study, and the neutral network further development is restricted in the system to some extent. The partial least square regression(PLS) has its advantage of building the calculation model between the variables with strong multi-correlation, especially much effective on a few data and many variables. So a new and effective method-improved neutral network has been introduced-the neutral network based on the PLS. The results of example show the improved method has a few calculations and high accuracy, and provide a new way for valuing the rock mass mechanical parameters.展开更多
Simultaneous perturbation stochastic approximation (SPSA) belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper descri...Simultaneous perturbation stochastic approximation (SPSA) belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper describes an improved SPSA algorithm, which entails fuzzy adaptive gain sequences, gradient smoothing, and a step rejection procedure to enhance convergence and stability. The proposed fuzzy adaptive simultaneous perturbation approximation (FASPA) algorithm is particularly well suited to problems involving a large number of parameters such as those encountered in nonlinear system identification using neural networks (NNs). Accordingly, a multilayer perceptron (MLP) network with popular training algorithms was used to predicate the system response. We found that an MLP trained by FASPSA had the desired accuracy that was comparable to results obtained by traditional system identification algorithms. Simulation results for typical nonlinear systems demonstrate that the proposed NN architecture trained with FASPSA yields improved system identification as measured by reduced time of convergence and a smaller identification error.展开更多
Artificial neural networks(ANNs)are one of the hottest topics in computer science and artificial intelligence due to their potential and advantages in analyzing real-world problems in various disciplines,including but...Artificial neural networks(ANNs)are one of the hottest topics in computer science and artificial intelligence due to their potential and advantages in analyzing real-world problems in various disciplines,including but not limited to physics,biology,chemistry,and engineering.However,ANNs lack several key characteristics of biological neural networks,such as sparsity,scale-freeness,and small-worldness.The concept of sparse and scale-free neural networks has been introduced to fill this gap.Network sparsity is implemented by removing weak weights between neurons during the learning process and replacing them with random weights.When the network is initialized,the neural network is fully connected,which means the number of weights is four times the number of neurons.In this study,considering that a biological neural network has some degree of initial sparsity,we design an ANN with a prescribed level of initial sparsity.The neural network is tested on handwritten digits,Arabic characters,CIFAR-10,and Reuters newswire topics.Simulations show that it is possible to reduce the number of weights by up to 50%without losing prediction accuracy.Moreover,in both cases,the testing time is dramatically reduced compared with fully connected ANNs.展开更多
Protein Secondary Structure Prediction (PSSP) is considered as one of the major challenging tasks in bioinformatics, so many solutions have been proposed to solve that problem via trying to achieve more accurate predi...Protein Secondary Structure Prediction (PSSP) is considered as one of the major challenging tasks in bioinformatics, so many solutions have been proposed to solve that problem via trying to achieve more accurate prediction results. The goal of this paper is to develop and implement an intelligent based system to predict secondary structure of a protein from its primary amino acid sequence by using five models of Neural Network (NN). These models are Feed Forward Neural Network (FNN), Learning Vector Quantization (LVQ), Probabilistic Neural Network (PNN), Convolutional Neural Network (CNN), and CNN Fine Tuning for PSSP. To evaluate our approaches two datasets have been used. The first one contains 114 protein samples, and the second one contains 1845 protein samples.展开更多
基金Project supported by the 2010 Yeungnam University Research Grant
文摘This paper is concerned with a delay-dependent state estimator for neutral-type neural networks with mixed timevarying delays and Markovian jumping parameters.The addressed neural networks have a finite number of modes,and the modes may jump from one to another according to a Markov process.By construction of a suitable Lyapunov-Krasovskii functional,a delay-dependent condition is developed to estimate the neuron states through available output measurements such that the estimation error system is globally asymptotically stable in a mean square.The criterion is formulated in terms of a set of linear matrix inequalities(LMIs),which can be checked efficiently by use of some standard numerical packages.
基金supported by the National Natural Science Foundation of China(Grant No.52008402)the Central South University autonomous exploration project(Grant No.2021zzts0790).
文摘The prediction of slope stability is considered as one of the critical concerns in geotechnical engineering.Conventional stochastic analysis with spatially variable slopes is time-consuming and highly computation-demanding.To assess the slope stability problems with a more desirable computational effort,many machine learning(ML)algorithms have been proposed.However,most ML-based techniques require that the training data must be in the same feature space and have the same distribution,and the model may need to be rebuilt when the spatial distribution changes.This paper presents a new ML-based algorithm,which combines the principal component analysis(PCA)-based neural network(NN)and transfer learning(TL)techniques(i.e.PCAeNNeTL)to conduct the stability analysis of slopes with different spatial distributions.The Monte Carlo coupled with finite element simulation is first conducted for data acquisition considering the spatial variability of cohesive strength or friction angle of soils from eight slopes with the same geometry.The PCA method is incorporated into the neural network algorithm(i.e.PCA-NN)to increase the computational efficiency by reducing the input variables.It is found that the PCA-NN algorithm performs well in improving the prediction of slope stability for a given slope in terms of the computational accuracy and computational effort when compared with the other two algorithms(i.e.NN and decision trees,DT).Furthermore,the PCAeNNeTL algorithm shows great potential in assessing the stability of slope even with fewer training data.
基金the National Key Research and Development Program of China(No.2017YFA0700902,2017YFB1003101)the National Natural Science Foundation of China(No.61472396,61432016,61473275,61522211,61532016,61521092,61502446,61672491,61602441,61602446,61732002,61702478)+3 种基金the 973 Program of China(No.2015CB358800)National Science and Technology Major Project(No.2018ZX01031102)the Transformation and Transfer of Scientific and Technological Achievements of Chinese Academy of Sciences(No.KFJ-HGZX-013)Strategic Priority Research Program of Chinese Academy of Sciences(No.XDBS01050200).
文摘Recent years,neural networks(NNs)have received increasing attention from both academia and industry.So far significant diversity among existing NNs as well as their hardware platforms makes NN programming a daunting task.In this paper,a domain-specific language(DSL)for NNs,neural network language(NNL)is proposed to deliver productivity of NN programming and portable performance of NN execution on different hardware platforms.The productivity and flexibility of NN programming are enabled by abstracting NNs as a directed graph of blocks.The language describes 4 representative and widely used NNs and runs them on 3 different hardware platforms(CPU,GPU and NN accelerator).Experimental results show that NNs written with the proposed language are,on average,14.5%better than the baseline implementations across these 3 platforms.Moreover,compared with the Caffe framework that specifically targets the GPU platform,the code can achieve similar performance.
基金This work was performed under the auspices of the National Nuclear Security Administration of the US Department of Energy at Los Alamos National Laboratory under Contract No.DE-AC52-06NA25396The authors gratefully acknowledge the support of the US Department of Energy National Nuclear Security Administration Advanced Simulation and Computing Program.The Los Alamos unlimited release number is LA-UR-19-32257.
文摘We present our results by using a machine learning(ML)approach for the solution of the Riemann problem for the Euler equations of fluid dynamics.The Riemann problem is an initial-value problem with piecewise-constant initial data and it represents a mathematical model of the shock tube.The solution of the Riemann problem is the building block for many numerical algorithms in computational fluid dynamics,such as finite-volume or discontinuous Galerkin methods.Therefore,a fast and accurate approximation of the solution of the Riemann problem and construction of the associated numerical fluxes is of crucial importance.The exact solution of the shock tube problem is fully described by the intermediate pressure and mathematically reduces to finding a solution of a nonlinear equation.Prior to delving into the complexities of ML for the Riemann problem,we consider a much simpler formulation,yet very informative,problem of learning roots of quadratic equations based on their coefficients.We compare two approaches:(i)Gaussian process(GP)regressions,and(ii)neural network(NN)approximations.Among these approaches,NNs prove to be more robust and efficient,although GP can be appreciably more accurate(about 30\%).We then use our experience with the quadratic equation to apply the GP and NN approaches to learn the exact solution of the Riemann problem from the initial data or coefficients of the gas equation of state(EOS).We compare GP and NN approximations in both regression and classification analysis and discuss the potential benefits and drawbacks of the ML approach.
文摘In this paper, we employ a fixed point theorem due to Krasnosel’skii to attain the existence of periodic solutions for neutral-type neural networks with delays on a periodic time scale. Some new sufficient conditions are established to show that there exists a unique periodic solution by the contraction mapping principle.
基金the National Natural Science Foundation of China (No. 10571036)Tianjin Municipal Education Commission of China(No. 20070405)
文摘In this paper, almost sure exponential stability of neutral delayed cellular neural networks which are in the noised environment is studied by decomposing the state space to sub-regions in view of the saturation linearity of output functions of neurons of the cellular neural networks. Some algebraic criteria are obtained and easily verified. Some examples are given to illustrate the correctness of the results obtained.
文摘The principle aim of this paper is to explore the existence of periodic solution of neural networks model with neutral delay. Sufficient and realistic conditions are obtained by means of an abstract continuous theorem of k-set contractive operator and some analysis technique.
基金supported by National Natural Science Foundation of China (Grant No. 60879002)Tianjin Municipal Science and Technology Support Plan of China (Grant No. 10ZCKFGX03800)
文摘Fatigue life and reliability of aero-engine blade are always of important significance to flight safety.The establishment of damage model is one of the key factors in blade fatigue research.Conventional linear Miner's sum method is not suitable for aero-engine because of its low accuracy.A back propagation neutral network(BPNN) based on the combination of Levenberg-Marquardt(LM) and finite element method(FEM) is used to describe process of nonlinear damage accumulation behavior in material and predict fatigue life of the blade.Fatigue tests of standard specimen made from TC4 are carried out to obtain material fatigue parameters and S-N curve.A nonlinear continuum damage model(CDM),based on the BPNN with one hidden layer and ten neurons,is built to investigate the nonlinear damage accumulation behavior,in which the results from the tests are used as training set.Comparing with linear models and previous nonlinear models,BPNN has the lowest calculation error in full load range.It has significant accuracy when the load is below 500 MPa.Especially,when the load is 350 MPa,the calculation error of the BPNN is only 0.4%.The accurate model of the blade is built by using 3D coordinate measurement technology.The loading cycle in fatigue analysis is defined from takeoff to cruise in 10 min,and the load history is obtained from finite element analysis(FEA).Then the fatigue life of the compressor blade is predicted by using the BPNN model.The final fatigue life of the aero-engine blade is 6.55 104 cycles(10 916 h) based on the BPNN model,which is effective for the virtual design of aero-engine blade.
基金supported by the National Key Fundamental Re-search Program (No. 2002CB312201-03)the National NaturalScience Foundation of China (No. 60575036)
文摘Exponential estimates and sufficient conditions for the exponential synchronization of complex dynamical networks with bounded time-varying delays are given in terms of linear matrix inequalities (LMIs). A generalized complex networks model involving both neutral delays and retarded ones is presented. The exponential synchronization problem of the complex networks is converted equivalently into the exponential stability problem of a group of uncorrelated delay functional differential equations with mixed timevarying delays. By utilizing the free weighting matrix technique, a less conservative delay-dependent synchronization criterion is derived. An illustrative example is provided to demonstrate the effectiveness of the proposed method.
文摘The neutral grounding mode of medium-voltage distribution network decides the reliability, overvoltage, relay protection and electrical safety. Therefore, a comprehensive consideration of the reliability, safety and economy is particularly important for the decision of neutral grounding mode. This paper proposes a new decision method of neutral point grounding mode for mediumvoltage distribution network. The objective function is constructed for the decision according the life cycle cost. The reliability of the neutral point grounding mode is taken into account through treating the outage cost as an operating cost. The safety condition of the neutral point grounding mode is preserved as the constraint condition of decision models, so the decision method can generate the most economical and reliable scheme of neutral point grounding mode within a safe limit. The example is used to verify the feasibility and effectiveness of the decision method.
文摘This paper presents the stability analysis for a class of neural networks with time varying delays that are represented by the Takagi^ugeno IT-S) model. The main results given here focus on the stability criteria using a new Lyapunov functional. New relaxed conditions and new linear matrix inequality-based designs are proposed that outperform the previous results found in the literature. Numerical examples are provided to show that the achieved conditions are less conservative than the existing ones in the literature.
基金Supported by Henan Innovation Project for University Prominent Research Talents(2005KYCX015) Henan Innovation Talents Project for University
文摘The artificial neutral network(ANN) has the ability that self-study and self-remember, its 3 layers BP network has been applied extensively, but sometimes because of serious multi-correlation between the variables, and a few observations while many variables, there usually will result into paralyzing in study, and the neutral network further development is restricted in the system to some extent. The partial least square regression(PLS) has its advantage of building the calculation model between the variables with strong multi-correlation, especially much effective on a few data and many variables. So a new and effective method-improved neutral network has been introduced-the neutral network based on the PLS. The results of example show the improved method has a few calculations and high accuracy, and provide a new way for valuing the rock mass mechanical parameters.
文摘Simultaneous perturbation stochastic approximation (SPSA) belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper describes an improved SPSA algorithm, which entails fuzzy adaptive gain sequences, gradient smoothing, and a step rejection procedure to enhance convergence and stability. The proposed fuzzy adaptive simultaneous perturbation approximation (FASPA) algorithm is particularly well suited to problems involving a large number of parameters such as those encountered in nonlinear system identification using neural networks (NNs). Accordingly, a multilayer perceptron (MLP) network with popular training algorithms was used to predicate the system response. We found that an MLP trained by FASPSA had the desired accuracy that was comparable to results obtained by traditional system identification algorithms. Simulation results for typical nonlinear systems demonstrate that the proposed NN architecture trained with FASPSA yields improved system identification as measured by reduced time of convergence and a smaller identification error.
文摘Artificial neural networks(ANNs)are one of the hottest topics in computer science and artificial intelligence due to their potential and advantages in analyzing real-world problems in various disciplines,including but not limited to physics,biology,chemistry,and engineering.However,ANNs lack several key characteristics of biological neural networks,such as sparsity,scale-freeness,and small-worldness.The concept of sparse and scale-free neural networks has been introduced to fill this gap.Network sparsity is implemented by removing weak weights between neurons during the learning process and replacing them with random weights.When the network is initialized,the neural network is fully connected,which means the number of weights is four times the number of neurons.In this study,considering that a biological neural network has some degree of initial sparsity,we design an ANN with a prescribed level of initial sparsity.The neural network is tested on handwritten digits,Arabic characters,CIFAR-10,and Reuters newswire topics.Simulations show that it is possible to reduce the number of weights by up to 50%without losing prediction accuracy.Moreover,in both cases,the testing time is dramatically reduced compared with fully connected ANNs.
文摘Protein Secondary Structure Prediction (PSSP) is considered as one of the major challenging tasks in bioinformatics, so many solutions have been proposed to solve that problem via trying to achieve more accurate prediction results. The goal of this paper is to develop and implement an intelligent based system to predict secondary structure of a protein from its primary amino acid sequence by using five models of Neural Network (NN). These models are Feed Forward Neural Network (FNN), Learning Vector Quantization (LVQ), Probabilistic Neural Network (PNN), Convolutional Neural Network (CNN), and CNN Fine Tuning for PSSP. To evaluate our approaches two datasets have been used. The first one contains 114 protein samples, and the second one contains 1845 protein samples.