In this paper, the method based on uniform design and neural network is proposed to model the complex system. In order to express the system characteristics all round, uniform design method is used to choose the model...In this paper, the method based on uniform design and neural network is proposed to model the complex system. In order to express the system characteristics all round, uniform design method is used to choose the modeling samples and obtain the overall information of the system;for the purpose of modeling the system or its characteristics, the artificial neural network is used to construct the model. Experiment indicates that this method can model the complex system effectively.展开更多
Neural networks are being used to construct meta-models in numerical simulation of structures.In addition to network structures and training algorithms,training samples also greatly affect the accuracy of neural netwo...Neural networks are being used to construct meta-models in numerical simulation of structures.In addition to network structures and training algorithms,training samples also greatly affect the accuracy of neural network models.In this paper,some existing main sampling techniques are evaluated,including techniques based on experimental design theory, random selection,and rotating sampling.First,advantages and disadvantages of each technique are reviewed.Then,seven techniques are used to generate samples for training radial neural networks models for two benchmarks:an antenna model and an aircraft model.Results show that the uniform design,in which the number of samples and mean square error network models are considered,is the best sampling technique for neural network based meta-model building.展开更多
Based on the CNN-LSTM fusion deep neural network,this paper proposes a seismic velocity model building method that can simultaneously estimate the root mean square(RMS)velocity and interval velocity from the common-mi...Based on the CNN-LSTM fusion deep neural network,this paper proposes a seismic velocity model building method that can simultaneously estimate the root mean square(RMS)velocity and interval velocity from the common-midpoint(CMP)gather.In the proposed method,a convolutional neural network(CNN)Encoder and two long short-term memory networks(LSTMs)are used to extract spatial and temporal features from seismic signals,respectively,and a CNN Decoder is used to recover RMS velocity and interval velocity of underground media from various feature vectors.To address the problems of unstable gradients and easily fall into a local minimum in the deep neural network training process,we propose to use Kaiming normal initialization with zero negative slopes of rectifi ed units and to adjust the network learning process by optimizing the mean square error(MSE)loss function with the introduction of a freezing factor.The experiments on testing dataset show that CNN-LSTM fusion deep neural network can predict RMS velocity as well as interval velocity more accurately,and its inversion accuracy is superior to that of single neural network models.The predictions on the complex structures and Marmousi model are consistent with the true velocity variation trends,and the predictions on fi eld data can eff ectively correct the phase axis,improve the lateral continuity of phase axis and quality of stack section,indicating the eff ectiveness and decent generalization capability of the proposed method.展开更多
Artificial neural networks(ANNs)are one of the hottest topics in computer science and artificial intelligence due to their potential and advantages in analyzing real-world problems in various disciplines,including but...Artificial neural networks(ANNs)are one of the hottest topics in computer science and artificial intelligence due to their potential and advantages in analyzing real-world problems in various disciplines,including but not limited to physics,biology,chemistry,and engineering.However,ANNs lack several key characteristics of biological neural networks,such as sparsity,scale-freeness,and small-worldness.The concept of sparse and scale-free neural networks has been introduced to fill this gap.Network sparsity is implemented by removing weak weights between neurons during the learning process and replacing them with random weights.When the network is initialized,the neural network is fully connected,which means the number of weights is four times the number of neurons.In this study,considering that a biological neural network has some degree of initial sparsity,we design an ANN with a prescribed level of initial sparsity.The neural network is tested on handwritten digits,Arabic characters,CIFAR-10,and Reuters newswire topics.Simulations show that it is possible to reduce the number of weights by up to 50%without losing prediction accuracy.Moreover,in both cases,the testing time is dramatically reduced compared with fully connected ANNs.展开更多
Xigeda formation is a type of hundredmeter-thick lacustrine sediments of being prone to triggering landslides along the trunk channel and tributaries of the upper Yangtze River in China. The Yonglang landslide located...Xigeda formation is a type of hundredmeter-thick lacustrine sediments of being prone to triggering landslides along the trunk channel and tributaries of the upper Yangtze River in China. The Yonglang landslide located near Yonglang Town of Dechang County in Sichuan Province of China, which was a typical Xigeda formation landslide, was stabilized by anti-slide piles. Loading tests on a loading-test pile were conducted to measure the displacements and moments. The uncertainty of the tested geomechanical parameters of the Yonglang landslide over certain ranges would be problematic during the evaluation of the landslide. Thus, uniform design was introduced in the experimental design,and by which, numerical analyses of the loading-test pile were performed using Fast Lagrangian Analysis of Continua(FLAC3D) to acquire a database of the geomechanical parameters of the Yonglang landslide and the corresponding displacements of the loadingtest pile. A three-layer back-propagation neural network was established and trained with the database, and then tested and verified for its accuracy and reliability in numerical simulations. Displacement back analysis was conducted by substituting the displacements of the loading-test pile to the well-trained three-layer back-propagation neural network so as to identify the geomechanical parameters of the Yonglang landslide. The neuralnetwork-based displacement back analysis method with the proposed methodology is verified to be accurate and reliable for the identification of the uncertain geomechanical parameters of landslides.展开更多
In order to study the effect of alloy component on magnetic properties of NdFeB magnets, the experiment schemes are carried out by the uniform design theory, and the relationship between the component and the magnetic...In order to study the effect of alloy component on magnetic properties of NdFeB magnets, the experiment schemes are carried out by the uniform design theory, and the relationship between the component and the magnetic properties is established by artificial neural network(ANN) predicting model.The element contents of alloys are optimized by the ANN model.Meanwhile, the influences of mono-factor or multi-factor interaction on alloy magnetic properties are respectively discussed according to the curves ploted by ANN model.Simulation result shows that the predicted and measured results are in good agreement.The relative error is every low, the error is not more than 1.68% for remanence Br, 1.56% for maximal energy product (BH)m, and 7.73% for coercivity Hcj.Hcj can be obviously improved and Br can be reduced by increasing Nd or Zr content.Co and B have advantageous effects on increasing Br and disadvantageous effects on increasing Hcj.Influence of alloying elements on Hcj and Br are inverse, and the interaction among the alloying elements play an important role in the magnetic properties of NdFeB magnets.The ANN prediction model presents a new approach to investigate the nonlinear relationship between the component and the magnetic properties of NdFeB alloys.展开更多
In this paper, an efficient weight initialization method is proposed using Cauchy’s inequality based on sensitivity analy- sis to improve the convergence speed in single hidden layer feedforward neural networks. The ...In this paper, an efficient weight initialization method is proposed using Cauchy’s inequality based on sensitivity analy- sis to improve the convergence speed in single hidden layer feedforward neural networks. The proposed method ensures that the outputs of hidden neurons are in the active region which increases the rate of convergence. Also the weights are learned by minimizing the sum of squared errors and obtained by solving linear system of equations. The proposed method is simulated on various problems. In all the problems the number of epochs and time required for the proposed method is found to be minimum compared with other weight initialization methods.展开更多
Purpose–The purpose of this paper is to consider the concept of Fuzzy Radial Basis Function Neural Networks with Information Granulation(IG-FRBFNN)and their optimization realized by means of the Multiobjective Partic...Purpose–The purpose of this paper is to consider the concept of Fuzzy Radial Basis Function Neural Networks with Information Granulation(IG-FRBFNN)and their optimization realized by means of the Multiobjective Particle Swarm Optimization(MOPSO).Design/methodology/approach–In fuzzy modeling,complexity,interpretability(or simplicity)as well as accuracy of the obtained model are essential design criteria.Since the performance of the IG-RBFNN model is directly affected by some parameters,such as the fuzzification coefficient used in the FCM,the number of rules and the orders of the polynomials in the consequent parts of the rules,the authors carry out both structural as well as parametric optimization of the network.A multi-objective Particle Swarm Optimization using Crowding Distance(MOPSO-CD)as well as O/WLS learning-based optimization are exploited to carry out the structural and parametric optimization of the model,respectively,while the optimization is of multiobjective character as it is aimed at the simultaneous minimization of complexity and maximization of accuracy.Findings–The performance of the proposed model is illustrated with the aid of three examples.The proposed optimization method leads to an accurate and highly interpretable fuzzy model.Originality/value–A MOPSO-CD as well as O/WLS learning-based optimization are exploited,respectively,to carry out the structural and parametric optimization of the model.As a result,the proposed methodology is interesting for designing an accurate and highly interpretable fuzzy model.展开更多
文摘In this paper, the method based on uniform design and neural network is proposed to model the complex system. In order to express the system characteristics all round, uniform design method is used to choose the modeling samples and obtain the overall information of the system;for the purpose of modeling the system or its characteristics, the artificial neural network is used to construct the model. Experiment indicates that this method can model the complex system effectively.
基金Specialized Research Fund for the Doctoral Program of Higher Education,China (No.20010227012)
文摘Neural networks are being used to construct meta-models in numerical simulation of structures.In addition to network structures and training algorithms,training samples also greatly affect the accuracy of neural network models.In this paper,some existing main sampling techniques are evaluated,including techniques based on experimental design theory, random selection,and rotating sampling.First,advantages and disadvantages of each technique are reviewed.Then,seven techniques are used to generate samples for training radial neural networks models for two benchmarks:an antenna model and an aircraft model.Results show that the uniform design,in which the number of samples and mean square error network models are considered,is the best sampling technique for neural network based meta-model building.
基金financially supported by the Key Project of National Natural Science Foundation of China (No. 41930431)the Project of National Natural Science Foundation of China (Nos. 41904121, 41804133, and 41974116)Joint Guidance Project of Natural Science Foundation of Heilongjiang Province (No. LH2020D006)
文摘Based on the CNN-LSTM fusion deep neural network,this paper proposes a seismic velocity model building method that can simultaneously estimate the root mean square(RMS)velocity and interval velocity from the common-midpoint(CMP)gather.In the proposed method,a convolutional neural network(CNN)Encoder and two long short-term memory networks(LSTMs)are used to extract spatial and temporal features from seismic signals,respectively,and a CNN Decoder is used to recover RMS velocity and interval velocity of underground media from various feature vectors.To address the problems of unstable gradients and easily fall into a local minimum in the deep neural network training process,we propose to use Kaiming normal initialization with zero negative slopes of rectifi ed units and to adjust the network learning process by optimizing the mean square error(MSE)loss function with the introduction of a freezing factor.The experiments on testing dataset show that CNN-LSTM fusion deep neural network can predict RMS velocity as well as interval velocity more accurately,and its inversion accuracy is superior to that of single neural network models.The predictions on the complex structures and Marmousi model are consistent with the true velocity variation trends,and the predictions on fi eld data can eff ectively correct the phase axis,improve the lateral continuity of phase axis and quality of stack section,indicating the eff ectiveness and decent generalization capability of the proposed method.
文摘Artificial neural networks(ANNs)are one of the hottest topics in computer science and artificial intelligence due to their potential and advantages in analyzing real-world problems in various disciplines,including but not limited to physics,biology,chemistry,and engineering.However,ANNs lack several key characteristics of biological neural networks,such as sparsity,scale-freeness,and small-worldness.The concept of sparse and scale-free neural networks has been introduced to fill this gap.Network sparsity is implemented by removing weak weights between neurons during the learning process and replacing them with random weights.When the network is initialized,the neural network is fully connected,which means the number of weights is four times the number of neurons.In this study,considering that a biological neural network has some degree of initial sparsity,we design an ANN with a prescribed level of initial sparsity.The neural network is tested on handwritten digits,Arabic characters,CIFAR-10,and Reuters newswire topics.Simulations show that it is possible to reduce the number of weights by up to 50%without losing prediction accuracy.Moreover,in both cases,the testing time is dramatically reduced compared with fully connected ANNs.
基金supported by the "Light of West China" Program of Chinese Academy of Sciences (Grant No.Y6R2250250)the National Basic Research Program of China (973 Program, Grant No.2013CB733201)+2 种基金the One-Hundred Talents Program of Chinese Academy of Sciences (LijunSu)the Key Research Program of Frontier Sciences, Chinese Academy of Sciences (Grant No.QYZDB-SSW-DQC010)the Youth Fund of Institute of Mountain Hazards and Environment, Chinese Academy of Sciences (Grant No. Y6K2110110)
文摘Xigeda formation is a type of hundredmeter-thick lacustrine sediments of being prone to triggering landslides along the trunk channel and tributaries of the upper Yangtze River in China. The Yonglang landslide located near Yonglang Town of Dechang County in Sichuan Province of China, which was a typical Xigeda formation landslide, was stabilized by anti-slide piles. Loading tests on a loading-test pile were conducted to measure the displacements and moments. The uncertainty of the tested geomechanical parameters of the Yonglang landslide over certain ranges would be problematic during the evaluation of the landslide. Thus, uniform design was introduced in the experimental design,and by which, numerical analyses of the loading-test pile were performed using Fast Lagrangian Analysis of Continua(FLAC3D) to acquire a database of the geomechanical parameters of the Yonglang landslide and the corresponding displacements of the loadingtest pile. A three-layer back-propagation neural network was established and trained with the database, and then tested and verified for its accuracy and reliability in numerical simulations. Displacement back analysis was conducted by substituting the displacements of the loading-test pile to the well-trained three-layer back-propagation neural network so as to identify the geomechanical parameters of the Yonglang landslide. The neuralnetwork-based displacement back analysis method with the proposed methodology is verified to be accurate and reliable for the identification of the uncertain geomechanical parameters of landslides.
文摘In order to study the effect of alloy component on magnetic properties of NdFeB magnets, the experiment schemes are carried out by the uniform design theory, and the relationship between the component and the magnetic properties is established by artificial neural network(ANN) predicting model.The element contents of alloys are optimized by the ANN model.Meanwhile, the influences of mono-factor or multi-factor interaction on alloy magnetic properties are respectively discussed according to the curves ploted by ANN model.Simulation result shows that the predicted and measured results are in good agreement.The relative error is every low, the error is not more than 1.68% for remanence Br, 1.56% for maximal energy product (BH)m, and 7.73% for coercivity Hcj.Hcj can be obviously improved and Br can be reduced by increasing Nd or Zr content.Co and B have advantageous effects on increasing Br and disadvantageous effects on increasing Hcj.Influence of alloying elements on Hcj and Br are inverse, and the interaction among the alloying elements play an important role in the magnetic properties of NdFeB magnets.The ANN prediction model presents a new approach to investigate the nonlinear relationship between the component and the magnetic properties of NdFeB alloys.
文摘In this paper, an efficient weight initialization method is proposed using Cauchy’s inequality based on sensitivity analy- sis to improve the convergence speed in single hidden layer feedforward neural networks. The proposed method ensures that the outputs of hidden neurons are in the active region which increases the rate of convergence. Also the weights are learned by minimizing the sum of squared errors and obtained by solving linear system of equations. The proposed method is simulated on various problems. In all the problems the number of epochs and time required for the proposed method is found to be minimum compared with other weight initialization methods.
基金This work was supported by National Research Foundation of Korea Grant funded by the Korean Government(NRF-2010-D00065)the Grant of the Korean Ministry of Education,Science and Technology(The Regional Core Research Program/Center of Healthcare Technology Development)the GRRC program of Gyeonggi province[GRRC SUWON 2011-B2,Center for U-city Security&Surveillance Technology].
文摘Purpose–The purpose of this paper is to consider the concept of Fuzzy Radial Basis Function Neural Networks with Information Granulation(IG-FRBFNN)and their optimization realized by means of the Multiobjective Particle Swarm Optimization(MOPSO).Design/methodology/approach–In fuzzy modeling,complexity,interpretability(or simplicity)as well as accuracy of the obtained model are essential design criteria.Since the performance of the IG-RBFNN model is directly affected by some parameters,such as the fuzzification coefficient used in the FCM,the number of rules and the orders of the polynomials in the consequent parts of the rules,the authors carry out both structural as well as parametric optimization of the network.A multi-objective Particle Swarm Optimization using Crowding Distance(MOPSO-CD)as well as O/WLS learning-based optimization are exploited to carry out the structural and parametric optimization of the model,respectively,while the optimization is of multiobjective character as it is aimed at the simultaneous minimization of complexity and maximization of accuracy.Findings–The performance of the proposed model is illustrated with the aid of three examples.The proposed optimization method leads to an accurate and highly interpretable fuzzy model.Originality/value–A MOPSO-CD as well as O/WLS learning-based optimization are exploited,respectively,to carry out the structural and parametric optimization of the model.As a result,the proposed methodology is interesting for designing an accurate and highly interpretable fuzzy model.