A hybrid identification model based on multilayer artificial neural networks(ANNs) and particle swarm optimization(PSO) algorithm is developed to improve the simultaneous identification efficiency of thermal conductiv...A hybrid identification model based on multilayer artificial neural networks(ANNs) and particle swarm optimization(PSO) algorithm is developed to improve the simultaneous identification efficiency of thermal conductivity and effective absorption coefficient of semitransparent materials.For the direct model,the spherical harmonic method and the finite volume method are used to solve the coupled conduction-radiation heat transfer problem in an absorbing,emitting,and non-scattering 2D axisymmetric gray medium in the background of laser flash method.For the identification part,firstly,the temperature field and the incident radiation field in different positions are chosen as observables.Then,a traditional identification model based on PSO algorithm is established.Finally,multilayer ANNs are built to fit and replace the direct model in the traditional identification model to speed up the identification process.The results show that compared with the traditional identification model,the time cost of the hybrid identification model is reduced by about 1 000 times.Besides,the hybrid identification model remains a high level of accuracy even with measurement errors.展开更多
Thermal deformation error is one of the most important factors affecting the CNCs’ accuracy, so research is conducted on the temperature errors affecting CNCs’ machining accuracy;on the basis of analyzing the unpred...Thermal deformation error is one of the most important factors affecting the CNCs’ accuracy, so research is conducted on the temperature errors affecting CNCs’ machining accuracy;on the basis of analyzing the unpredictability and pre-maturing of the results of the genetic algorithm, as well as the slow speed of the training speed of the particle algorithm, a kind of Mind Evolutionary Algorithm optimized BP neural network featuring extremely strong global search capacity was proposed;type KVC850MA/2 five-axis CNC of Changzheng Lathe Factory was used as the research subject, and the Mind Evolutionary Algorithm optimized BP neural network algorithm was used for the establishment of the compensation model between temperature changes and the CNCs’ thermal deformation errors, as well as the realization method on hardware. The simulation results indicated that this method featured extremely high practical value.展开更多
Radial Basis Function Neural Network(RBFNN)ensembles have long suffered from non-efficient training,where incorrect parameter settings can be computationally disastrous.This paper examines different evolutionary algor...Radial Basis Function Neural Network(RBFNN)ensembles have long suffered from non-efficient training,where incorrect parameter settings can be computationally disastrous.This paper examines different evolutionary algorithms for training the Symbolic Radial Basis Function Neural Network(SRBFNN)through the behavior’s integration of satisfiability programming.Inspired by evolutionary algorithms,which can iteratively find the nearoptimal solution,different Evolutionary Algorithms(EAs)were designed to optimize the producer output weight of the SRBFNN that corresponds to the embedded logic programming 2Satisfiability representation(SRBFNN-2SAT).The SRBFNN’s objective function that corresponds to Satisfiability logic programming can be minimized by different algorithms,including Genetic Algorithm(GA),Evolution Strategy Algorithm(ES),Differential Evolution Algorithm(DE),and Evolutionary Programming Algorithm(EP).Each of these methods is presented in the steps in the flowchart form which can be used for its straightforward implementation in any programming language.With the use of SRBFNN-2SAT,a training method based on these algorithms has been presented,then training has been compared among algorithms,which were applied in Microsoft Visual C++software using multiple metrics of performance,including Mean Absolute Relative Error(MARE),Root Mean Square Error(RMSE),Mean Absolute Percentage Error(MAPE),Mean Bias Error(MBE),Systematic Error(SD),Schwarz Bayesian Criterion(SBC),and Central Process Unit time(CPU time).Based on the results,the EP algorithm achieved a higher training rate and simple structure compared with the rest of the algorithms.It has been confirmed that the EP algorithm is quite effective in training and obtaining the best output weight,accompanied by the slightest iteration error,which minimizes the objective function of SRBFNN-2SAT.展开更多
This paper proposes an integration of recent metaheuristic algorithm namely Evolutionary Mating Algorithm (EMA) in optimizing the weights and biases of deep neural networks (DNN) for forecasting the solar power genera...This paper proposes an integration of recent metaheuristic algorithm namely Evolutionary Mating Algorithm (EMA) in optimizing the weights and biases of deep neural networks (DNN) for forecasting the solar power generation. The study employs a Feed Forward Neural Network (FFNN) to forecast AC power output using real solar power plant measurements spanning a 34-day period, recorded at 15-minute intervals. The intricate nonlinear relationship between solar irradiation, ambient temperature, and module temperature is captured for accurate prediction. Additionally, the paper conducts a comprehensive comparison with established algorithms, including Differential Evolution (DE-DNN), Barnacles Mating Optimizer (BMO-DNN), Particle Swarm Optimization (PSO-DNN), Harmony Search Algorithm (HSA-DNN), DNN with Adaptive Moment Estimation optimizer (ADAM) and Nonlinear AutoRegressive with eXogenous inputs (NARX). The experimental results distinctly highlight the exceptional performance of EMA-DNN by attaining the lowest Root Mean Squared Error (RMSE) during testing. This contribution not only advances solar power forecasting methodologies but also underscores the potential of merging metaheuristic algorithms with contemporary neural networks for improved accuracy and reliability.展开更多
This paper proposes a co-evolutionary recurrent neural network (CERNN) for the multi-step-prediction of chaotic time series, it estimates the proper parameters of phase space reconstruction and optimizes the structu...This paper proposes a co-evolutionary recurrent neural network (CERNN) for the multi-step-prediction of chaotic time series, it estimates the proper parameters of phase space reconstruction and optimizes the structure of recurrent neural networks by coevolutionary strategy. The searching space was separated into two subspaces and the individuals are trained in a parallel computational procedure. It can dynamically combine the embedding method with the capability of recurrent neural network to incorporate past experience due to internal recurrence. The effectiveness of CERNN is evaluated by using three benchmark chaotic time series data sets: the Lorenz series, Mackey-Glass series and real-world sun spot series. The simulation results show that CERNN improves the performances of multi-step-prediction of chaotic time series.展开更多
Neural network pruning is a popular approach to reducing the computational complexity of deep neural networks.In recent years,as growing evidence shows that conventional network pruning methods employ inappropriate pr...Neural network pruning is a popular approach to reducing the computational complexity of deep neural networks.In recent years,as growing evidence shows that conventional network pruning methods employ inappropriate proxy metrics,and as new types of hardware become increasingly available,hardware-aware network pruning that incorporates hardware characteristics in the loop of network pruning has gained growing attention,Both network accuracy and hardware efficiency(latency,memory consumption,etc.)are critical objectives to the success of network pruning,but the conflict between the multiple objectives makes it impossible to find a single optimal solution.Previous studies mostly convert the hardware-aware network pruning to optimization problems with a single objective.In this paper,we propose to solve the hardware-aware network pruning problem with Multi-Objective Evolutionary Algorithms(MOEAs).Specifically,we formulate the problem as a multi-objective optimization problem,and propose a novel memetic MOEA,namely HAMP,that combines an efficient portfoliobased selection and a surrogate-assisted local search,to solve it.Empirical studies demonstrate the potential of MOEAs in providing simultaneously a set of alternative solutions and the superiority of HAMP compared to the state-of-the-art hardware-aware network pruning method.展开更多
This paper presents an improved nonlinear system identification scheme using di?erential evolution (DE), neural network (NN) and Levenberg Marquardt algorithm (LM). With a view to achieve better convergence of ...This paper presents an improved nonlinear system identification scheme using di?erential evolution (DE), neural network (NN) and Levenberg Marquardt algorithm (LM). With a view to achieve better convergence of NN weights optimization during the training, the DE and LM are used in a combined framework to train the NN. We present the convergence analysis of the DE and demonstrate the efficacy of the proposed improved system identification algorithm by exploiting the combined DE and LM training of the NN and suitably implementing it together with other system identification methods, namely NN and DE+NN on a number of examples including a practical case study. The identification results obtained through a series of simulation studies of these methods on different nonlinear systems demonstrate that the proposed DE and LM trained NN approach to nonlinear system identification can yield better identification results in terms of time of convergence and less identification error.展开更多
Brushless DC(BLDC)motor is a complex nonlinear system,of which some parameters will also change during operation.Therefore,obtaining accurate rotor position directly through the line voltage becomes more difficult.So ...Brushless DC(BLDC)motor is a complex nonlinear system,of which some parameters will also change during operation.Therefore,obtaining accurate rotor position directly through the line voltage becomes more difficult.So a new method is proposed in this paper which uses three line voltages as the input signal to identify the motor position based on adaptive wavelet neural network(WNN)and the differential evolution(DE)algorithm to optimize WNN structures,thus realizing the improvement of accuracy,exactness of the communication signals and convergence speed of the rotor position identification.Finally,both simulations and experimental results show that the proposed method has high accuracy of recognizing rotor position and strong orientation ability.展开更多
In the experiment of combined navigation filtering using wavelet neural network, the initial parameters of the network have the influence of randomness on network convergence and navigation accuracy. A combined naviga...In the experiment of combined navigation filtering using wavelet neural network, the initial parameters of the network have the influence of randomness on network convergence and navigation accuracy. A combined navigation filtering method based on wavelet neural network optimized by mind evolution algorithm is proposed. Firstly, the efficient global search ability of the mind evolution algorithm was used to quickly and accurately obtain the initial parameters of the appropriate wavelet neural network, and then the optimized wavelet neural network was applied to directly predict the position and velocity error data. This method is different from the traditional filtering method, while avoiding the drawbacks of the neural network. The simulation experiments with wavelet neural network and GA-wavelet network were carried out. The results show that the proposed method can effectively improve the accuracy of the integrated navigation system and provide a feasible path for combined navigation filtering.展开更多
To rationalize the design of D-π-A type organic small-molecule nonlinear optical materials,a theory guided machine learning framework is constructed.Such an approach is based on the recognition that the optical prope...To rationalize the design of D-π-A type organic small-molecule nonlinear optical materials,a theory guided machine learning framework is constructed.Such an approach is based on the recognition that the optical property of the molecule is predictable upon accumulating the contribution of each component,which is in line with the concept of group contribution method in thermodynamics.To realize this,a Lewis-mode group contribution method(LGC)has been developed in this work,which is combined with the multistage Bayesian neural network and the evolutionary algorithm to constitute an interactive framework(LGC-msBNN-EA).Thus,different optical properties of molecules are afforded accurately and efficientlyby using only a small data set for training.Moreover,by employing the EA model designed specifically for LGC,structural search is well achievable.The origins of the satisfying performance of the framework are discussed in detail.Considering that such a framework combines chemical principles and data-driven tools,most likely,it will be proven to be rational and efficient to complete mission regarding structure design in related fields.展开更多
Evolutionary neural network(ENN)shows high performance in function optimization and in finding approximately global optima from searching large and complex spaces.It is one of the most efficient and adaptive optimizat...Evolutionary neural network(ENN)shows high performance in function optimization and in finding approximately global optima from searching large and complex spaces.It is one of the most efficient and adaptive optimization techniques used widely to provide candidate solutions that lead to the fitness of the problem.ENN has the extraordinary ability to search the global and learning the approximate optimal solution regardless of the gradient information of the error functions.However,ENN requires high computation and processing which requires parallel processing platforms such as field programmable gate arrays(FPGAs)and graphic processing units(GPUs)to achieve a good performance.This work involves different new implementations of ENN by exploring and adopting different techniques and opportunities for parallel processing.Different versions of ENN algorithm have also been implemented and parallelized on FPGAs platform for low latency by exploiting the parallelism and pipelining approaches.Real data form mass spectrometry data(MSD)application was tested to examine and verify our implementations.This is a very important and extensive computation application which needs to search and find the optimal features(peaks)in MSD in order to distinguish cancer patients from control patients.ENN algorithm is also implemented and parallelized on single core and GPU platforms for comparison purposes.The computation time of our optimized algorithm on FPGA and GPU has been improved by a factor of 6.75 and 6,respectively.展开更多
Evapotranspiration is an essential component of the hydrological cycle that is of particular interest for water resource planning.Its quantification is helpful in irrigation scheduling,water balance studies,water allo...Evapotranspiration is an essential component of the hydrological cycle that is of particular interest for water resource planning.Its quantification is helpful in irrigation scheduling,water balance studies,water allocation,etc.Modelling of reference evapotranspiration(ET0)using both gene expression programming(GEP)and artificial neural network(ANN)techniques was done using the daily meteorological data of the Pantnagar region,India,from 2010 to 2019.A total of 15 combinations of inputs were used in developing the ET0 models.The model with the least number of inputs consisted of maximum and minimum air temperatures,whereas the model with the highest number of inputs consisted of maximum air temperature,minimum air temperature,mean relative humidity,number of sunshine hours,wind speed at 2mheight and extra-terrestrial radiation as inputs and with ET0 as the output for all the models.All the GEP models were developed for a single functional set and pre-defined genetic operator values,while the best structure in each ANN model was found based on the performance during the testing phase.It was found that ANN models were superior to GEP models for the estimation purpose.It was evident from the reduction in RMSE values ranging from 2%to 56%during training and testing phases in all the ANN models compared with GEP models.The ANN models showed an increase of about 0.96%to 9.72%of R2 value compared to the respective GEP models.The comparative study of these models with multiple linear regression(MLR)depicted that the ANN and GEP models were superior to MLR models.展开更多
Electrocardiogram(ECG)signal is a measure of the heart’s electrical activity.Recently,ECG detection and classification have benefited from the use of computer-aided systems by cardiologists.The goal of this paper is ...Electrocardiogram(ECG)signal is a measure of the heart’s electrical activity.Recently,ECG detection and classification have benefited from the use of computer-aided systems by cardiologists.The goal of this paper is to improve the accuracy of ECG classification by combining the Dipper Throated Optimization(DTO)and Differential Evolution Algorithm(DEA)into a unified algorithm to optimize the hyperparameters of neural network(NN)for boosting the ECG classification accuracy.In addition,we proposed a new feature selection method for selecting the significant feature that can improve the overall performance.To prove the superiority of the proposed approach,several experimentswere conducted to compare the results achieved by the proposed approach and other competing approaches.Moreover,statistical analysis is performed to study the significance and stability of the proposed approach using Wilcoxon and ANOVA tests.Experimental results confirmed the superiority and effectiveness of the proposed approach.The classification accuracy achieved by the proposed approach is(99.98%).展开更多
In aquaculture,the accurate prediction of feed intake for group fish is considered to be crucial to any feeding system.Previous studies mainly used mathematical statistics to establish the mapping relationship between...In aquaculture,the accurate prediction of feed intake for group fish is considered to be crucial to any feeding system.Previous studies mainly used mathematical statistics to establish the mapping relationship between feed intake and influencing factors.The result was easily influenced by subjective experience.To solve the above issues,this paper proposed a feed intake prediction model for group fish using the back-propagation neural network(BPNN)and mind evolutionary algorithm(MEA).Firstly,four factors,including water temperature,dissolved oxygen,the average fish weight and the number of fish were selected as the input of the BPNN model.Secondly,the initial weight and threshold of the BPNN were optimized by the MEA to improve the matching precision.Finally,the prediction model was achieved after training.Experimental results showed that the correlation coefficient between the predicted and measured values reached 0.96.And the root mean squared error,mean square error,mean absolute error,mean absolute percent error of the model was 6.89,47.53,6.17 and 0.04,respectively.In addition,the proposed method also had the better nonlinear fitting ability than BPNN and GA-BP.By using an intelligent optimization algorithm,the mapping relationship between fish intake and environmental factors was automatically established,thus avoiding the subjectivity of traditional methods.Therefore,it can lay a theoretical foundation for the development of intelligent feeding equipment and meet the needs of the smart fishery.展开更多
A practical neural network model was designed to realize the color space conversion of digital photofinishing. The sampling, network structure and training process were introduced respectively. But in actual training,...A practical neural network model was designed to realize the color space conversion of digital photofinishing. The sampling, network structure and training process were introduced respectively. But in actual training, the networks fall into local minimum in all probability. To solve this problem, evolutionary programming (EP) algorithm was applied and the learning rate was adaptively adjusted. In the experiment, the performance of network was compared with pre-optimizing. Then the color space conversion was evaluated bv the simulation error of samples from the point of color difference.展开更多
An evolutionary network driven by dynamics is studied and applied to the graph coloring problem. From an initial structure, both the topology and the coupling weights evolve according to the dynamics. On the other han...An evolutionary network driven by dynamics is studied and applied to the graph coloring problem. From an initial structure, both the topology and the coupling weights evolve according to the dynamics. On the other hand, the dynamics of the network are determined by the topology and the coupling weights, so an interesting structure-dynamics co-evolutionary scheme appears. By providing two evolutionary strategies, a network described by the complement of a graph will evolve into several clusters of nodes according to their dynamics. The nodes in each cluster can be assigned the same color and nodes in different clusters assigned different colors. In this way, a co-evolution phenomenon is applied to the graph coloring problem. The proposed scheme is tested on several benchmark graphs for graph coloring.展开更多
针对神经网络超参数优化效果差、容易陷入次优解和优化效率低的问题,提出一种基于改进实数编码遗传算法(IRCGA)的深度神经网络超参数优化算法——IRCGA-DNN(IRCGA for Deep Neural Network)。首先,采用实数编码方式表示超参数的取值,使...针对神经网络超参数优化效果差、容易陷入次优解和优化效率低的问题,提出一种基于改进实数编码遗传算法(IRCGA)的深度神经网络超参数优化算法——IRCGA-DNN(IRCGA for Deep Neural Network)。首先,采用实数编码方式表示超参数的取值,使超参数的搜索空间更灵活;然后,引入分层比例选择算子增加解集多样性;最后,分别设计了改进的单点交叉和变异算子,以更全面地探索超参数空间,提高优化算法的效率和质量。基于两个仿真数据集,验证IRCGA-DNN的毁伤效果预测性能和收敛效率。实验结果表明,在两个数据集上,与GA-DNN(Genetic Algorithm for Deep Neural Network)相比,所提算法的收敛迭代次数分别减少了8.7%和13.6%,均方误差(MSE)相差不大;与IGA-DNN(Improved GA-DNN)相比,IRCGA-DNN的收敛迭代次数分别减少了22.2%和13.6%。实验结果表明,所提算法收敛速度和预测性能均更优,能有效处理神经网络超参数优化问题。展开更多
基金supported by the Fundamental Research Funds for the Central Universities (No.3122020072)the Multi-investment Project of Tianjin Applied Basic Research(No.23JCQNJC00250)。
文摘A hybrid identification model based on multilayer artificial neural networks(ANNs) and particle swarm optimization(PSO) algorithm is developed to improve the simultaneous identification efficiency of thermal conductivity and effective absorption coefficient of semitransparent materials.For the direct model,the spherical harmonic method and the finite volume method are used to solve the coupled conduction-radiation heat transfer problem in an absorbing,emitting,and non-scattering 2D axisymmetric gray medium in the background of laser flash method.For the identification part,firstly,the temperature field and the incident radiation field in different positions are chosen as observables.Then,a traditional identification model based on PSO algorithm is established.Finally,multilayer ANNs are built to fit and replace the direct model in the traditional identification model to speed up the identification process.The results show that compared with the traditional identification model,the time cost of the hybrid identification model is reduced by about 1 000 times.Besides,the hybrid identification model remains a high level of accuracy even with measurement errors.
文摘Thermal deformation error is one of the most important factors affecting the CNCs’ accuracy, so research is conducted on the temperature errors affecting CNCs’ machining accuracy;on the basis of analyzing the unpredictability and pre-maturing of the results of the genetic algorithm, as well as the slow speed of the training speed of the particle algorithm, a kind of Mind Evolutionary Algorithm optimized BP neural network featuring extremely strong global search capacity was proposed;type KVC850MA/2 five-axis CNC of Changzheng Lathe Factory was used as the research subject, and the Mind Evolutionary Algorithm optimized BP neural network algorithm was used for the establishment of the compensation model between temperature changes and the CNCs’ thermal deformation errors, as well as the realization method on hardware. The simulation results indicated that this method featured extremely high practical value.
基金This work is supported by Ministry of Higher Education(MOHE)through Fundamental Research Grant Scheme(FRGS)(FRGS/1/2020/STG06/UTHM/03/7).
文摘Radial Basis Function Neural Network(RBFNN)ensembles have long suffered from non-efficient training,where incorrect parameter settings can be computationally disastrous.This paper examines different evolutionary algorithms for training the Symbolic Radial Basis Function Neural Network(SRBFNN)through the behavior’s integration of satisfiability programming.Inspired by evolutionary algorithms,which can iteratively find the nearoptimal solution,different Evolutionary Algorithms(EAs)were designed to optimize the producer output weight of the SRBFNN that corresponds to the embedded logic programming 2Satisfiability representation(SRBFNN-2SAT).The SRBFNN’s objective function that corresponds to Satisfiability logic programming can be minimized by different algorithms,including Genetic Algorithm(GA),Evolution Strategy Algorithm(ES),Differential Evolution Algorithm(DE),and Evolutionary Programming Algorithm(EP).Each of these methods is presented in the steps in the flowchart form which can be used for its straightforward implementation in any programming language.With the use of SRBFNN-2SAT,a training method based on these algorithms has been presented,then training has been compared among algorithms,which were applied in Microsoft Visual C++software using multiple metrics of performance,including Mean Absolute Relative Error(MARE),Root Mean Square Error(RMSE),Mean Absolute Percentage Error(MAPE),Mean Bias Error(MBE),Systematic Error(SD),Schwarz Bayesian Criterion(SBC),and Central Process Unit time(CPU time).Based on the results,the EP algorithm achieved a higher training rate and simple structure compared with the rest of the algorithms.It has been confirmed that the EP algorithm is quite effective in training and obtaining the best output weight,accompanied by the slightest iteration error,which minimizes the objective function of SRBFNN-2SAT.
基金supported by the Ministry of Higher Education Malaysia(MOHE)under Fundamental Research Grant Scheme(FRGS/1/2022/ICT04/UMP/02/1)Universiti Malaysia Pahang Al-Sultan Abdullah(UMPSA)under Distinguished Research Grant(#RDU223003).
文摘This paper proposes an integration of recent metaheuristic algorithm namely Evolutionary Mating Algorithm (EMA) in optimizing the weights and biases of deep neural networks (DNN) for forecasting the solar power generation. The study employs a Feed Forward Neural Network (FFNN) to forecast AC power output using real solar power plant measurements spanning a 34-day period, recorded at 15-minute intervals. The intricate nonlinear relationship between solar irradiation, ambient temperature, and module temperature is captured for accurate prediction. Additionally, the paper conducts a comprehensive comparison with established algorithms, including Differential Evolution (DE-DNN), Barnacles Mating Optimizer (BMO-DNN), Particle Swarm Optimization (PSO-DNN), Harmony Search Algorithm (HSA-DNN), DNN with Adaptive Moment Estimation optimizer (ADAM) and Nonlinear AutoRegressive with eXogenous inputs (NARX). The experimental results distinctly highlight the exceptional performance of EMA-DNN by attaining the lowest Root Mean Squared Error (RMSE) during testing. This contribution not only advances solar power forecasting methodologies but also underscores the potential of merging metaheuristic algorithms with contemporary neural networks for improved accuracy and reliability.
基金Project supported by the State Key Program of National Natural Science of China (Grant No 30230350)the Natural Science Foundation of Guangdong Province,China (Grant No 07006474)
文摘This paper proposes a co-evolutionary recurrent neural network (CERNN) for the multi-step-prediction of chaotic time series, it estimates the proper parameters of phase space reconstruction and optimizes the structure of recurrent neural networks by coevolutionary strategy. The searching space was separated into two subspaces and the individuals are trained in a parallel computational procedure. It can dynamically combine the embedding method with the capability of recurrent neural network to incorporate past experience due to internal recurrence. The effectiveness of CERNN is evaluated by using three benchmark chaotic time series data sets: the Lorenz series, Mackey-Glass series and real-world sun spot series. The simulation results show that CERNN improves the performances of multi-step-prediction of chaotic time series.
基金the National Natural Science Foundation of China(62106098)the Stable Support Plan Program of Shenzhen Natural Science Fund(20200925154942002)the M0E University Scientific-Technological Innovation Plan Program.
文摘Neural network pruning is a popular approach to reducing the computational complexity of deep neural networks.In recent years,as growing evidence shows that conventional network pruning methods employ inappropriate proxy metrics,and as new types of hardware become increasingly available,hardware-aware network pruning that incorporates hardware characteristics in the loop of network pruning has gained growing attention,Both network accuracy and hardware efficiency(latency,memory consumption,etc.)are critical objectives to the success of network pruning,but the conflict between the multiple objectives makes it impossible to find a single optimal solution.Previous studies mostly convert the hardware-aware network pruning to optimization problems with a single objective.In this paper,we propose to solve the hardware-aware network pruning problem with Multi-Objective Evolutionary Algorithms(MOEAs).Specifically,we formulate the problem as a multi-objective optimization problem,and propose a novel memetic MOEA,namely HAMP,that combines an efficient portfoliobased selection and a surrogate-assisted local search,to solve it.Empirical studies demonstrate the potential of MOEAs in providing simultaneously a set of alternative solutions and the superiority of HAMP compared to the state-of-the-art hardware-aware network pruning method.
文摘This paper presents an improved nonlinear system identification scheme using di?erential evolution (DE), neural network (NN) and Levenberg Marquardt algorithm (LM). With a view to achieve better convergence of NN weights optimization during the training, the DE and LM are used in a combined framework to train the NN. We present the convergence analysis of the DE and demonstrate the efficacy of the proposed improved system identification algorithm by exploiting the combined DE and LM training of the NN and suitably implementing it together with other system identification methods, namely NN and DE+NN on a number of examples including a practical case study. The identification results obtained through a series of simulation studies of these methods on different nonlinear systems demonstrate that the proposed DE and LM trained NN approach to nonlinear system identification can yield better identification results in terms of time of convergence and less identification error.
文摘Brushless DC(BLDC)motor is a complex nonlinear system,of which some parameters will also change during operation.Therefore,obtaining accurate rotor position directly through the line voltage becomes more difficult.So a new method is proposed in this paper which uses three line voltages as the input signal to identify the motor position based on adaptive wavelet neural network(WNN)and the differential evolution(DE)algorithm to optimize WNN structures,thus realizing the improvement of accuracy,exactness of the communication signals and convergence speed of the rotor position identification.Finally,both simulations and experimental results show that the proposed method has high accuracy of recognizing rotor position and strong orientation ability.
文摘In the experiment of combined navigation filtering using wavelet neural network, the initial parameters of the network have the influence of randomness on network convergence and navigation accuracy. A combined navigation filtering method based on wavelet neural network optimized by mind evolution algorithm is proposed. Firstly, the efficient global search ability of the mind evolution algorithm was used to quickly and accurately obtain the initial parameters of the appropriate wavelet neural network, and then the optimized wavelet neural network was applied to directly predict the position and velocity error data. This method is different from the traditional filtering method, while avoiding the drawbacks of the neural network. The simulation experiments with wavelet neural network and GA-wavelet network were carried out. The results show that the proposed method can effectively improve the accuracy of the integrated navigation system and provide a feasible path for combined navigation filtering.
基金support by the Key Research and Development Program of Zhejiang Province(2023C01102,2023C01208,2022C01208)。
文摘To rationalize the design of D-π-A type organic small-molecule nonlinear optical materials,a theory guided machine learning framework is constructed.Such an approach is based on the recognition that the optical property of the molecule is predictable upon accumulating the contribution of each component,which is in line with the concept of group contribution method in thermodynamics.To realize this,a Lewis-mode group contribution method(LGC)has been developed in this work,which is combined with the multistage Bayesian neural network and the evolutionary algorithm to constitute an interactive framework(LGC-msBNN-EA).Thus,different optical properties of molecules are afforded accurately and efficientlyby using only a small data set for training.Moreover,by employing the EA model designed specifically for LGC,structural search is well achievable.The origins of the satisfying performance of the framework are discussed in detail.Considering that such a framework combines chemical principles and data-driven tools,most likely,it will be proven to be rational and efficient to complete mission regarding structure design in related fields.
文摘Evolutionary neural network(ENN)shows high performance in function optimization and in finding approximately global optima from searching large and complex spaces.It is one of the most efficient and adaptive optimization techniques used widely to provide candidate solutions that lead to the fitness of the problem.ENN has the extraordinary ability to search the global and learning the approximate optimal solution regardless of the gradient information of the error functions.However,ENN requires high computation and processing which requires parallel processing platforms such as field programmable gate arrays(FPGAs)and graphic processing units(GPUs)to achieve a good performance.This work involves different new implementations of ENN by exploring and adopting different techniques and opportunities for parallel processing.Different versions of ENN algorithm have also been implemented and parallelized on FPGAs platform for low latency by exploiting the parallelism and pipelining approaches.Real data form mass spectrometry data(MSD)application was tested to examine and verify our implementations.This is a very important and extensive computation application which needs to search and find the optimal features(peaks)in MSD in order to distinguish cancer patients from control patients.ENN algorithm is also implemented and parallelized on single core and GPU platforms for comparison purposes.The computation time of our optimized algorithm on FPGA and GPU has been improved by a factor of 6.75 and 6,respectively.
文摘Evapotranspiration is an essential component of the hydrological cycle that is of particular interest for water resource planning.Its quantification is helpful in irrigation scheduling,water balance studies,water allocation,etc.Modelling of reference evapotranspiration(ET0)using both gene expression programming(GEP)and artificial neural network(ANN)techniques was done using the daily meteorological data of the Pantnagar region,India,from 2010 to 2019.A total of 15 combinations of inputs were used in developing the ET0 models.The model with the least number of inputs consisted of maximum and minimum air temperatures,whereas the model with the highest number of inputs consisted of maximum air temperature,minimum air temperature,mean relative humidity,number of sunshine hours,wind speed at 2mheight and extra-terrestrial radiation as inputs and with ET0 as the output for all the models.All the GEP models were developed for a single functional set and pre-defined genetic operator values,while the best structure in each ANN model was found based on the performance during the testing phase.It was found that ANN models were superior to GEP models for the estimation purpose.It was evident from the reduction in RMSE values ranging from 2%to 56%during training and testing phases in all the ANN models compared with GEP models.The ANN models showed an increase of about 0.96%to 9.72%of R2 value compared to the respective GEP models.The comparative study of these models with multiple linear regression(MLR)depicted that the ANN and GEP models were superior to MLR models.
文摘Electrocardiogram(ECG)signal is a measure of the heart’s electrical activity.Recently,ECG detection and classification have benefited from the use of computer-aided systems by cardiologists.The goal of this paper is to improve the accuracy of ECG classification by combining the Dipper Throated Optimization(DTO)and Differential Evolution Algorithm(DEA)into a unified algorithm to optimize the hyperparameters of neural network(NN)for boosting the ECG classification accuracy.In addition,we proposed a new feature selection method for selecting the significant feature that can improve the overall performance.To prove the superiority of the proposed approach,several experimentswere conducted to compare the results achieved by the proposed approach and other competing approaches.Moreover,statistical analysis is performed to study the significance and stability of the proposed approach using Wilcoxon and ANOVA tests.Experimental results confirmed the superiority and effectiveness of the proposed approach.The classification accuracy achieved by the proposed approach is(99.98%).
基金The work was supported by the Beijing Excellent Talents Development Project(2017000057592G125)National Key Research and Development Program of China(2017YFD0701700).
文摘In aquaculture,the accurate prediction of feed intake for group fish is considered to be crucial to any feeding system.Previous studies mainly used mathematical statistics to establish the mapping relationship between feed intake and influencing factors.The result was easily influenced by subjective experience.To solve the above issues,this paper proposed a feed intake prediction model for group fish using the back-propagation neural network(BPNN)and mind evolutionary algorithm(MEA).Firstly,four factors,including water temperature,dissolved oxygen,the average fish weight and the number of fish were selected as the input of the BPNN model.Secondly,the initial weight and threshold of the BPNN were optimized by the MEA to improve the matching precision.Finally,the prediction model was achieved after training.Experimental results showed that the correlation coefficient between the predicted and measured values reached 0.96.And the root mean squared error,mean square error,mean absolute error,mean absolute percent error of the model was 6.89,47.53,6.17 and 0.04,respectively.In addition,the proposed method also had the better nonlinear fitting ability than BPNN and GA-BP.By using an intelligent optimization algorithm,the mapping relationship between fish intake and environmental factors was automatically established,thus avoiding the subjectivity of traditional methods.Therefore,it can lay a theoretical foundation for the development of intelligent feeding equipment and meet the needs of the smart fishery.
基金This work was supported by the National Highand New Technology Industrialization Foundation ofChina (No. 2001AA300152).
文摘A practical neural network model was designed to realize the color space conversion of digital photofinishing. The sampling, network structure and training process were introduced respectively. But in actual training, the networks fall into local minimum in all probability. To solve this problem, evolutionary programming (EP) algorithm was applied and the learning rate was adaptively adjusted. In the experiment, the performance of network was compared with pre-optimizing. Then the color space conversion was evaluated bv the simulation error of samples from the point of color difference.
基金supported by the National Natural Science Foundation of China (Grants Nos. 61072139,61072106,61203303,61003198,61272279,and 61003199)
文摘An evolutionary network driven by dynamics is studied and applied to the graph coloring problem. From an initial structure, both the topology and the coupling weights evolve according to the dynamics. On the other hand, the dynamics of the network are determined by the topology and the coupling weights, so an interesting structure-dynamics co-evolutionary scheme appears. By providing two evolutionary strategies, a network described by the complement of a graph will evolve into several clusters of nodes according to their dynamics. The nodes in each cluster can be assigned the same color and nodes in different clusters assigned different colors. In this way, a co-evolution phenomenon is applied to the graph coloring problem. The proposed scheme is tested on several benchmark graphs for graph coloring.
文摘针对神经网络超参数优化效果差、容易陷入次优解和优化效率低的问题,提出一种基于改进实数编码遗传算法(IRCGA)的深度神经网络超参数优化算法——IRCGA-DNN(IRCGA for Deep Neural Network)。首先,采用实数编码方式表示超参数的取值,使超参数的搜索空间更灵活;然后,引入分层比例选择算子增加解集多样性;最后,分别设计了改进的单点交叉和变异算子,以更全面地探索超参数空间,提高优化算法的效率和质量。基于两个仿真数据集,验证IRCGA-DNN的毁伤效果预测性能和收敛效率。实验结果表明,在两个数据集上,与GA-DNN(Genetic Algorithm for Deep Neural Network)相比,所提算法的收敛迭代次数分别减少了8.7%和13.6%,均方误差(MSE)相差不大;与IGA-DNN(Improved GA-DNN)相比,IRCGA-DNN的收敛迭代次数分别减少了22.2%和13.6%。实验结果表明,所提算法收敛速度和预测性能均更优,能有效处理神经网络超参数优化问题。