Scale adaptive fitness evaluation‐based particle swarm optimisation for hyperparameter and architecture optimisation in neural networks and deep learning

Research into automatically searching for an optimal neural network(NN)by optimi-sation algorithms is a significant research topic in deep learning and artificial intelligence.However,this is still challenging due to two issues:Both the hyperparameter and ar-chitecture should be optimised and the optimisation process is computationally expen-sive.To tackle these two issues,this paper focusses on solving the hyperparameter and architecture optimization problem for the NN and proposes a novel light‐weight scale‐adaptive fitness evaluation‐based particle swarm optimisation(SAFE‐PSO)approach.Firstly,the SAFE‐PSO algorithm considers the hyperparameters and architectures together in the optimisation problem and therefore can find their optimal combination for the globally best NN.Secondly,the computational cost can be reduced by using multi‐scale accuracy evaluation methods to evaluate candidates.Thirdly,a stagnation‐based switch strategy is proposed to adaptively switch different evaluation methods to better balance the search performance and computational cost.The SAFE‐PSO algorithm is tested on two widely used datasets:The 10‐category(i.e.,CIFAR10)and the 100−cate-gory(i.e.,CIFAR100).The experimental results show that SAFE‐PSO is very effective and efficient,which can not only find a promising NN automatically but also find a better NN than compared algorithms at the same computational cost.

Co-digestion of Waste Coffee and Cocoa Hulls: Modeling of Biogas Production by the Particle Swarm Method

Energy is a crucial material for the development of our economy.Access to sufficient energy remains a major concern for developing countries,particularly those in sub-Saharan Africa.The major challenge lies in access to clean,environmentally friendly,quality and low-cost energy in different households in our municipalities.To cope with this vast energy gap,many households are dependent on fossil fuels.In Cameroon,the consumption of wood for the supply of energy is increasing by 4%per year.Overall,approximately 80%of households in Cameroon depend on woody biomass as the sole main source of energy supply in Cameroon and demand is growing over time.In view of the climatic variations that our countries,particularly Cameroon,undergo through deforestation,the use of wood as a source of energy is expensive and harmful to the environment,hence the urgency of replacing wood with renewable energy.Biogas is one of the most versatile sources of renewable energy.On an industrial scale,it is important to automate the process control.The main objective of the present work is to model the anaerobic digestion of coffee and cocoa hulls using the particle swarm optimisation method.Pretreatment using the organosolv process was done.This resulted in 48%lignin removal and 22%cellulose increase.For the pretreated biomass,the maximum production rate was 21 NmLCH4 per day with a biomethane yield of 90 NmLCH4/gVS.This represents an enhancement of 117%in biomethane yield.A positive flammability test was recorded after the 10th day of retention time.Moreover,the data collected during anaerobic digestion allowed implementation of a two-phase mathematical model.The thirteen parameters of the model were estimated with particle swarm optimisation method in Matlab.The model was able to simulate the biomethane production kinetics and variation of volatile fatty acid concentration.

Remarks on the Efficiency of Bionic Optimisation Strategies

Bionic optimisation is one of the most popular and efficient applications of bionic engineering. As there are many different approaches and terms being used, we try to come up with a structuring of the strategies and compare the efficiency of the different methods. The methods mostly proposed in literature may be classified into evolutionary, particle swarm and artificial neural net optimisation. Some related classes have to be mentioned as the non-sexual fern optimisation and the response surfaces, which are close to the neuron nets. To come up with a measure of the efficiency that allows to take into account some of the published results the technical optimisation problems were derived from the ones given in literature. They deal with elastic studies of frame structures, as the computing time for each individual is very short. General proposals, which approach to use may not be given. It seems to be a good idea to learn about the applicability of the different methods at different problem classes and then do the optimisation according to these experiences. Furthermore in many cases there is some evidence that switching from one method to another improves the performance. Finally the identification of the exact position of the optimum by gradient methods is often more efficient than long random walks around local maxima.

PSTCNN: Explainable COVID-19 diagnosis using PSO-guided self-tuning CNN

Since 2019,the coronavirus disease-19(COVID-19)has been spreading rapidly worldwide,posing an unignorable threat to the global economy and human health.It is a disease caused by severe acute respiratory syndrome coronavirus 2,a single-stranded RNA virus of the genus Betacoronavirus.This virus is highly infectious and relies on its angiotensin-converting enzyme 2-receptor to enter cells.With the increase in the number of confirmed COVID-19 diagnoses,the difficulty of diagnosis due to the lack of global healthcare resources becomes increasingly apparent.Deep learning-based computer-aided diagnosis models with high generalisability can effectively alleviate this pressure.Hyperparameter tuning is essential in training such models and significantly impacts their final performance and training speed.However,traditional hyperparameter tuning methods are usually time-consuming and unstable.To solve this issue,we introduce Particle Swarm Optimisation to build a PSO-guided Self-Tuning Convolution Neural Network(PSTCNN),allowing the model to tune hyperparameters automatically.Therefore,the proposed approach can reduce human involvement.Also,the optimisation algorithm can select the combination of hyperparameters in a targeted manner,thus stably achieving a solution closer to the global optimum.Experimentally,the PSTCNN can obtain quite excellent results,with a sensitivity of 93.65%±1.86%,a specificity of 94.32%±2.07%,a precision of 94.30%±2.04%,an accuracy of 93.99%±1.78%,an F1-score of 93.97%±1.78%,Matthews Correlation Coefficient of 87.99%±3.56%,and Fowlkes-Mallows Index of 93.97%±1.78%.Our experiments demonstrate that compared to traditional methods,hyperparameter tuning of the model using an optimisation algorithm is faster and more effective.

Research on error compensation of robot based on multi-hole measurement technology and particle swarm optimization

Robot error compensation is a technique for enhancing the positioning accuracy of the system. This paper presented an error measuring technique for serial robots based on the multi-hole measuring method, combined with the intelligent particle swarm optimisation(PSO) to obtain the optimal solution of the robot’s error compensation values, thereby improving the positioning accuracy of the robot. In the experiment, the robot error was measured using self-made multi-hole measuring plates and probes, and the experimental data were combined with PSO for the error comprehensive analysis. The results showed that on this type of serial robot, the multi-hole measuring method and PSO algorithm had obvious error compensation effects, which effectively improved the positioning accuracy of the robot, with the error reduced by 35% after compensation.