Particle Swarm Optimization-Based Hyperparameters Tuning of Machine Learning Models for Big COVID-19 Data Analysis

Analyzing big data, especially medical data, helps to provide good health care to patients and face the risks of death. The COVID-19 pandemic has had a significant impact on public health worldwide, emphasizing the need for effective risk prediction models. Machine learning (ML) techniques have shown promise in analyzing complex data patterns and predicting disease outcomes. The accuracy of these techniques is greatly affected by changing their parameters. Hyperparameter optimization plays a crucial role in improving model performance. In this work, the Particle Swarm Optimization (PSO) algorithm was used to effectively search the hyperparameter space and improve the predictive power of the machine learning models by identifying the optimal hyperparameters that can provide the highest accuracy. A dataset with a variety of clinical and epidemiological characteristics linked to COVID-19 cases was used in this study. Various machine learning models, including Random Forests, Decision Trees, Support Vector Machines, and Neural Networks, were utilized to capture the complex relationships present in the data. To evaluate the predictive performance of the models, the accuracy metric was employed. The experimental findings showed that the suggested method of estimating COVID-19 risk is effective. When compared to baseline models, the optimized machine learning models performed better and produced better results.

Particle Discontinuous Deformation Analysis of Static and Dynamic Crack Propagation in Brittle Material

Crack propagation in brittle material is not only crucial for structural safety evaluation,but also has a wideranging impact on material design,damage assessment,resource extraction,and scientific research.A thorough investigation into the behavior of crack propagation contributes to a better understanding and control of the properties of brittle materials,thereby enhancing the reliability and safety of both materials and structures.As an implicit discrete elementmethod,the Discontinuous Deformation Analysis(DDA)has gained significant attention for its developments and applications in recent years.Among these developments,the particle DDA equipped with the bonded particle model is a powerful tool for predicting the whole process of material from continuity to failure.The primary objective of this research is to develop and utilize the particle DDAtomodel and understand the complex behavior of cracks in brittle materials under both static and dynamic loadings.The particle DDA is applied to several classical crack propagation problems,including the crack branching,compact tensile test,Kalthoff impact experiment,and tensile test of a rectangular plate with a hole.The evolutions of cracks under various stress or geometrical conditions are carefully investigated.The simulated results are compared with the experiments and other numerical results.It is found that the crack propagation patterns,including crack branching and the formation of secondary cracks,can be well reproduced.The results show that the particle DDA is a qualified method for crack propagation problems,providing valuable insights into the fracture mechanism of brittle materials.

Reliability analysis of earth slopes using hybrid chaotic particle swarm optimization

A numerical procedure for reliability analysis of earth slope based on advanced first-order second-moment method is presented,while soil properties and pore water pressure may be considered as random variables.The factor of safety and performance function is formulated utilizing a new approach of the Morgenstern and Price method.To evaluate the minimum reliability index defined by Hasofer and Lind and corresponding critical probabilistic slip surface,a hybrid algorithm combining chaotic particle swarm optimization and harmony search algorithm called CPSOHS is presented.The comparison of the results of the presented method,standard particle swarm optimization,and selected other methods employed in previous studies demonstrates the superior successful functioning of the new method by evaluating lower values of reliability index and factor of safety.Moreover,the presented procedure is applied for sensitivity analysis and the obtained results show the influence of soil strength parameters and probability distribution types of random variables on the reliability index of slopes.

A hybrid particle swarm optimization approach with neural network and set pair analysis for transmission network planning

Transmission network planning (TNP) is a large-scale, complex, with more non-linear discrete variables and the multi-objective constrained optimization problem. In the optimization process, the line investment, network reliability and the network loss are the main objective of transmission network planning. Combined with set pair analysis (SPA), particle swarm optimization (PSO), neural network (NN), a hybrid particle swarm optimization model was established with neural network and set pair analysis for transmission network planning (HPNS). Firstly, the contact degree of set pair analysis was introduced, the traditional goal set was converted into the collection of the three indicators including the identity degree, difference agree and contrary degree. On this bases, using shi(H), the three objective optimization problem was converted into single objective optimization problem. Secondly, using the fast and efficient search capabilities of PSO, the transmission network planning model based on set pair analysis was optimized. In the process of optimization, by improving the BP neural network constantly training so that the value of the fitness function of PSO becomes smaller in order to obtain the optimization program fitting the three objectives better. Finally, compared HPNS with PSO algorithm and the classic genetic algorithm, HPNS increased about 23% efficiency than THA, raised about 3.7% than PSO and improved about 2.96% than GA.

Discontinuous flying particle swarm optimization algorithm and its application to slope stability analysis

A new version of particle swarm optimization(PSO) called discontinuous flying particle swarm optimization(DFPSO) was proposed,where not all of the particles refreshed their positions and velocities during each iteration step and the probability of each particle in refreshing its position and velocity was dependent on its objective function value.The effect of population size on the results was investigated.The results obtained by DFPSO have an average difference of 6% compared with those by PSO,whereas DFPSO consumes much less evaluations of objective function than PSO does.

Common model analysis and improvement of particle swarm optimizer

Particle swarm optimizer （PSO）, a new evolutionary computation algorithm, exhibits good performance for optimization problems, although PSO can not guarantee convergence of a global minimum, even a local minimum. However, there are some adjustable parameters and restrictive conditions which can affect performance of the algorithm. In this paper, the algorithm are analyzed as a time-varying dynamic system, and the sufficient conditions for asymptotic stability of acceleration factors, increment of acceleration factors and inertia weight are deduced. The value of the inertia weight is enhanced to （-1, 1）. Based on the deduced principle of acceleration factors, a new adaptive PSO algorithm- harmonious PSO （HPSO） is proposed. Furthermore it is proved that HPSO is a global search algorithm. In the experiments, HPSO are used to the model identification of a linear motor driving servo system. An Akaike information criteria based fitness function is designed and the algorithms can not only estimate the parameters, but also determine the order of the model simultaneously. The results demonstrate the effectiveness of HPSO.

Particle swarm optimization for rigid body reconstruction after micro-Doppler removal in radar analysis

The rotating micro-motion parts produce micro-Doppler(m-D)effects which severely influence the quality of inverse synthetic aperture radar(ISAR)imaging for complex moving targets.Recently,a method based on short-time Fourier transform(STFT)and L-statistics to remove m-D effects is proposed,which can separate the rigid body parts from interferences introduced by rotating parts.However,during the procedure of removing m-D parts,the useful data of the rigid body parts are also removed together with the m-D interferences.After summing the rest STFT samples,the result will be affected.A novel method is proposed to recover the missing values of the rigid body parts by the particle swarm optimization(PSO)algorithm.For PSO,each particle corresponds to a possible phase estimation of the missing values.The best particle is selected which has the minimal energy of the side lobes according to the best fitness value of particles.The simulation and measured data results demonstrate the effectiveness of the proposed method.

Multi-state Information Dimension Reduction Based on Particle Swarm Optimization-Kernel Independent Component Analysis

The precision of the kernel independent component analysis( KICA) algorithm depends on the type and parameter values of kernel function. Therefore,it's of great significance to study the choice method of KICA's kernel parameters for improving its feature dimension reduction result. In this paper, a fitness function was established by use of the ideal of Fisher discrimination function firstly. Then the global optimal solution of fitness function was searched by particle swarm optimization( PSO) algorithm and a multi-state information dimension reduction algorithm based on PSO-KICA was established. Finally,the validity of this algorithm to enhance the precision of feature dimension reduction has been proven.

Application of Particle Swarm Optimization to Fault Condition Recognition Based on Kernel Principal Component Analysis

Panicle swarm optimization （PSO） is an optimization algorithm based on the swarm intelligent principle. In this paper the modified PSO is applied to a kernel principal component analysis （ KPCA ） for an optimal kernel function parameter. We first comprehensively considered within-class scatter and between-class scatter of the sample features. Then, the fitness function of an optimized kernel function parameter is constructed, and the particle swarm optimization algorithm with adaptive acceleration （CPSO） is applied to optimizing it. It is used for gearbox condi- tion recognition, and the result is compared with the recognized results based on principal component analysis （PCA）. The results show that KPCA optimized by CPSO can effectively recognize fault conditions of the gearbox by reducing bind set-up of the kernel function parameter, and its results of fault recognition outperform those of PCA. We draw the conclusion that KPCA based on CPSO has an advantage in nonlinear feature extraction of mechanical failure, and is helpful for fault condition recognition of complicated machines.

Analysis of Water Pollution Causes and Control Countermeasures in Liaohe Estuary via Support Vector Machine Particle Swarm Optimization under Deep Learning

This study explores the loss or degradation of the ecosystem and its service function in the Liaohe estuary coastal zone due to the deterioration ofwater quality.Aprediction systembased on support vectormachine(SVM)-particle swarm optimization(PSO)(SVM-PSO)algorithm is proposed under the background of deep learning.SVM-PSO algorithm is employed to analyze the pollution status of the Liaohe estuary,so is the difference in water pollution of different sea consuming types.Based on the analysis results for causes of pollution,the control countermeasures of water pollution in Liaohe estuary are put forward.The results suggest that the water pollution index prediction model based on SVM-PSO algorithm shows the maximum error of 2.41%,the average error of 1.24%in predicting the samples,the root mean square error(RMSE)of 5.36×10^(−4),and the square of correlation coefficient of 0.91.Therefore,the prediction system in this study is feasible.At present,the water pollution status of Liaohe estuary is of moderate and severe levels of eutrophication,and the water pollution status basically remains at the level of mild pollution.The general trend is fromphosphorus moderate restricted eutrophication to phosphorus restricted potential eutrophication.To sumup,the SVM-PSO algorithm shows good sewage prediction ability,which can be applied and promoted in water pollution control and has reliable reference significance.

Quantum Particle Swarm Optimization with Deep Learning-Based Arabic Tweets Sentiment Analysis

Sentiment Analysis(SA),a Machine Learning(ML)technique,is often applied in the literature.The SA technique is specifically applied to the data collected from social media sites.The research studies conducted earlier upon the SA of the tweets were mostly aimed at automating the feature extraction process.In this background,the current study introduces a novel method called Quantum Particle Swarm Optimization with Deep Learning-Based Sentiment Analysis on Arabic Tweets(QPSODL-SAAT).The presented QPSODL-SAAT model determines and classifies the sentiments of the tweets written in Arabic.Initially,the data pre-processing is performed to convert the raw tweets into a useful format.Then,the word2vec model is applied to generate the feature vectors.The Bidirectional Gated Recurrent Unit(BiGRU)classifier is utilized to identify and classify the sentiments.Finally,the QPSO algorithm is exploited for the optimal finetuning of the hyperparameters involved in the BiGRU model.The proposed QPSODL-SAAT model was experimentally validated using the standard datasets.An extensive comparative analysis was conducted,and the proposed model achieved a maximum accuracy of 98.35%.The outcomes confirmed the supremacy of the proposed QPSODL-SAAT model over the rest of the approaches,such as the Surface Features(SF),Generic Embeddings(GE),Arabic Sentiment Embeddings constructed using the Hybrid(ASEH)model and the Bidirectional Encoder Representations from Transformers(BERT)model.

3D characterization and analysis of pore structure of packed ore particle beds based on computed tomography images

Methods and procedures of three-dimensional （3D） characterization of the pore structure features in the packed ore particle bed are focused. X-ray computed tomography was applied to deriving the cross-sectional images of specimens with single particle size of 1-2, 2-3, 3-4, 4-5, 5-6, 6-7, 7-8, 8-9, 9-10 ram. Based on the in-house developed 3D image analysis programs using Matlab, the volume porosity, pore size distribution and degree of connectivity were calculated and analyzed in detail. The results indicate that the volume porosity, the mean diameter of pores and the effective pore size （d50） increase with the increasing of particle size. Lognormal distribution or Gauss distribution is mostly suitable to model the pore size distribution. The degree of connectivity investigated on the basis of cluster-labeling algorithm also increases with increasing the particle size approximately.

Sigmoidal Particle Swarm Optimization for Twitter Sentiment Analysis

Social media,like Twitter,is a data repository,and people exchange views on global issues like the COVID-19 pandemic.Social media has been shown to influence the low acceptance of vaccines.This work aims to identify public sentiments concerning the COVID-19 vaccines and better understand the individual’s sensitivities and feelings that lead to achievement.This work proposes a method to analyze the opinion of an individual’s tweet about the COVID-19 vaccines.This paper introduces a sigmoidal particle swarm optimization(SPSO)algorithm.First,the performance of SPSO is measured on a set of 12 benchmark problems,and later it is deployed for selecting optimal text features and categorizing sentiment.The proposed method uses TextBlob and VADER for sentiment analysis,CountVectorizer,and term frequency-inverse document frequency(TF-IDF)vectorizer for feature extraction,followed by SPSO-based feature selection.The Covid-19 vaccination tweets dataset was created and used for training,validating,and testing.The proposed approach outperformed considered algorithms in terms of accuracy.Additionally,we augmented the newly created dataset to make it balanced to increase performance.A classical support vector machine(SVM)gives better accuracy for the augmented dataset without a feature selection algorithm.It shows that augmentation improves the overall accuracy of tweet analysis.After the augmentation performance of PSO and SPSO is improved by almost 7%and 5%,respectively,it is observed that simple SVMwith 10-fold cross-validation significantly improved compared to the primary dataset.

Model identification of hydraulic flight simulator based on improved particle swarm optimization and wavelet analysis

A new model identification method of hydraulic flight simulator adopting improved panicle swarm optimization （PSO） and wavelet analysis is proposed for achieving higher identification precision. Input-output data of hydraulic flight simulator were decomposed by wavelet muhiresolution to get the information of different frequency bands. The reconstructed input-output data were used to build the model of hydraulic flight simulator with improved particle swarm optimization with mutation （IPSOM） to avoid the premature convergence of traditional optimization techniques effectively. Simulation results show that the proposed method is more precise than traditional system identification methods in operating frequency bands because of the consideration of design index of control system for identification.

CPSO: Chaotic Particle Swarm Optimization for Cluster Analysis

Background:To solve the cluster analysis better,we propose a new method based on the chaotic particle swarm optimization(CPSO)algorithm.Methods:In order to enhance the performance in clustering,we propose a novel method based on CPSO.We first evaluate the clustering performance of this model using the variance ratio criterion(VRC)as the evaluation metric.The effectiveness of the CPSO algorithm is compared with that of the traditional particle swarm optimization(PSO)algorithm.The CPSO aims to improve the VRC value while avoiding local optimal solutions.The simulated dataset is set at three levels of overlapping:non-overlapping,partial overlapping,and severe overlapping.Finally,we compare CPSO with two other methods.Results:By observing the comparative results,our proposed CPSO method performs outstandingly.In the conditions of non-overlapping,partial overlapping,and severe overlapping,our method has the best VRC values of 1683.2,620.5,and 275.6,respectively.The mean VRC values in these three cases are 1683.2,617.8,and 222.6.Conclusion:The CPSO performed better than other methods for cluster analysis problems.CPSO is effective for cluster analysis.

h-ADAPTIVITY ANALYSIS BASED ON MULTIPLE SCALE REPRODUCING KERNEL PARTICLE METHOD

An h-adaptivity analysis scheme based on multiple scale reproducing kernel particle method was proposed, and two node refinement strategies were constructed using searching-neighbor-nodes(SNN) and local-Delaunay-triangulation(LDT) tech-niques, which were suitable and effective for h-adaptivity analysis on 2-D problems with the regular or irregular distribution of the nodes. The results of multiresolution and h-adaptivity analyses on 2-D linear elastostatics and bending plate problems demonstrate that the improper high-gradient indicator will reduce the convergence property of the h-adaptivity analysis, and that the efficiency of the LDT node refinement strategy is better than SNN, and that the presented h-adaptivity analysis scheme is provided with the validity, stability and good convergence property.

Comparison of debris flow susceptibility assessment methods:support vector machine,particle swarm optimization,and feature selection techniques

The selection of important factors in machine learning-based susceptibility assessments is crucial to obtain reliable susceptibility results.In this study,metaheuristic optimization and feature selection techniques were applied to identify the most important input parameters for mapping debris flow susceptibility in the southern mountain area of Chengde City in Hebei Province,China,by using machine learning algorithms.In total,133 historical debris flow records and 16 related factors were selected.The support vector machine(SVM)was first used as the base classifier,and then a hybrid model was introduced by a two-step process.First,the particle swarm optimization(PSO)algorithm was employed to select the SVM model hyperparameters.Second,two feature selection algorithms,namely principal component analysis(PCA)and PSO,were integrated into the PSO-based SVM model,which generated the PCA-PSO-SVM and FS-PSO-SVM models,respectively.Three statistical metrics(accuracy,recall,and specificity)and the area under the receiver operating characteristic curve(AUC)were employed to evaluate and validate the performance of the models.The results indicated that the feature selection-based models exhibited the best performance,followed by the PSO-based SVM and SVM models.Moreover,the performance of the FS-PSO-SVM model was better than that of the PCA-PSO-SVM model,showing the highest AUC,accuracy,recall,and specificity values in both the training and testing processes.It was found that the selection of optimal features is crucial to improving the reliability of debris flow susceptibility assessment results.Moreover,the PSO algorithm was found to be not only an effective tool for hyperparameter optimization,but also a useful feature selection algorithm to improve prediction accuracies of debris flow susceptibility by using machine learning algorithms.The high and very high debris flow susceptibility zone appropriately covers 38.01%of the study area,where debris flow may occur under intensive human activities and heavy rainfall events.

Stochastic neuro-swarming intelligence paradigm for the analysis of magneto-hydrodynamic Prandtl-Eyring fluid flow with diffusive magnetic layers effect over an elongated surface

In recent years,the integration of stochastic techniques,especially those based on artificial neural networks,has emerged as a pivotal advancement in the field of computational fluid dynamics.These techniques offer a powerful framework for the analysis of complex fluid flow phenomena and address the uncertainties inherent in fluid dynamics systems.Following this trend,the current investigation portrays the design and construction of an important technique named swarming optimized neuroheuristic intelligence with the competency of artificial neural networks to analyze nonlinear viscoelastic magneto-hydrodynamic Prandtl-Eyring fluid flow model,with diffusive magnetic layers effect along an extended sheet.The currently designed computational technique is established using inverse multiquadric radial basis activation function through the hybridization of a well-known global searching technique of particle swarm optimization and sequential quadratic programming,a technique capable of rapid convergence locally.The most appropriate scaling group involved transformations that are implemented on governing equations of the suggested fluidic model to convert it from a system of nonlinear partial differential equations into a dimensionless form of a third-order nonlinear ordinary differential equation.The transformed/reduced fluid flow model is solved for sundry variations of physical quantities using the designed scheme and outcomes are matched consistently with Adam's numerical technique with negligible magnitude of absolute errors and mean square errors.Moreover,it is revealed that the velocity of the fluid depreciates in the presence of a strong magnetic field effect.The efficacy of the designed solver is depicted evidently through rigorous statistical observations via exhaustive numerical experimentation of the fluidic problem.

Determination of the Pile Drivability Using Random Forest Optimized by Particle Swarm Optimization and Bayesian Optimizer

Driven piles are used in many geological environments as a practical and convenient structural component.Hence,the determination of the drivability of piles is actually of great importance in complex geotechnical applications.Conventional methods of predicting pile drivability often rely on simplified physicalmodels or empirical formulas,whichmay lack accuracy or applicability in complex geological conditions.Therefore,this study presents a practical machine learning approach,namely a Random Forest(RF)optimized by Bayesian Optimization(BO)and Particle Swarm Optimization(PSO),which not only enhances prediction accuracy but also better adapts to varying geological environments to predict the drivability parameters of piles(i.e.,maximumcompressive stress,maximum tensile stress,and blow per foot).In addition,support vector regression,extreme gradient boosting,k nearest neighbor,and decision tree are also used and applied for comparison purposes.In order to train and test these models,among the 4072 datasets collected with 17model inputs,3258 datasets were randomly selected for training,and the remaining 814 datasets were used for model testing.Lastly,the results of these models were compared and evaluated using two performance indices,i.e.,the root mean square error(RMSE)and the coefficient of determination(R2).The results indicate that the optimized RF model achieved lower RMSE than other prediction models in predicting the three parameters,specifically 0.044,0.438,and 0.146;and higher R^(2) values than other implemented techniques,specifically 0.966,0.884,and 0.977.In addition,the sensitivity and uncertainty of the optimized RF model were analyzed using Sobol sensitivity analysis and Monte Carlo(MC)simulation.It can be concluded that the optimized RF model could be used to predict the performance of the pile,and it may provide a useful reference for solving some problems under similar engineering conditions.

True-temperature inversion algorithm for a multi-wavelength pyrometer based on fractional-order particle-swarm optimization

Herein,a method of true-temperature inversion for a multi-wavelength pyrometer based on fractional-order particle-swarm optimization is proposed for difficult inversion problems with unknown emissivity.Fractional-order calculus has the inherent advantage of easily jumping out of local extreme values;here,it is introduced into the particle-swarm algorithm to invert the true temperature.An improved adaptive-adjustment mechanism is applied to automatically adjust the current velocity order of the particles and update their velocity and position values,increasing the accuracy of the true temperature values.The results of simulations using the proposed algorithm were compared with three algorithms using typical emissivity models:the internal penalty function algorithm,the optimization function(fmincon)algorithm,and the conventional particle-swarm optimization algorithm.The results show that the proposed algorithm has good accuracy for true-temperature inversion.Actual experimental results from a rocket-motor plume were used to demonstrate that the true-temperature inversion results of this algorithm are in good agreement with the theoretical true-temperature values.