期刊文献+
共找到24篇文章
< 1 2 >
每页显示 20 50 100
Particle Swarm Optimization-Based Hyperparameters Tuning of Machine Learning Models for Big COVID-19 Data Analysis
1
作者 Hend S. Salem Mohamed A. Mead Ghada S. El-Taweel 《Journal of Computer and Communications》 2024年第3期160-183,共24页
Analyzing big data, especially medical data, helps to provide good health care to patients and face the risks of death. The COVID-19 pandemic has had a significant impact on public health worldwide, emphasizing the ne... Analyzing big data, especially medical data, helps to provide good health care to patients and face the risks of death. The COVID-19 pandemic has had a significant impact on public health worldwide, emphasizing the need for effective risk prediction models. Machine learning (ML) techniques have shown promise in analyzing complex data patterns and predicting disease outcomes. The accuracy of these techniques is greatly affected by changing their parameters. Hyperparameter optimization plays a crucial role in improving model performance. In this work, the Particle Swarm Optimization (PSO) algorithm was used to effectively search the hyperparameter space and improve the predictive power of the machine learning models by identifying the optimal hyperparameters that can provide the highest accuracy. A dataset with a variety of clinical and epidemiological characteristics linked to COVID-19 cases was used in this study. Various machine learning models, including Random Forests, Decision Trees, Support Vector Machines, and Neural Networks, were utilized to capture the complex relationships present in the data. To evaluate the predictive performance of the models, the accuracy metric was employed. The experimental findings showed that the suggested method of estimating COVID-19 risk is effective. When compared to baseline models, the optimized machine learning models performed better and produced better results. 展开更多
关键词 Big COVID-19 Data Machine Learning Hyperparameter optimization Particle Swarm optimization Computational Intelligence
下载PDF
Landslide susceptibility mapping(LSM)based on different boosting and hyperparameter optimization algorithms:A case of Wanzhou District,China
2
作者 Deliang Sun Jing Wang +2 位作者 Haijia Wen YueKai Ding Changlin Mi 《Journal of Rock Mechanics and Geotechnical Engineering》 SCIE CSCD 2024年第8期3221-3232,共12页
Boosting algorithms have been widely utilized in the development of landslide susceptibility mapping(LSM)studies.However,these algorithms possess distinct computational strategies and hyperparameters,making it challen... Boosting algorithms have been widely utilized in the development of landslide susceptibility mapping(LSM)studies.However,these algorithms possess distinct computational strategies and hyperparameters,making it challenging to propose an ideal LSM model.To investigate the impact of different boosting algorithms and hyperparameter optimization algorithms on LSM,this study constructed a geospatial database comprising 12 conditioning factors,such as elevation,stratum,and annual average rainfall.The XGBoost(XGB),LightGBM(LGBM),and CatBoost(CB)algorithms were employed to construct the LSM model.Furthermore,the Bayesian optimization(BO),particle swarm optimization(PSO),and Hyperband optimization(HO)algorithms were applied to optimizing the LSM model.The boosting algorithms exhibited varying performances,with CB demonstrating the highest precision,followed by LGBM,and XGB showing poorer precision.Additionally,the hyperparameter optimization algorithms displayed different performances,with HO outperforming PSO and BO showing poorer performance.The HO-CB model achieved the highest precision,boasting an accuracy of 0.764,an F1-score of 0.777,an area under the curve(AUC)value of 0.837 for the training set,and an AUC value of 0.863 for the test set.The model was interpreted using SHapley Additive exPlanations(SHAP),revealing that slope,curvature,topographic wetness index(TWI),degree of relief,and elevation significantly influenced landslides in the study area.This study offers a scientific reference for LSM and disaster prevention research.This study examines the utilization of various boosting algorithms and hyperparameter optimization algorithms in Wanzhou District.It proposes the HO-CB-SHAP framework as an effective approach to accurately forecast landslide disasters and interpret LSM models.However,limitations exist concerning the generalizability of the model and the data processing,which require further exploration in subsequent studies. 展开更多
关键词 Landslide susceptibility Hyperparameter optimization Boosting algorithms SHapley additive exPlanations(SHAP)
下载PDF
Hyperparameter optimization for cardiovascular disease data-driven prognostic system
3
作者 Jayson Saputra Cindy Lawrencya +1 位作者 Jecky Mitra Saini Suharjito Suharjito 《Visual Computing for Industry,Biomedicine,and Art》 EI 2023年第1期218-244,共27页
Prediction and diagnosis of cardiovascular diseases(CVDs)based,among other things,on medical examinations and patient symptoms are the biggest challenges in medicine.About 17.9 million people die from CVDs annually,ac... Prediction and diagnosis of cardiovascular diseases(CVDs)based,among other things,on medical examinations and patient symptoms are the biggest challenges in medicine.About 17.9 million people die from CVDs annually,accounting for 31%of all deaths worldwide.With a timely prognosis and thorough consideration of the patient’s medical history and lifestyle,it is possible to predict CVDs and take preventive measures to eliminate or control this life-threatening disease.In this study,we used various patient datasets from a major hospital in the United States as prognostic factors for CVD.The data was obtained by monitoring a total of 918 patients whose criteria for adults were 28-77 years old.In this study,we present a data mining modeling approach to analyze the performance,classification accuracy and number of clusters on Cardiovascular Disease Prognostic datasets in unsupervised machine learning(ML)using the Orange data mining software.Various techniques are then used to classify the model parameters,such as k-nearest neighbors,support vector machine,random forest,artificial neural network(ANN),naïve bayes,logistic regression,stochastic gradient descent(SGD),and AdaBoost.To determine the number of clusters,various unsupervised ML clustering methods were used,such as k-means,hierarchical,and density-based spatial clustering of applications with noise clustering.The results showed that the best model performance analysis and classification accuracy were SGD and ANN,both of which had a high score of 0.900 on Cardiovascular Disease Prognostic datasets.Based on the results of most clustering methods,such as k-means and hierarchical clustering,Cardiovascular Disease Prognostic datasets can be divided into two clusters.The prognostic accuracy of CVD depends on the accuracy of the proposed model in determining the diagnostic model.The more accurate the model,the better it can predict which patients are at risk for CVD. 展开更多
关键词 Cardiovascular disease Data-driven analytics Data mining Hyperparameter optimization Orange data mining software Prognostic system Unsupervised machine learning
下载PDF
Jellyfish Search Optimization with Deep Learning Driven Autism Spectrum Disorder Classification
4
作者 S.Rama Sree Inderjeet Kaur +5 位作者 Alexey Tikhonov E.Laxmi Lydia Ahmed A.Thabit Zahraa H.Kareem Yousif Kerrar Yousif Ahmed Alkhayyat 《Computers, Materials & Continua》 SCIE EI 2023年第1期2195-2209,共15页
Autism spectrum disorder(ASD)is regarded as a neurological disorder well-defined by a specific set of problems associated with social skills,recurrent conduct,and communication.Identifying ASD as soon as possible is f... Autism spectrum disorder(ASD)is regarded as a neurological disorder well-defined by a specific set of problems associated with social skills,recurrent conduct,and communication.Identifying ASD as soon as possible is favourable due to prior identification of ASD permits prompt interferences in children with ASD.Recognition of ASD related to objective pathogenicmutation screening is the initial step against prior intervention and efficient treatment of children who were affected.Nowadays,healthcare and machine learning(ML)industries are combined for determining the existence of various diseases.This article devises a Jellyfish Search Optimization with Deep Learning Driven ASD Detection and Classification(JSODL-ASDDC)model.The goal of the JSODL-ASDDC algorithm is to identify the different stages of ASD with the help of biomedical data.The proposed JSODLASDDC model initially performs min-max data normalization approach to scale the data into uniform range.In addition,the JSODL-ASDDC model involves JSO based feature selection(JFSO-FS)process to choose optimal feature subsets.Moreover,Gated Recurrent Unit(GRU)based classification model is utilized for the recognition and classification of ASD.Furthermore,the Bacterial Foraging Optimization(BFO)assisted parameter tuning process gets executed to enhance the efficacy of the GRU system.The experimental assessment of the JSODL-ASDDC model is investigated against distinct datasets.The experimental outcomes highlighted the enhanced performances of the JSODL-ASDDC algorithm over recent approaches. 展开更多
关键词 Autism spectral disorder biomedical data deep learning feature selection hyperparameter optimization data classification machine learning
下载PDF
Earthworm Optimization with Improved SqueezeNet Enabled Facial Expression Recognition Model
5
作者 N.Sharmili Saud Yonbawi +5 位作者 Sultan Alahmari E.Laxmi Lydia Mohamad Khairi Ishak Hend Khalid Alkahtani Ayman Aljarbouh Samih M.Mostafa 《Computer Systems Science & Engineering》 SCIE EI 2023年第8期2247-2262,共16页
Facial expression recognition(FER)remains a hot research area among computer vision researchers and still becomes a challenge because of high intraclass variations.Conventional techniques for this problem depend on ha... Facial expression recognition(FER)remains a hot research area among computer vision researchers and still becomes a challenge because of high intraclass variations.Conventional techniques for this problem depend on hand-crafted features,namely,LBP,SIFT,and HOG,along with that a classifier trained on a database of videos or images.Many execute perform well on image datasets captured in a controlled condition;however not perform well in the more challenging dataset,which has partial faces and image variation.Recently,many studies presented an endwise structure for facial expression recognition by utilizing DL methods.Therefore,this study develops an earthworm optimization with an improved SqueezeNet-based FER(EWOISN-FER)model.The presented EWOISN-FER model primarily applies the contrast-limited adaptive histogram equalization(CLAHE)technique as a pre-processing step.In addition,the improved SqueezeNet model is exploited to derive an optimal set of feature vectors,and the hyperparameter tuning process is performed by the stochastic gradient boosting(SGB)model.Finally,EWO with sparse autoencoder(SAE)is employed for the FER process,and the EWO algorithm appropriately chooses the SAE parameters.Awide-ranging experimental analysis is carried out to examine the performance of the proposed model.The experimental outcomes indicate the supremacy of the presented EWOISN-FER technique. 展开更多
关键词 Facial expression recognition deep learning computer vision earthworm optimization hyperparameter optimization
下载PDF
Hyperparameter Optimization for Capsule Network Based Modified Hybrid Rice Optimization Algorithm
6
作者 Zhiwei Ye Ziqian Fang +4 位作者 Zhina Song Haigang Sui Chunyan Yan Wen Zhou Mingwei Wang 《Intelligent Automation & Soft Computing》 SCIE 2023年第8期2019-2035,共17页
Hyperparameters play a vital impact in the performance of most machine learning algorithms.It is a challenge for traditional methods to con-figure hyperparameters of the capsule network to obtain high-performance manu... Hyperparameters play a vital impact in the performance of most machine learning algorithms.It is a challenge for traditional methods to con-figure hyperparameters of the capsule network to obtain high-performance manually.Some swarm intelligence or evolutionary computation algorithms have been effectively employed to seek optimal hyperparameters as a com-binatorial optimization problem.However,these algorithms are prone to get trapped in the local optimal solution as random search strategies are adopted.The inspiration for the hybrid rice optimization(HRO)algorithm is from the breeding technology of three-line hybrid rice in China,which has the advantages of easy implementation,less parameters and fast convergence.In the paper,genetic search is combined with the hybrid rice optimization algorithm(GHRO)and employed to obtain the optimal hyperparameter of the capsule network automatically,that is,a probability search technique and a hybridization strategy belong with the primary HRO.Thirteen benchmark functions are used to evaluate the performance of GHRO.Furthermore,the MNIST,Chest X-Ray(pneumonia),and Chest X-Ray(COVID-19&pneumonia)datasets are also utilized to evaluate the capsule network learnt by GHRO.The experimental results show that GHRO is an effective method for optimizing the hyperparameters of the capsule network,which is able to boost the performance of the capsule network on image classification. 展开更多
关键词 Hyperparameter optimization hybrid rice optimization algorithm genetic algorithm capsule network image classification
下载PDF
Neural network hyperparameter optimization based on improved particle swarm optimization
7
作者 谢晓燕 HE Wanqi +1 位作者 ZHU Yun YU Jinhao 《High Technology Letters》 EI CAS 2023年第4期427-433,共7页
Hyperparameter optimization is considered as one of the most challenges in deep learning and dominates the precision of model in a certain.Recent proposals tried to solve this issue through the particle swarm optimiza... Hyperparameter optimization is considered as one of the most challenges in deep learning and dominates the precision of model in a certain.Recent proposals tried to solve this issue through the particle swarm optimization(PSO),but its native defect may result in the local optima trapped and convergence difficulty.In this paper,the genetic operations are introduced to the PSO,which makes the best hyperparameter combination scheme for specific network architecture be located easier.Spe-cifically,to prevent the troubles caused by the different data types and value scopes,a mixed coding method is used to ensure the effectiveness of particles.Moreover,the crossover and mutation opera-tions are added to the process of particles updating,to increase the diversity of particles and avoid local optima in searching.Verified with three benchmark datasets,MNIST,Fashion-MNIST,and CIFAR10,it is demonstrated that the proposed scheme can achieve accuracies of 99.58%,93.39%,and 78.96%,respectively,improving the accuracy by about 0.1%,0.5%,and 2%,respectively,compared with that of the PSO. 展开更多
关键词 hyperparameter optimization particle swarm optimization(PSO)algorithm neu-ral network
下载PDF
Comparison of Two Recurrent Neural Networks for Rainfall-Runoff Modeling in the Zou River Basin at Atchérigbé (Bénin)
8
作者 Iboukoun Eliézer Biao Oscar Houessou +1 位作者 Pierre Jérôme Zohou Adéchina Eric Alamou 《Journal of Geoscience and Environment Protection》 2024年第9期167-181,共15页
Hydrological models are developed to simulate river flows over a watershed for many practical applications in the field of water resource management. The present paper compares the performance of two recurrent neural ... Hydrological models are developed to simulate river flows over a watershed for many practical applications in the field of water resource management. The present paper compares the performance of two recurrent neural networks for rainfall-runoff modeling in the Zou River basin at Atchérigbé outlet. To this end, we used daily precipitation data over the period 1988-2010 as input of the models, such as the Long Short-Term Memory (LSTM) and Recurrent Gate Networks (GRU) to simulate river discharge in the study area. The investigated models give good results in calibration (R2 = 0.888, NSE = 0.886, and RMSE = 0.42 for LSTM;R2 = 0.9, NSE = 0.9 and RMSE = 0.397 for GRU) and in validation (R2 = 0.865, NSE = 0.851, and RMSE = 0.329 for LSTM;R2 = 0.9, NSE = 0.865 and RMSE = 0.301 for GRU). This good performance of LSTM and GRU models confirms the importance of models based on machine learning in modeling hydrological phenomena for better decision-making. 展开更多
关键词 Supervised Learning Modeling Zou Basin Long and Short-Term Memory Gated Recurrent Unit hyperparameters optimization
下载PDF
An Efficient Modelling of Oversampling with Optimal Deep Learning Enabled Anomaly Detection in Streaming Data
9
作者 R.Rajakumar S.Sathiya Devi 《China Communications》 SCIE CSCD 2024年第5期249-260,共12页
Recently,anomaly detection(AD)in streaming data gained significant attention among research communities due to its applicability in finance,business,healthcare,education,etc.The recent developments of deep learning(DL... Recently,anomaly detection(AD)in streaming data gained significant attention among research communities due to its applicability in finance,business,healthcare,education,etc.The recent developments of deep learning(DL)models find helpful in the detection and classification of anomalies.This article designs an oversampling with an optimal deep learning-based streaming data classification(OS-ODLSDC)model.The aim of the OSODLSDC model is to recognize and classify the presence of anomalies in the streaming data.The proposed OS-ODLSDC model initially undergoes preprocessing step.Since streaming data is unbalanced,support vector machine(SVM)-Synthetic Minority Over-sampling Technique(SVM-SMOTE)is applied for oversampling process.Besides,the OS-ODLSDC model employs bidirectional long short-term memory(Bi LSTM)for AD and classification.Finally,the root means square propagation(RMSProp)optimizer is applied for optimal hyperparameter tuning of the Bi LSTM model.For ensuring the promising performance of the OS-ODLSDC model,a wide-ranging experimental analysis is performed using three benchmark datasets such as CICIDS 2018,KDD-Cup 1999,and NSL-KDD datasets. 展开更多
关键词 anomaly detection deep learning hyperparameter optimization OVERSAMPLING SMOTE streaming data
下载PDF
An Enhanced Ensemble-Based Long Short-Term Memory Approach for Traffic Volume Prediction
10
作者 Duy Quang Tran Huy Q.Tran Minh Van Nguyen 《Computers, Materials & Continua》 SCIE EI 2024年第3期3585-3602,共18页
With the advancement of artificial intelligence,traffic forecasting is gaining more and more interest in optimizing route planning and enhancing service quality.Traffic volume is an influential parameter for planning ... With the advancement of artificial intelligence,traffic forecasting is gaining more and more interest in optimizing route planning and enhancing service quality.Traffic volume is an influential parameter for planning and operating traffic structures.This study proposed an improved ensemble-based deep learning method to solve traffic volume prediction problems.A set of optimal hyperparameters is also applied for the suggested approach to improve the performance of the learning process.The fusion of these methodologies aims to harness ensemble empirical mode decomposition’s capacity to discern complex traffic patterns and long short-term memory’s proficiency in learning temporal relationships.Firstly,a dataset for automatic vehicle identification is obtained and utilized in the preprocessing stage of the ensemble empirical mode decomposition model.The second aspect involves predicting traffic volume using the long short-term memory algorithm.Next,the study employs a trial-and-error approach to select a set of optimal hyperparameters,including the lookback window,the number of neurons in the hidden layers,and the gradient descent optimization.Finally,the fusion of the obtained results leads to a final traffic volume prediction.The experimental results show that the proposed method outperforms other benchmarks regarding various evaluation measures,including mean absolute error,root mean squared error,mean absolute percentage error,and R-squared.The achieved R-squared value reaches an impressive 98%,while the other evaluation indices surpass the competing.These findings highlight the accuracy of traffic pattern prediction.Consequently,this offers promising prospects for enhancing transportation management systems and urban infrastructure planning. 展开更多
关键词 Ensemble empirical mode decomposition traffic volume prediction long short-term memory optimal hyperparameters deep learning
下载PDF
Hunger Search Optimization with Hybrid Deep Learning Enabled Phishing Detection and Classification Model
11
作者 Hadil Shaiba Jaber S.Alzahrani +3 位作者 Majdy M.Eltahir Radwa Marzouk Heba Mohsen Manar Ahmed Hamza 《Computers, Materials & Continua》 SCIE EI 2022年第12期6425-6441,共17页
Phishing is one of the simplest ways in cybercrime to hack the reliable data of users such as passwords,account identifiers,bank details,etc.In general,these kinds of cyberattacks are made at users through phone calls... Phishing is one of the simplest ways in cybercrime to hack the reliable data of users such as passwords,account identifiers,bank details,etc.In general,these kinds of cyberattacks are made at users through phone calls,emails,or instant messages.The anti-phishing techniques,currently under use,aremainly based on source code features that need to scrape the webpage content.In third party services,these techniques check the classification procedure of phishing Uniform Resource Locators(URLs).Even thoughMachine Learning(ML)techniques have been lately utilized in the identification of phishing,they still need to undergo feature engineering since the techniques are not well-versed in identifying phishing offenses.The tremendous growth and evolution of Deep Learning(DL)techniques paved the way for increasing the accuracy of classification process.In this background,the current research article presents a Hunger Search Optimization with Hybrid Deep Learning enabled Phishing Detection and Classification(HSOHDL-PDC)model.The presented HSOHDL-PDC model focuses on effective recognition and classification of phishing based on website URLs.In addition,SOHDL-PDC model uses character-level embedding instead of word-level embedding since the URLs generally utilize words with no importance.Moreover,a hybrid Convolutional Neural Network-Long Short Term Memory(HCNN-LSTM)technique is also applied for identification and classification of phishing.The hyperparameters involved in HCNN-LSTM model are optimized with the help of HSO algorithm which in turn produced improved outcomes.The performance of the proposed HSOHDL-PDC model was validated using different datasets and the outcomes confirmed the supremacy of the proposed model over other recent approaches. 展开更多
关键词 Uniform resource locators PHISHING cyberattacks machine learning deep learning hyperparameter optimization
下载PDF
Optimal Hybrid Deep Learning Enabled Attack Detection and Classificationin IoT Environment
12
作者 Fahad F.Alruwaili 《Computers, Materials & Continua》 SCIE EI 2023年第4期99-115,共17页
The Internet of Things (IoT) paradigm enables end users to accessnetworking services amongst diverse kinds of electronic devices. IoT securitymechanism is a technology that concentrates on safeguarding the devicesand ... The Internet of Things (IoT) paradigm enables end users to accessnetworking services amongst diverse kinds of electronic devices. IoT securitymechanism is a technology that concentrates on safeguarding the devicesand networks connected in the IoT environment. In recent years, False DataInjection Attacks (FDIAs) have gained considerable interest in the IoT environment.Cybercriminals compromise the devices connected to the networkand inject the data. Such attacks on the IoT environment can result in a considerableloss and interrupt normal activities among the IoT network devices.The FDI attacks have been effectively overcome so far by conventional threatdetection techniques. The current research article develops a Hybrid DeepLearning to Combat Sophisticated False Data Injection Attacks detection(HDL-FDIAD) for the IoT environment. The presented HDL-FDIAD modelmajorly recognizes the presence of FDI attacks in the IoT environment.The HDL-FDIAD model exploits the Equilibrium Optimizer-based FeatureSelection (EO-FS) technique to select the optimal subset of the features.Moreover, the Long Short Term Memory with Recurrent Neural Network(LSTM-RNN) model is also utilized for the purpose of classification. At last,the Bayesian Optimization (BO) algorithm is employed as a hyperparameteroptimizer in this study. To validate the enhanced performance of the HDLFDIADmodel, a wide range of simulations was conducted, and the resultswere investigated in detail. A comparative study was conducted between theproposed model and the existing models. The outcomes revealed that theproposed HDL-FDIAD model is superior to other models. 展开更多
关键词 False data injection attacks hyperparameter optimizer deep learning feature selection IOT SECURITY
下载PDF
Optimal Deep Transfer Learning Based Colorectal Cancer Detection and Classification Model
13
作者 Mahmoud Ragab Maged Mostafa Mahmoud +2 位作者 Amer H.Asseri Hani Choudhry Haitham A.Yacoub 《Computers, Materials & Continua》 SCIE EI 2023年第2期3279-3295,共17页
Colorectal carcinoma(CRC)is one such dispersed cancer globally and also prominent one in causing cancer-based death.Conventionally,pathologists execute CRC diagnosis through visible scrutinizing under the microscope t... Colorectal carcinoma(CRC)is one such dispersed cancer globally and also prominent one in causing cancer-based death.Conventionally,pathologists execute CRC diagnosis through visible scrutinizing under the microscope the resected tissue samples,stained and fixed through Haematoxylin and Eosin(H&E).The advancement of graphical processing systems has resulted in high potentiality for deep learning(DL)techniques in interpretating visual anatomy from high resolution medical images.This study develops a slime mould algorithm with deep transfer learning enabled colorectal cancer detection and classification(SMADTL-CCDC)algorithm.The presented SMADTL-CCDC technique intends to appropriately recognize the occurrence of colorectal cancer.To accomplish this,the SMADTLCCDC model initially undergoes pre-processing to improve the input image quality.In addition,a dense-EfficientNet technique was employed to extract feature vectors from the pre-processed images.Moreover,SMA with Discrete Hopfield neural network(DHNN)method was applied for the recognition and classification of colorectal cancer.The utilization of SMA assists in appropriately selecting the parameters involved in the DHNN approach.A wide range of experiments was implemented on benchmark datasets to assess the classification performance.A comprehensive comparative study highlighted the better performance of the SMADTL-CDC model over the recent approaches. 展开更多
关键词 Colorectal cancer deep transfer learning slime mould algorithm hyperparameter optimization biomedical imaging
下载PDF
Artificial Intelligence in Internet of Things System for Predicting Water Quality in Aquaculture Fishponds
14
作者 Po-Yuan Yang Yu-Cheng Liao Fu-I Chou 《Computer Systems Science & Engineering》 SCIE EI 2023年第9期2861-2880,共20页
Aquaculture has long been a critical economic sector in Taiwan.Since a key factor in aquaculture production efficiency is water quality,an effective means of monitoring the dissolved oxygen content(DOC)of aquaculture ... Aquaculture has long been a critical economic sector in Taiwan.Since a key factor in aquaculture production efficiency is water quality,an effective means of monitoring the dissolved oxygen content(DOC)of aquaculture water is essential.This study developed an internet of things system for monitoring DOC by collecting essential data related to water quality.Artificial intelligence technology was used to construct a water quality prediction model for use in a complete system for managing water quality.Since aquaculture water quality depends on a continuous interaction among multiple factors,and the current state is correlated with the previous state,a model with time series is required.Therefore,this study used recurrent neural networks(RNNs)with sequential characteristics.Commonly used RNNs such as long short-term memory model and gated recurrent unit(GRU)model have a memory function that appropriately retains previous results for use in processing current results.To construct a suitable RNN model,this study used Taguchi method to optimize hyperparameters(including hidden layer neuron count,iteration count,batch size,learning rate,and dropout ratio).Additionally,optimization performance was also compared between 5-layer and 7-layer network architectures.The experimental results revealed that the 7-layer GRU was more suitable for the application considered in this study.The values obtained in tests of prediction performance were mean absolute percentage error of 3.7134%,root mean square error of 0.0638,and R-value of 0.9984.Therefore,thewater qualitymanagement system developed in this study can quickly provide practitioners with highly accurate data,which is essential for a timely response to water quality issues.This study was performed in collaboration with the Taiwan Industrial Technology Research Institute and a local fishery company.Practical application of the system by the fishery company confirmed that the monitoring system is effective in improving the survival rate of farmed fish by providing data needed to maintain DOC higher than the standard value. 展开更多
关键词 FISHERY gated recurrent unit hyperparameter optimization long short-term memory Taguchi method water quality prediction
下载PDF
Hybrid Convolutional Neural Network and Long Short-Term Memory Approach for Facial Expression Recognition
15
作者 M.N.Kavitha A.RajivKannan 《Intelligent Automation & Soft Computing》 SCIE 2023年第1期689-704,共16页
Facial Expression Recognition(FER)has been an importantfield of research for several decades.Extraction of emotional characteristics is crucial to FERs,but is complex to process as they have significant intra-class va... Facial Expression Recognition(FER)has been an importantfield of research for several decades.Extraction of emotional characteristics is crucial to FERs,but is complex to process as they have significant intra-class variances.Facial characteristics have not been completely explored in static pictures.Previous studies used Convolution Neural Networks(CNNs)based on transfer learning and hyperparameter optimizations for static facial emotional recognitions.Particle Swarm Optimizations(PSOs)have also been used for tuning hyperparameters.However,these methods achieve about 92 percent in terms of accuracy.The existing algorithms have issues with FER accuracy and precision.Hence,the overall FER performance is degraded significantly.To address this issue,this work proposes a combination of CNNs and Long Short-Term Memories(LSTMs)called the HCNN-LSTMs(Hybrid CNNs and LSTMs)approach for FERs.The work is evaluated on the benchmark dataset,Facial Expression Recog Image Ver(FERC).Viola-Jones(VJ)algorithms recognize faces from preprocessed images followed by HCNN-LSTMs feature extractions and FER classifications.Further,the success rate of Deep Learning Techniques(DLTs)has increased with hyperparameter tunings like epochs,batch sizes,initial learning rates,regularization parameters,shuffling types,and momentum.This proposed work uses Improved Weight based Whale Optimization Algorithms(IWWOAs)to select near-optimal settings for these parameters using bestfitness values.The experi-mentalfindings demonstrated that the proposed HCNN-LSTMs system outper-forms the existing methods. 展开更多
关键词 Facial expression recognition Gaussianfilter hyperparameter optimization improved weight-based whale optimization algorithm deep learning(DL)
下载PDF
A benchmark-based method for evaluating hyperparameter optimization techniques of neural networks for surface water quality prediction
16
作者 Xuan Wang Yan Dong +2 位作者 Jing Yang Zhipeng Liu Jinsuo Lu 《Frontiers of Environmental Science & Engineering》 SCIE EI CSCD 2024年第5期13-27,共15页
Neural networks(NNs)have been used extensively in surface water prediction tasks due to computing algorithm improvements and data accumulation.An essential step in developing an NN is the hyperparameter selection.In p... Neural networks(NNs)have been used extensively in surface water prediction tasks due to computing algorithm improvements and data accumulation.An essential step in developing an NN is the hyperparameter selection.In practice,it is common to manually determine hyperparameters in the studies of NNs in water resources tasks.This may result in considerable randomness and require significant computation time;therefore,hyperparameter optimization(HPO)is essential.This study adopted five representatives of the HPO techniques in the surface water quality prediction tasks,including the grid sampling(GS),random search(RS),genetic algorithm(GA),Bayesian optimization(BO)based on the Gaussian process(GP),and the tree Parzen estimator(TPE).For the evaluation of these techniques,this study proposed a method:first,the optimal hyperparameter value sets achieved by GS were regarded as the benchmark;then,the other HPO techniques were evaluated and compared with the benchmark in convergence,optimization orientation,and consistency of the optimized values.The results indicated that the TPE-based BO algorithm was recommended because it yielded stable convergence,reasonable optimization orientation,and the highest consistency rates with the benchmark values.The optimization consistency rates via TPE for the hyperparameters hidden layers,hidden dimension,learning rate,and batch size were 86.7%,73.3%,73.3%,and 80.0%,respectively.Unlike the evaluation of HPO techniques directly based on the prediction performance of the optimized NN in a single HPO test,the proposed benchmark-based HPO evaluation approach is feasible and robust. 展开更多
关键词 Neural networks Hyperparameter optimization Surface water quality prediction Bayes optimization Genetic algorithm
原文传递
Improving Prediction Efficiency of Machine Learning Models for Cardiovascular Disease in IoST-Based Systems through Hyperparameter Optimization
17
作者 Tajim Md.Niamat Ullah Akhund Waleed M.Al-Nuwaiser 《Computers, Materials & Continua》 SCIE EI 2024年第9期3485-3506,共22页
This study explores the impact of hyperparameter optimization on machine learning models for predicting cardiovascular disease using data from an IoST(Internet of Sensing Things)device.Ten distinct machine learning ap... This study explores the impact of hyperparameter optimization on machine learning models for predicting cardiovascular disease using data from an IoST(Internet of Sensing Things)device.Ten distinct machine learning approaches were implemented and systematically evaluated before and after hyperparameter tuning.Significant improvements were observed across various models,with SVM and Neural Networks consistently showing enhanced performance metrics such as F1-Score,recall,and precision.The study underscores the critical role of tailored hyperparameter tuning in optimizing these models,revealing diverse outcomes among algorithms.Decision Trees and Random Forests exhibited stable performance throughout the evaluation.While enhancing accuracy,hyperparameter optimization also led to increased execution time.Visual representations and comprehensive results support the findings,confirming the hypothesis that optimizing parameters can effectively enhance predictive capabilities in cardiovascular disease.This research contributes to advancing the understanding and application of machine learning in healthcare,particularly in improving predictive accuracy for cardiovascular disease management and intervention strategies. 展开更多
关键词 Internet of sensing things(IoST) machine learning hyperparameter optimization cardiovascular disease prediction execution time analysis performance analysis wilcoxon signed-rank test
下载PDF
Comparison of machine learning methods for ground settlement prediction with different tunneling datasets 被引量:10
18
作者 Libin Tang SeonHong Na 《Journal of Rock Mechanics and Geotechnical Engineering》 SCIE CSCD 2021年第6期1274-1289,共16页
This study integrates different machine learning(ML) methods and 5-fold cross-validation(CV) method to estimate the ground maximal surface settlement(MSS) induced by tunneling.We further investigate the applicability ... This study integrates different machine learning(ML) methods and 5-fold cross-validation(CV) method to estimate the ground maximal surface settlement(MSS) induced by tunneling.We further investigate the applicability of artificial intelligent(AI) based prediction through a comparative study of two tunnelling datasets with different sizes and features.Four different ML approaches,including support vector machine(SVM),random forest(RF),back-propagation neural network(BPNN),and deep neural network(DNN),are utilized.Two techniques,i.e.particle swarm optimization(PSO) and grid search(GS)methods,are adopted for hyperparameter optimization.To assess the reliability and efficiency of the predictions,three performance evaluation indicators,including the mean absolute error(MAE),root mean square error(RMSE),and Pearson correlation coefficient(R),are calculated.Our results indicate that proposed models can accurately and efficiently predict the settlement,while the RF model outperforms the other three methods on both datasets.The difference in model performance on two datasets(Datasets A and B) reveals the importance of data quality and quantity.Sensitivity analysis indicates that Dataset A is more significantly affected by geological conditions,while geometric characteristics play a more dominant role on Dataset B. 展开更多
关键词 Surface settlement Tunnel construction Machine learning(ML) Hyperparameter optimization Cross-validation(CV)
下载PDF
Ensembles of Deep Learning Framework for Stomach Abnormalities Classification 被引量:2
19
作者 Talha Saeed Chu Kiong Loo Muhammad Shahreeza Safiruz Kassim 《Computers, Materials & Continua》 SCIE EI 2022年第3期4357-4372,共16页
Abnormalities of the gastrointestinal tract are widespread worldwide today.Generally,an effective way to diagnose these life-threatening diseases is based on endoscopy,which comprises a vast number of images.However,t... Abnormalities of the gastrointestinal tract are widespread worldwide today.Generally,an effective way to diagnose these life-threatening diseases is based on endoscopy,which comprises a vast number of images.However,the main challenge in this area is that the process is time-consuming and fatiguing for a gastroenterologist to examine every image in the set.Thus,this led to the rise of studies on designingAI-based systems to assist physicians in the diagnosis.In several medical imaging tasks,deep learning methods,especially convolutional neural networks(CNNs),have contributed to the stateof-the-art outcomes,where the complicated nonlinear relation between target classes and data can be learned and not limit to hand-crafted features.On the other hand,hyperparameters are commonly set manually,which may take a long time and leave the risk of non-optimal hyperparameters for classification.An effective tool for tuning optimal hyperparameters of deep CNNis Bayesian optimization.However,due to the complexity of the CNN,the network can be regarded as a black-box model where the information stored within it is hard to interpret.Hence,Explainable Artificial Intelligence(XAI)techniques are applied to overcome this issue by interpreting the decisions of the CNNs in such wise the physicians can trust.To play an essential role in real-time medical diagnosis,CNN-based models need to be accurate and interpretable,while the uncertainty must be handled.Therefore,a novel method comprising of three phases is proposed to classify these life-threatening diseases.At first,hyperparameter tuning is performed using Bayesian optimization for two state-of-the-art deep CNNs,and then Darknet53 and InceptionV3 features are extracted from these fine-tunned models.Secondly,XAI techniques are used to interpret which part of the images CNN takes for feature extraction.At last,the features are fused,and uncertainties are handled by selecting entropybased features.The experimental results show that the proposed method outperforms existing methods by achieving an accuracy of 97%based on a Bayesian optimized Support Vector Machine classifier. 展开更多
关键词 Gastrointestinal tract deep learning Bayesian optimization hyperparameters explainable AI uncertainty handling feature fusion
下载PDF
Hyperparameter Tuned Deep Learning Enabled Cyberbullying Classification in Social Media 被引量:1
20
作者 Mesfer Al Duhayyim Heba G.Mohamed +5 位作者 Saud S.Alotaibi Hany Mahgoub Abdullah Mohamed Abdelwahed Motwakel Abu Sarwar Zamani Mohamed I.Eldesouki 《Computers, Materials & Continua》 SCIE EI 2022年第12期5011-5024,共14页
Cyberbullying(CB)is a challenging issue in social media and it becomes important to effectively identify the occurrence of CB.The recently developed deep learning(DL)models pave the way to design CB classifier models ... Cyberbullying(CB)is a challenging issue in social media and it becomes important to effectively identify the occurrence of CB.The recently developed deep learning(DL)models pave the way to design CB classifier models with maximum performance.At the same time,optimal hyperparameter tuning process plays a vital role to enhance overall results.This study introduces a Teacher Learning Genetic Optimization with Deep Learning Enabled Cyberbullying Classification(TLGODL-CBC)model in Social Media.The proposed TLGODL-CBC model intends to identify the existence and non-existence of CB in social media context.Initially,the input data is cleaned and pre-processed to make it compatible for further processing.Followed by,independent recurrent autoencoder(IRAE)model is utilized for the recognition and classification of CBs.Finally,the TLGO algorithm is used to optimally adjust the parameters related to the IRAE model and shows the novelty of the work.To assuring the improved outcomes of the TLGODLCBC approach,a wide range of simulations are executed and the outcomes are investigated under several aspects.The simulation outcomes make sure the improvements of the TLGODL-CBC model over recent approaches. 展开更多
关键词 Social media deep learning CYBERBULLYING CYBERSECURITY hyperparameter optimization
下载PDF
上一页 1 2 下一页 到第
使用帮助 返回顶部