In order to directly construct the mapping between multiple state parameters and remaining useful life(RUL),and reduce the interference of random error on prediction accuracy,a RUL prediction model of aeroengine based...In order to directly construct the mapping between multiple state parameters and remaining useful life(RUL),and reduce the interference of random error on prediction accuracy,a RUL prediction model of aeroengine based on principal component analysis(PCA)and one-dimensional convolution neural network(1D-CNN)is proposed in this paper.Firstly,multiple state parameters corresponding to massive cycles of aeroengine are collected and brought into PCA for dimensionality reduction,and principal components are extracted for further time series prediction.Secondly,the 1D-CNN model is constructed to directly study the mapping between principal components and RUL.Multiple convolution and pooling operations are applied for deep feature extraction,and the end-to-end RUL prediction of aeroengine can be realized.Experimental results show that the most effective principal component from the multiple state parameters can be obtained by PCA,and the long time series of multiple state parameters can be directly mapped to RUL by 1D-CNN,so as to improve the efficiency and accuracy of RUL prediction.Compared with other traditional models,the proposed method also has lower prediction error and better robustness.展开更多
In recent years,wearable devices-based Human Activity Recognition(HAR)models have received significant attention.Previously developed HAR models use hand-crafted features to recognize human activities,leading to the e...In recent years,wearable devices-based Human Activity Recognition(HAR)models have received significant attention.Previously developed HAR models use hand-crafted features to recognize human activities,leading to the extraction of basic features.The images captured by wearable sensors contain advanced features,allowing them to be analyzed by deep learning algorithms to enhance the detection and recognition of human actions.Poor lighting and limited sensor capabilities can impact data quality,making the recognition of human actions a challenging task.The unimodal-based HAR approaches are not suitable in a real-time environment.Therefore,an updated HAR model is developed using multiple types of data and an advanced deep-learning approach.Firstly,the required signals and sensor data are accumulated from the standard databases.From these signals,the wave features are retrieved.Then the extracted wave features and sensor data are given as the input to recognize the human activity.An Adaptive Hybrid Deep Attentive Network(AHDAN)is developed by incorporating a“1D Convolutional Neural Network(1DCNN)”with a“Gated Recurrent Unit(GRU)”for the human activity recognition process.Additionally,the Enhanced Archerfish Hunting Optimizer(EAHO)is suggested to fine-tune the network parameters for enhancing the recognition process.An experimental evaluation is performed on various deep learning networks and heuristic algorithms to confirm the effectiveness of the proposed HAR model.The EAHO-based HAR model outperforms traditional deep learning networks with an accuracy of 95.36,95.25 for recall,95.48 for specificity,and 95.47 for precision,respectively.The result proved that the developed model is effective in recognizing human action by taking less time.Additionally,it reduces the computation complexity and overfitting issue through using an optimization approach.展开更多
Audiovisual speech recognition is an emerging research topic.Lipreading is the recognition of what someone is saying using visual information,primarily lip movements.In this study,we created a custom dataset for India...Audiovisual speech recognition is an emerging research topic.Lipreading is the recognition of what someone is saying using visual information,primarily lip movements.In this study,we created a custom dataset for Indian English linguistics and categorized it into three main categories:(1)audio recognition,(2)visual feature extraction,and(3)combined audio and visual recognition.Audio features were extracted using the mel-frequency cepstral coefficient,and classification was performed using a one-dimension convolutional neural network.Visual feature extraction uses Dlib and then classifies visual speech using a long short-term memory type of recurrent neural networks.Finally,integration was performed using a deep convolutional network.The audio speech of Indian English was successfully recognized with accuracies of 93.67%and 91.53%,respectively,using testing data from 200 epochs.The training accuracy for visual speech recognition using the Indian English dataset was 77.48%and the test accuracy was 76.19%using 60 epochs.After integration,the accuracies of audiovisual speech recognition using the Indian English dataset for training and testing were 94.67%and 91.75%,respectively.展开更多
In order to reduce the risk of non-performing loans, losses, and improve the loan approval efficiency, it is necessary to establish an intelligent loan risk and approval prediction system. A hybrid deep learning model...In order to reduce the risk of non-performing loans, losses, and improve the loan approval efficiency, it is necessary to establish an intelligent loan risk and approval prediction system. A hybrid deep learning model with 1DCNN-attention network and the enhanced preprocessing techniques is proposed for loan approval prediction. Our proposed model consists of the enhanced data preprocessing and stacking of multiple hybrid modules. Initially, the enhanced data preprocessing techniques using a combination of methods such as standardization, SMOTE oversampling, feature construction, recursive feature elimination (RFE), information value (IV) and principal component analysis (PCA), which not only eliminates the effects of data jitter and non-equilibrium, but also removes redundant features while improving the representation of features. Subsequently, a hybrid module that combines a 1DCNN with an attention mechanism is proposed to extract local and global spatio-temporal features. Finally, the comprehensive experiments conducted validate that the proposed model surpasses state-of-the-art baseline models across various performance metrics, including accuracy, precision, recall, F1 score, and AUC. Our proposed model helps to automate the loan approval process and provides scientific guidance to financial institutions for loan risk control.展开更多
The accurate and efficient prediction of explosive detonation properties has important engineering significance for weapon design.Traditional methods for predicting detonation performance include empirical formulas,eq...The accurate and efficient prediction of explosive detonation properties has important engineering significance for weapon design.Traditional methods for predicting detonation performance include empirical formulas,equations of state,and quantum chemical calculation methods.In recent years,with the development of computer performance and deep learning methods,researchers have begun to apply deep learning methods to the prediction of explosive detonation performance.The deep learning method has the advantage of simple and rapid prediction of explosive detonation properties.However,some problems remain in the study of detonation properties based on deep learning.For example,there are few studies on the prediction of mixed explosives,on the prediction of the parameters of the equation of state of explosives,and on the application of explosive properties to predict the formulation of explosives.Based on an artificial neural network model and a one-dimensional convolutional neural network model,three improved deep learning models were established in this work with the aim of solving these problems.The training data for these models,called the detonation parameters prediction model,JWL equation of state(EOS)prediction model,and inverse prediction model,was obtained through the KHT thermochemical code.After training,the model was tested for overfitting using the validation-set test.Through the model-accuracy test,the prediction accuracy of the model for real explosive formulations was tested by comparing the predicted value with the reference value.The results show that the model errors were within 10%and 3%for the prediction of detonation pressure and detonation velocity,respectively.The accuracy refers to the prediction of tested explosive formulations which consist of TNT,RDX and HMX.For the prediction of the equation of state for explosives,the correlation coefficient between the prediction and the reference curves was above 0.99.For the prediction of the inverse prediction model,the prediction error of the explosive equation was within 9%.This indicates that the models have utility in engineering.展开更多
Weed is a plant that grows along with nearly allfield crops,including rice,wheat,cotton,millets and sugar cane,affecting crop yield and quality.Classification and accurate identification of all types of weeds is a cha...Weed is a plant that grows along with nearly allfield crops,including rice,wheat,cotton,millets and sugar cane,affecting crop yield and quality.Classification and accurate identification of all types of weeds is a challenging task for farmers in earlier stage of crop growth because of similarity.To address this issue,an efficient weed classification model is proposed with the Deep Convolutional Neural Network(CNN)that implements automatic feature extraction and performs complex feature learning for image classification.Throughout this work,weed images were trained using the proposed CNN model with evolutionary computing approach to classify the weeds based on the two publicly available weed datasets.The Tamil Nadu Agricultural University(TNAU)dataset used as afirst dataset that consists of 40 classes of weed images and the other dataset is from Indian Council of Agriculture Research–Directorate of Weed Research(ICAR-DWR)which contains 50 classes of weed images.An effective Particle Swarm Optimization(PSO)technique is applied in the proposed CNN to automa-tically evolve and improve its classification accuracy.The proposed model was evaluated and compared with pre-trained transfer learning models such as GoogLeNet,AlexNet,Residual neural Network(ResNet)and Visual Geometry Group Network(VGGNet)for weed classification.This work shows that the performance of the PSO assisted proposed CNN model is significantly improved the success rate by 98.58%for TNAU and 97.79%for ICAR-DWR weed datasets.展开更多
Growing demand for seafood and reduced fishery harvests have raised intensive farming of marine aquaculture in coastal regions,which may cause severe coastal water problems without adequate environmental management.Ef...Growing demand for seafood and reduced fishery harvests have raised intensive farming of marine aquaculture in coastal regions,which may cause severe coastal water problems without adequate environmental management.Effective mapping of mariculture areas is essential for the protection of coastal environments.However,due to the limited spatial coverage and complex structures,it is still challenging for traditional methods to accurately extract mariculture areas from medium spatial resolution(MSR)images.To solve this problem,we propose to use the full resolution cascade convolutional neural network(FRCNet),which maintains effective features over the whole training process,to identify mariculture areas from MSR images.Specifically,the FRCNet uses a sequential full resolution neural network as the first-level subnetwork,and gradually aggregates higher-level subnetworks in a cascade way.Meanwhile,we perform a repeated fusion strategy so that features can receive information from different subnetworks simultaneously,leading to rich and representative features.As a result,FRCNet can effectively recognize different kinds of mariculture areas from MSR images.Results show that FRCNet obtained better performance than other classical and recently proposed methods.Our developed methods can provide valuable datasets for large-scale and intelligent modeling of the marine aquaculture management and coastal zone planning.展开更多
针对传统机器学习方法对特征依赖大,以及传统卷积神经网络只通过提取重要的局部特征来完成识别分类,收敛速度慢的问题,提出了一维多尺度卷积神经网络和门控循环单元相结合的入侵检测方法。该方法使用一维多尺度卷积神经网络加强对特征...针对传统机器学习方法对特征依赖大,以及传统卷积神经网络只通过提取重要的局部特征来完成识别分类,收敛速度慢的问题,提出了一维多尺度卷积神经网络和门控循环单元相结合的入侵检测方法。该方法使用一维多尺度卷积神经网络加强对特征的捕捉能力,加快收敛速度,采用门控循环单元把握空间特征,减少通道数量扩张,降低数据维度。使用KDD CUP 99数据集和密西西比州大学的天然气管道的数据集进行仿真实验,结果表明与经典的机器学习分类器相比,该方法具有较高的入侵检测性能和较好的泛化能力。展开更多
传统基于地球物理模型函数(geophysical model function,GMF)的全球导航卫星系统反射测量(global navigation satellite system reflectometry,GNSS-R)海面风速反演存在特征提取准确度低、模型复杂度高等问题。针对上述问题,提出了一种...传统基于地球物理模型函数(geophysical model function,GMF)的全球导航卫星系统反射测量(global navigation satellite system reflectometry,GNSS-R)海面风速反演存在特征提取准确度低、模型复杂度高等问题。针对上述问题,提出了一种基于卷积神经网络的GNSS-R海面风速反演方法。通过构建卷积模块自动提取时延-多普勒映射图像(delay-Doppler map,DDM)中的观测特征,特征融合模块将提取的特征与辅助特征关联,全连接模块将上述特征向量逐级映射到海面风速。以“捕风一号”卫星观测数据为例验证了上述方法的有效性,较传统GMF方法,风速反演精度在均方根误差(root mean square error,RMSE)和平均偏差(mean bias error,MBE)上分别降低了0.51 m/s和0.19 m/s,反演效果分别提升了21%和16%。试验结果表明:该方法能够有针对性地自动提取DDM特征,有效提高特征提取的精度,同时显著降低模型的复杂度。本研究为同类卫星各种地表参数反演提供了新思路。展开更多
基金supported by Jiangsu Social Science Foundation(No.20GLD008)Science,Technology Projects of Jiangsu Provincial Department of Communications(No.2020Y14)Joint Fund for Civil Aviation Research(No.U1933202)。
文摘In order to directly construct the mapping between multiple state parameters and remaining useful life(RUL),and reduce the interference of random error on prediction accuracy,a RUL prediction model of aeroengine based on principal component analysis(PCA)and one-dimensional convolution neural network(1D-CNN)is proposed in this paper.Firstly,multiple state parameters corresponding to massive cycles of aeroengine are collected and brought into PCA for dimensionality reduction,and principal components are extracted for further time series prediction.Secondly,the 1D-CNN model is constructed to directly study the mapping between principal components and RUL.Multiple convolution and pooling operations are applied for deep feature extraction,and the end-to-end RUL prediction of aeroengine can be realized.Experimental results show that the most effective principal component from the multiple state parameters can be obtained by PCA,and the long time series of multiple state parameters can be directly mapped to RUL by 1D-CNN,so as to improve the efficiency and accuracy of RUL prediction.Compared with other traditional models,the proposed method also has lower prediction error and better robustness.
文摘In recent years,wearable devices-based Human Activity Recognition(HAR)models have received significant attention.Previously developed HAR models use hand-crafted features to recognize human activities,leading to the extraction of basic features.The images captured by wearable sensors contain advanced features,allowing them to be analyzed by deep learning algorithms to enhance the detection and recognition of human actions.Poor lighting and limited sensor capabilities can impact data quality,making the recognition of human actions a challenging task.The unimodal-based HAR approaches are not suitable in a real-time environment.Therefore,an updated HAR model is developed using multiple types of data and an advanced deep-learning approach.Firstly,the required signals and sensor data are accumulated from the standard databases.From these signals,the wave features are retrieved.Then the extracted wave features and sensor data are given as the input to recognize the human activity.An Adaptive Hybrid Deep Attentive Network(AHDAN)is developed by incorporating a“1D Convolutional Neural Network(1DCNN)”with a“Gated Recurrent Unit(GRU)”for the human activity recognition process.Additionally,the Enhanced Archerfish Hunting Optimizer(EAHO)is suggested to fine-tune the network parameters for enhancing the recognition process.An experimental evaluation is performed on various deep learning networks and heuristic algorithms to confirm the effectiveness of the proposed HAR model.The EAHO-based HAR model outperforms traditional deep learning networks with an accuracy of 95.36,95.25 for recall,95.48 for specificity,and 95.47 for precision,respectively.The result proved that the developed model is effective in recognizing human action by taking less time.Additionally,it reduces the computation complexity and overfitting issue through using an optimization approach.
文摘Audiovisual speech recognition is an emerging research topic.Lipreading is the recognition of what someone is saying using visual information,primarily lip movements.In this study,we created a custom dataset for Indian English linguistics and categorized it into three main categories:(1)audio recognition,(2)visual feature extraction,and(3)combined audio and visual recognition.Audio features were extracted using the mel-frequency cepstral coefficient,and classification was performed using a one-dimension convolutional neural network.Visual feature extraction uses Dlib and then classifies visual speech using a long short-term memory type of recurrent neural networks.Finally,integration was performed using a deep convolutional network.The audio speech of Indian English was successfully recognized with accuracies of 93.67%and 91.53%,respectively,using testing data from 200 epochs.The training accuracy for visual speech recognition using the Indian English dataset was 77.48%and the test accuracy was 76.19%using 60 epochs.After integration,the accuracies of audiovisual speech recognition using the Indian English dataset for training and testing were 94.67%and 91.75%,respectively.
文摘In order to reduce the risk of non-performing loans, losses, and improve the loan approval efficiency, it is necessary to establish an intelligent loan risk and approval prediction system. A hybrid deep learning model with 1DCNN-attention network and the enhanced preprocessing techniques is proposed for loan approval prediction. Our proposed model consists of the enhanced data preprocessing and stacking of multiple hybrid modules. Initially, the enhanced data preprocessing techniques using a combination of methods such as standardization, SMOTE oversampling, feature construction, recursive feature elimination (RFE), information value (IV) and principal component analysis (PCA), which not only eliminates the effects of data jitter and non-equilibrium, but also removes redundant features while improving the representation of features. Subsequently, a hybrid module that combines a 1DCNN with an attention mechanism is proposed to extract local and global spatio-temporal features. Finally, the comprehensive experiments conducted validate that the proposed model surpasses state-of-the-art baseline models across various performance metrics, including accuracy, precision, recall, F1 score, and AUC. Our proposed model helps to automate the loan approval process and provides scientific guidance to financial institutions for loan risk control.
文摘The accurate and efficient prediction of explosive detonation properties has important engineering significance for weapon design.Traditional methods for predicting detonation performance include empirical formulas,equations of state,and quantum chemical calculation methods.In recent years,with the development of computer performance and deep learning methods,researchers have begun to apply deep learning methods to the prediction of explosive detonation performance.The deep learning method has the advantage of simple and rapid prediction of explosive detonation properties.However,some problems remain in the study of detonation properties based on deep learning.For example,there are few studies on the prediction of mixed explosives,on the prediction of the parameters of the equation of state of explosives,and on the application of explosive properties to predict the formulation of explosives.Based on an artificial neural network model and a one-dimensional convolutional neural network model,three improved deep learning models were established in this work with the aim of solving these problems.The training data for these models,called the detonation parameters prediction model,JWL equation of state(EOS)prediction model,and inverse prediction model,was obtained through the KHT thermochemical code.After training,the model was tested for overfitting using the validation-set test.Through the model-accuracy test,the prediction accuracy of the model for real explosive formulations was tested by comparing the predicted value with the reference value.The results show that the model errors were within 10%and 3%for the prediction of detonation pressure and detonation velocity,respectively.The accuracy refers to the prediction of tested explosive formulations which consist of TNT,RDX and HMX.For the prediction of the equation of state for explosives,the correlation coefficient between the prediction and the reference curves was above 0.99.For the prediction of the inverse prediction model,the prediction error of the explosive equation was within 9%.This indicates that the models have utility in engineering.
文摘Weed is a plant that grows along with nearly allfield crops,including rice,wheat,cotton,millets and sugar cane,affecting crop yield and quality.Classification and accurate identification of all types of weeds is a challenging task for farmers in earlier stage of crop growth because of similarity.To address this issue,an efficient weed classification model is proposed with the Deep Convolutional Neural Network(CNN)that implements automatic feature extraction and performs complex feature learning for image classification.Throughout this work,weed images were trained using the proposed CNN model with evolutionary computing approach to classify the weeds based on the two publicly available weed datasets.The Tamil Nadu Agricultural University(TNAU)dataset used as afirst dataset that consists of 40 classes of weed images and the other dataset is from Indian Council of Agriculture Research–Directorate of Weed Research(ICAR-DWR)which contains 50 classes of weed images.An effective Particle Swarm Optimization(PSO)technique is applied in the proposed CNN to automa-tically evolve and improve its classification accuracy.The proposed model was evaluated and compared with pre-trained transfer learning models such as GoogLeNet,AlexNet,Residual neural Network(ResNet)and Visual Geometry Group Network(VGGNet)for weed classification.This work shows that the performance of the PSO assisted proposed CNN model is significantly improved the success rate by 98.58%for TNAU and 97.79%for ICAR-DWR weed datasets.
基金supported by the National Natural Science Foundation of China[grant numbers 42101404,42107498]the National Key Research and Development Program of China[grant number 2020YFC1807501].
文摘Growing demand for seafood and reduced fishery harvests have raised intensive farming of marine aquaculture in coastal regions,which may cause severe coastal water problems without adequate environmental management.Effective mapping of mariculture areas is essential for the protection of coastal environments.However,due to the limited spatial coverage and complex structures,it is still challenging for traditional methods to accurately extract mariculture areas from medium spatial resolution(MSR)images.To solve this problem,we propose to use the full resolution cascade convolutional neural network(FRCNet),which maintains effective features over the whole training process,to identify mariculture areas from MSR images.Specifically,the FRCNet uses a sequential full resolution neural network as the first-level subnetwork,and gradually aggregates higher-level subnetworks in a cascade way.Meanwhile,we perform a repeated fusion strategy so that features can receive information from different subnetworks simultaneously,leading to rich and representative features.As a result,FRCNet can effectively recognize different kinds of mariculture areas from MSR images.Results show that FRCNet obtained better performance than other classical and recently proposed methods.Our developed methods can provide valuable datasets for large-scale and intelligent modeling of the marine aquaculture management and coastal zone planning.
文摘针对传统机器学习方法对特征依赖大,以及传统卷积神经网络只通过提取重要的局部特征来完成识别分类,收敛速度慢的问题,提出了一维多尺度卷积神经网络和门控循环单元相结合的入侵检测方法。该方法使用一维多尺度卷积神经网络加强对特征的捕捉能力,加快收敛速度,采用门控循环单元把握空间特征,减少通道数量扩张,降低数据维度。使用KDD CUP 99数据集和密西西比州大学的天然气管道的数据集进行仿真实验,结果表明与经典的机器学习分类器相比,该方法具有较高的入侵检测性能和较好的泛化能力。
文摘传统基于地球物理模型函数(geophysical model function,GMF)的全球导航卫星系统反射测量(global navigation satellite system reflectometry,GNSS-R)海面风速反演存在特征提取准确度低、模型复杂度高等问题。针对上述问题,提出了一种基于卷积神经网络的GNSS-R海面风速反演方法。通过构建卷积模块自动提取时延-多普勒映射图像(delay-Doppler map,DDM)中的观测特征,特征融合模块将提取的特征与辅助特征关联,全连接模块将上述特征向量逐级映射到海面风速。以“捕风一号”卫星观测数据为例验证了上述方法的有效性,较传统GMF方法,风速反演精度在均方根误差(root mean square error,RMSE)和平均偏差(mean bias error,MBE)上分别降低了0.51 m/s和0.19 m/s,反演效果分别提升了21%和16%。试验结果表明:该方法能够有针对性地自动提取DDM特征,有效提高特征提取的精度,同时显著降低模型的复杂度。本研究为同类卫星各种地表参数反演提供了新思路。
