Deep Learning(DL)is known for its golden standard computing paradigm in the learning community.However,it turns out to be an extensively utilized computing approach in the ML field.Therefore,attaining superior outcome...Deep Learning(DL)is known for its golden standard computing paradigm in the learning community.However,it turns out to be an extensively utilized computing approach in the ML field.Therefore,attaining superior outcomes over cognitive tasks based on human performance.The primary benefit of DL is its competency in learning massive data.The DL-based technologies have grown faster and are widely adopted to handle the conventional approaches resourcefully.Specifically,various DL approaches outperform the conventional ML approaches in real-time applications.Indeed,various research works are reviewed to understand the significance of the individual DL models and some computational complexity is observed.This may be due to the broader expertise and knowledge required for handling these models during the prediction process.This research proposes a holistic approach for pneumonia prediction and offers a more appropriate DL model for classification purposes.This work incorporates a novel fused Squeeze and Excitation(SE)block with the ResNet model for pneumonia prediction and better accuracy.The expected model reduces the human effort during the prediction process and makes it easier to diagnose it intelligently as the feature learning is adaptive.The experimentation is carried out in Keras,and the model’s superiority is compared with various advanced approaches.The proposed model gives 90%prediction accuracy,93%precision,90%recall and 89%F1-measure.The proposed model shows a better trade-off compared to other approaches.The evaluation is done with the existing standard ResNet model,GoogleNet+ResNet+DenseNet,and different variants of ResNet models.展开更多
The surface electromyography(sEMG)is one of the basic processing techniques to the gesture recognition because of its inherent advantages of easy collection and non-invasion.However,limited by feature extraction and c...The surface electromyography(sEMG)is one of the basic processing techniques to the gesture recognition because of its inherent advantages of easy collection and non-invasion.However,limited by feature extraction and classifier selection,the adaptability and accuracy of the conventional machine learning still need to promote with the increase of the input dimension and the number of output classifications.Moreover,due to the different characteristics of sEMG data and image data,the conventional convolutional neural network(CNN)have yet to fit sEMG signals.In this paper,a novel hybrid model combining CNN with the graph convolutional network(GCN)was constructed to improve the performance of the gesture recognition.Based on the characteristics of sEMG signal,GCN was introduced into the model through a joint voting network to extract the muscle synergy feature of the sEMG signal.Such strategy optimizes the structure and convolution kernel parameters of the residual network(ResNet)with the classification accuracy on the NinaPro DBl up to 90.07%.The experimental results and comparisons confirm the superiority of the proposed hybrid model for gesture recognition from the sEMG signals.展开更多
In this paper,we propose an improved deep residual network model to recognize human actions.Action data is composed of channel state information signals,which are continuous fine-grained signals.We replaced the tradit...In this paper,we propose an improved deep residual network model to recognize human actions.Action data is composed of channel state information signals,which are continuous fine-grained signals.We replaced the traditional identity connection with the shrinking thresholdmodule.Themodule automatically adjusts the threshold of the action data signal,and filters out signals that are not related to the principal components.We use the attention mechanism to improve the memory of the network model to the action signal,so as to better recognize the action.To verify the validity of the experiment more accurately,we collected action data in two different environments.The experimental results show that the improved network model is much better than the traditional network in recognition.The accuracy of recognition in complex places can reach 92.85%,among which the recognition rate of raising hands is up to 96%.We combine the improved residual deep network model with channel state information action data,and prove the effectiveness of our model for classification through experimental data.展开更多
Landslides are common natural hazards occurring in most parts of the world and have considerable adverse economic effects. Residual shear strength of clay is one of the most important factors in the determination of s...Landslides are common natural hazards occurring in most parts of the world and have considerable adverse economic effects. Residual shear strength of clay is one of the most important factors in the determination of stability of slopes or landslides. This effect is more pronounced in sensitive clays which show large changes in shear strength from peak to residual states. This study analyses the prediction of the residual strength of clay based on a new prediction model, functional networks（FN） using data available in the literature. The performance of FN was compared with support vector machine（SVM） and artificial neural network（ANN） based on statistical parameters like correlation coefficient（R）, Nash–Sutcliff coefficient of efficiency（E）, absolute average error（AAE）, maximum average error（MAE） and root mean square error（RMSE）. Based on R and E parameters, FN is found to be a better prediction tool than ANN for the given data. However, the R and E values for FN are less than SVM. A prediction equation is presented that can be used by practicing geotechnical engineers. A sensitivity analysis is carried out to ascertain the importance of various inputs in the prediction of the output.展开更多
Even though much advancements have been achieved with regards to the recognition of handwritten characters,researchers still face difficulties with the handwritten character recognition problem,especially with the adv...Even though much advancements have been achieved with regards to the recognition of handwritten characters,researchers still face difficulties with the handwritten character recognition problem,especially with the advent of new datasets like the Extended Modified National Institute of Standards and Technology dataset(EMNIST).The EMNIST dataset represents a challenge for both machine-learning and deep-learning techniques due to inter-class similarity and intra-class variability.Inter-class similarity exists because of the similarity between the shapes of certain characters in the dataset.The presence of intra-class variability is mainly due to different shapes written by different writers for the same character.In this research,we have optimized a deep residual network to achieve higher accuracy vs.the published state-of-the-art results.This approach is mainly based on the prebuilt deep residual network model ResNet18,whose architecture has been enhanced by using the optimal number of residual blocks and the optimal size of the receptive field of the first convolutional filter,the replacement of the first max-pooling filter by an average pooling filter,and the addition of a drop-out layer before the fully connected layer.A distinctive modification has been introduced by replacing the final addition layer with a depth concatenation layer,which resulted in a novel deep architecture having higher accuracy vs.the pure residual architecture.Moreover,the dataset images’sizes have been adjusted to optimize their visibility in the network.Finally,by tuning the training hyperparameters and using rotation and shear augmentations,the proposed model outperformed the state-of-the-art models by achieving average accuracies of 95.91%and 90.90%for the Letters and Balanced dataset sections,respectively.Furthermore,the average accuracies were improved to 95.9%and 91.06%for the Letters and Balanced sections,respectively,by using a group of 5 instances of the trained models and averaging the output class probabilities.展开更多
The latest studies with radiological imaging techniques indicate that X-ray images provide valuable details on the Coronavirus disease 2019(COVID-19).The usage of sophisticated artificial intelligence technology(AI)an...The latest studies with radiological imaging techniques indicate that X-ray images provide valuable details on the Coronavirus disease 2019(COVID-19).The usage of sophisticated artificial intelligence technology(AI)and the radiological images can help in diagnosing the disease reliably and addressing the problem of the shortage of trained doctors in remote villages.In this research,the automated diagnosis of Coronavirus disease was performed using a dataset of X-ray images of patients with severe bacterial pneumonia,reported COVID-19 disease,and normal cases.The goal of the study is to analyze the achievements for medical image recognition of state-of-the-art neural networking architectures.Transfer Learning technique has been implemented in this work.Transfer learning is an ambitious task,but it results in impressive outcomes for identifying distinct patterns in tiny datasets of medical images.The findings indicate that deep learning with X-ray imagery could retrieve important biomarkers relevant for COVID-19 disease detection.Since all diagnostic measures show failure levels that pose questions,the scientific profession should determine the probability of integration of X-rays with the clinical treatment,utilizing the results.The proposed model achieved 96.73%accuracy outperforming the ResNet50 and traditional Resnet18 models.Based on our findings,the proposed system can help the specialist doctors in making verdicts for COVID-19 detection.展开更多
With the massive success of deep networks,there have been signi-cant efforts to analyze cancer diseases,especially skin cancer.For this purpose,this work investigates the capability of deep networks in diagnosing a va...With the massive success of deep networks,there have been signi-cant efforts to analyze cancer diseases,especially skin cancer.For this purpose,this work investigates the capability of deep networks in diagnosing a variety of dermoscopic lesion images.This paper aims to develop and ne-tune a deep learning architecture to diagnose different skin cancer grades based on dermatoscopic images.Fine-tuning is a powerful method to obtain enhanced classication results by the customized pre-trained network.Regularization,batch normalization,and hyperparameter optimization are performed for ne-tuning the proposed deep network.The proposed ne-tuned ResNet50 model successfully classied 7-respective classes of dermoscopic lesions using the publicly available HAM10000 dataset.The developed deep model was compared against two powerful models,i.e.,InceptionV3 and VGG16,using the Dice similarity coefcient(DSC)and the area under the curve(AUC).The evaluation results show that the proposed model achieved higher results than some recent and robust models.展开更多
alient object detection aims at identifying the visually interesting object regions that are consistent with human perception. Multispectral remote sensing images provide rich radiometric information in revealing the ...alient object detection aims at identifying the visually interesting object regions that are consistent with human perception. Multispectral remote sensing images provide rich radiometric information in revealing the physical properties of the observed objects, which leads to great potential to perform salient object detection for remote sensing images. Conventional salient object detection methods often employ handcrafted features to predict saliency by evaluating the pixel-wise or superpixel-wise contrast. With the recent use of deep learning framework, in particular, fully convolutional neural networks, there has been profound progress in visual saliency detection. However, this success has not been extended to multispectral remote sensing images, and existing multispectral salient object detection methods are still mainly based on handcrafted features, essentially due to the difficulties in image acquisition and labeling. In this paper, we propose a novel deep residual network based on a top-down model, which is trained in an end-to-end manner to tackle the above issues in multispectral salient object detection. Our model effectively exploits the saliency cues at different levels of the deep residual network. To overcome the limited availability of remote sensing images in training of our deep residual network, we also introduce a new spectral image reconstruction model that can generate multispectral images from RGB images. Our extensive experimental results using both multispectral and RGB salient object detection datasets demonstrate a significant performance improvement of more than 10% improvement compared with the state-of-the-art methods.展开更多
文摘Deep Learning(DL)is known for its golden standard computing paradigm in the learning community.However,it turns out to be an extensively utilized computing approach in the ML field.Therefore,attaining superior outcomes over cognitive tasks based on human performance.The primary benefit of DL is its competency in learning massive data.The DL-based technologies have grown faster and are widely adopted to handle the conventional approaches resourcefully.Specifically,various DL approaches outperform the conventional ML approaches in real-time applications.Indeed,various research works are reviewed to understand the significance of the individual DL models and some computational complexity is observed.This may be due to the broader expertise and knowledge required for handling these models during the prediction process.This research proposes a holistic approach for pneumonia prediction and offers a more appropriate DL model for classification purposes.This work incorporates a novel fused Squeeze and Excitation(SE)block with the ResNet model for pneumonia prediction and better accuracy.The expected model reduces the human effort during the prediction process and makes it easier to diagnose it intelligently as the feature learning is adaptive.The experimentation is carried out in Keras,and the model’s superiority is compared with various advanced approaches.The proposed model gives 90%prediction accuracy,93%precision,90%recall and 89%F1-measure.The proposed model shows a better trade-off compared to other approaches.The evaluation is done with the existing standard ResNet model,GoogleNet+ResNet+DenseNet,and different variants of ResNet models.
基金supported by the Development of Sleep Disordered Breathing Detection and Auxiliary Regulation System Project(No.2019I1009)。
文摘The surface electromyography(sEMG)is one of the basic processing techniques to the gesture recognition because of its inherent advantages of easy collection and non-invasion.However,limited by feature extraction and classifier selection,the adaptability and accuracy of the conventional machine learning still need to promote with the increase of the input dimension and the number of output classifications.Moreover,due to the different characteristics of sEMG data and image data,the conventional convolutional neural network(CNN)have yet to fit sEMG signals.In this paper,a novel hybrid model combining CNN with the graph convolutional network(GCN)was constructed to improve the performance of the gesture recognition.Based on the characteristics of sEMG signal,GCN was introduced into the model through a joint voting network to extract the muscle synergy feature of the sEMG signal.Such strategy optimizes the structure and convolution kernel parameters of the residual network(ResNet)with the classification accuracy on the NinaPro DBl up to 90.07%.The experimental results and comparisons confirm the superiority of the proposed hybrid model for gesture recognition from the sEMG signals.
基金This work was supported by Innovation Capability Support Program of Shaanxi(Program No.2018TD-016)Key Research and Development Program of Shaanxi(Program No.2019ZDLSF02-09-02).
文摘In this paper,we propose an improved deep residual network model to recognize human actions.Action data is composed of channel state information signals,which are continuous fine-grained signals.We replaced the traditional identity connection with the shrinking thresholdmodule.Themodule automatically adjusts the threshold of the action data signal,and filters out signals that are not related to the principal components.We use the attention mechanism to improve the memory of the network model to the action signal,so as to better recognize the action.To verify the validity of the experiment more accurately,we collected action data in two different environments.The experimental results show that the improved network model is much better than the traditional network in recognition.The accuracy of recognition in complex places can reach 92.85%,among which the recognition rate of raising hands is up to 96%.We combine the improved residual deep network model with channel state information action data,and prove the effectiveness of our model for classification through experimental data.
文摘Landslides are common natural hazards occurring in most parts of the world and have considerable adverse economic effects. Residual shear strength of clay is one of the most important factors in the determination of stability of slopes or landslides. This effect is more pronounced in sensitive clays which show large changes in shear strength from peak to residual states. This study analyses the prediction of the residual strength of clay based on a new prediction model, functional networks（FN） using data available in the literature. The performance of FN was compared with support vector machine（SVM） and artificial neural network（ANN） based on statistical parameters like correlation coefficient（R）, Nash–Sutcliff coefficient of efficiency（E）, absolute average error（AAE）, maximum average error（MAE） and root mean square error（RMSE）. Based on R and E parameters, FN is found to be a better prediction tool than ANN for the given data. However, the R and E values for FN are less than SVM. A prediction equation is presented that can be used by practicing geotechnical engineers. A sensitivity analysis is carried out to ascertain the importance of various inputs in the prediction of the output.
文摘Even though much advancements have been achieved with regards to the recognition of handwritten characters,researchers still face difficulties with the handwritten character recognition problem,especially with the advent of new datasets like the Extended Modified National Institute of Standards and Technology dataset(EMNIST).The EMNIST dataset represents a challenge for both machine-learning and deep-learning techniques due to inter-class similarity and intra-class variability.Inter-class similarity exists because of the similarity between the shapes of certain characters in the dataset.The presence of intra-class variability is mainly due to different shapes written by different writers for the same character.In this research,we have optimized a deep residual network to achieve higher accuracy vs.the published state-of-the-art results.This approach is mainly based on the prebuilt deep residual network model ResNet18,whose architecture has been enhanced by using the optimal number of residual blocks and the optimal size of the receptive field of the first convolutional filter,the replacement of the first max-pooling filter by an average pooling filter,and the addition of a drop-out layer before the fully connected layer.A distinctive modification has been introduced by replacing the final addition layer with a depth concatenation layer,which resulted in a novel deep architecture having higher accuracy vs.the pure residual architecture.Moreover,the dataset images’sizes have been adjusted to optimize their visibility in the network.Finally,by tuning the training hyperparameters and using rotation and shear augmentations,the proposed model outperformed the state-of-the-art models by achieving average accuracies of 95.91%and 90.90%for the Letters and Balanced dataset sections,respectively.Furthermore,the average accuracies were improved to 95.9%and 91.06%for the Letters and Balanced sections,respectively,by using a group of 5 instances of the trained models and averaging the output class probabilities.
文摘The latest studies with radiological imaging techniques indicate that X-ray images provide valuable details on the Coronavirus disease 2019(COVID-19).The usage of sophisticated artificial intelligence technology(AI)and the radiological images can help in diagnosing the disease reliably and addressing the problem of the shortage of trained doctors in remote villages.In this research,the automated diagnosis of Coronavirus disease was performed using a dataset of X-ray images of patients with severe bacterial pneumonia,reported COVID-19 disease,and normal cases.The goal of the study is to analyze the achievements for medical image recognition of state-of-the-art neural networking architectures.Transfer Learning technique has been implemented in this work.Transfer learning is an ambitious task,but it results in impressive outcomes for identifying distinct patterns in tiny datasets of medical images.The findings indicate that deep learning with X-ray imagery could retrieve important biomarkers relevant for COVID-19 disease detection.Since all diagnostic measures show failure levels that pose questions,the scientific profession should determine the probability of integration of X-rays with the clinical treatment,utilizing the results.The proposed model achieved 96.73%accuracy outperforming the ResNet50 and traditional Resnet18 models.Based on our findings,the proposed system can help the specialist doctors in making verdicts for COVID-19 detection.
文摘With the massive success of deep networks,there have been signi-cant efforts to analyze cancer diseases,especially skin cancer.For this purpose,this work investigates the capability of deep networks in diagnosing a variety of dermoscopic lesion images.This paper aims to develop and ne-tune a deep learning architecture to diagnose different skin cancer grades based on dermatoscopic images.Fine-tuning is a powerful method to obtain enhanced classication results by the customized pre-trained network.Regularization,batch normalization,and hyperparameter optimization are performed for ne-tuning the proposed deep network.The proposed ne-tuned ResNet50 model successfully classied 7-respective classes of dermoscopic lesions using the publicly available HAM10000 dataset.The developed deep model was compared against two powerful models,i.e.,InceptionV3 and VGG16,using the Dice similarity coefcient(DSC)and the area under the curve(AUC).The evaluation results show that the proposed model achieved higher results than some recent and robust models.
基金National 1000 Young Talents Plan of ChinaNational Natural Science Foundation of China(61420106007,61671387,61871325)DECRA of Australica Resenrch Council (DE140100180).
文摘alient object detection aims at identifying the visually interesting object regions that are consistent with human perception. Multispectral remote sensing images provide rich radiometric information in revealing the physical properties of the observed objects, which leads to great potential to perform salient object detection for remote sensing images. Conventional salient object detection methods often employ handcrafted features to predict saliency by evaluating the pixel-wise or superpixel-wise contrast. With the recent use of deep learning framework, in particular, fully convolutional neural networks, there has been profound progress in visual saliency detection. However, this success has not been extended to multispectral remote sensing images, and existing multispectral salient object detection methods are still mainly based on handcrafted features, essentially due to the difficulties in image acquisition and labeling. In this paper, we propose a novel deep residual network based on a top-down model, which is trained in an end-to-end manner to tackle the above issues in multispectral salient object detection. Our model effectively exploits the saliency cues at different levels of the deep residual network. To overcome the limited availability of remote sensing images in training of our deep residual network, we also introduce a new spectral image reconstruction model that can generate multispectral images from RGB images. Our extensive experimental results using both multispectral and RGB salient object detection datasets demonstrate a significant performance improvement of more than 10% improvement compared with the state-of-the-art methods.
