Pneumonia ranks as a leading cause of mortality, particularly in children aged five and under. Detecting this disease typically requires radiologists to examine chest X-rays and report their findings to physicians, a ...Pneumonia ranks as a leading cause of mortality, particularly in children aged five and under. Detecting this disease typically requires radiologists to examine chest X-rays and report their findings to physicians, a task susceptible to human error. The application of Deep Transfer Learning (DTL) for the identification of pneumonia through chest X-rays is hindered by a shortage of available images, which has led to less than optimal DTL performance and issues with overfitting. Overfitting is characterized by a model’s learning that is too closely fitted to the training data, reducing its effectiveness on unseen data. The problem of overfitting is especially prevalent in medical image processing due to the high costs and extensive time required for image annotation, as well as the challenge of collecting substantial datasets that also respect patient privacy concerning infectious diseases such as pneumonia. To mitigate these challenges, this paper introduces the use of conditional generative adversarial networks (CGAN) to enrich the pneumonia dataset with 2690 synthesized X-ray images of the minority class, aiming to even out the dataset distribution for improved diagnostic performance. Subsequently, we applied four modified lightweight deep transfer learning models such as Xception, MobileNetV2, MobileNet, and EfficientNetB0. These models have been fine-tuned and evaluated, demonstrating remarkable detection accuracies of 99.26%, 98.23%, 97.06%, and 94.55%, respectively, across fifty epochs. The experimental results validate that the models we have proposed achieve high detection accuracy rates, with the best model reaching up to 99.26% effectiveness, outperforming other models in the diagnosis of pneumonia from X-ray images.展开更多
In order to address the shortcoming of feature representation limitation in machine translation(MT)system,this paper presents a feature transfer method in MT.Meta feature transfer of the decoding process considered no...In order to address the shortcoming of feature representation limitation in machine translation(MT)system,this paper presents a feature transfer method in MT.Meta feature transfer of the decoding process considered not only their own translation system,but also transferred knowledge of another translation system.The domain meta feature and the objective function of domain adaptation are used to better model the domain transfer task.In this paper,extensive experiments and comparisons are made.The experiment results show that the proposed model has a significant improvement in domain transfer task.The first model has better performance than baseline system,which improves 3.06 BLEU score on the news test set,improves 3.27 BLEU score on the education test set,and improves 3.93 BLEU score on the law test set;The second model improves 3.16 BLEU score on the news test set,improves 3.54 BLEU score on the education test set,and improves 4.2 BLEU score on the law test set.展开更多
The development of artificial intelligence (AI), particularly deep learning, has made it possible to accelerate and improve the processing of data collected in different fields (commerce, medicine, surveillance or sec...The development of artificial intelligence (AI), particularly deep learning, has made it possible to accelerate and improve the processing of data collected in different fields (commerce, medicine, surveillance or security, agriculture, etc.). Most related works use open source consistent image databases. This is the case for ImageNet reference data such as coco data, IP102, CIFAR-10, STL-10 and many others with variability representatives. The consistency of its images contributes to the spectacular results observed in its fields with deep learning. The application of deep learning which is making its debut in geology does not, to our knowledge, include a database of microscopic images of thin sections of open source rock minerals. In this paper, we evaluate three optimizers under the AlexNet architecture to check whether our acquired mineral images have object features or patterns that are clear and distinct to be extracted by a neural network. These are thin sections of magmatic rocks (biotite and 2-mica granite, granodiorite, simple granite, dolerite, charnokite and gabbros, etc.) which served as support. We use two hyper-parameters: the number of epochs to perform complete rounds on the entire data set and the “learning rate” to indicate how quickly the weights in the network will be modified during optimization. Using Transfer Learning, the three (3) optimizers all based on the gradient descent methods of Stochastic Momentum Gradient Descent (sgdm), Root Mean Square Propagation (RMSprop) algorithm and Adaptive Estimation of moment (Adam) achieved better performance. The recorded results indicate that the Momentum optimizer achieved the best scores respectively of 96.2% with a learning step set to 10−3 for a fixed choice of 350 epochs during this variation and 96, 7% over 300 epochs for the same value of the learning step. This performance is expected to provide excellent insight into image quality for future studies. Then they participate in the development of an intelligent system for the identification and classification of minerals, seven (7) in total (quartz, biotite, amphibole, plagioclase, feldspar, muscovite, pyroxene) and rocks.展开更多
Aiming at the problems of lack of fault diagnosis samples and low model generalization ability of cross-working gear based on deep transfer learning, a fault diagnosis method based on improved deep residual network an...Aiming at the problems of lack of fault diagnosis samples and low model generalization ability of cross-working gear based on deep transfer learning, a fault diagnosis method based on improved deep residual network and transfer learning was proposed. Firstly, one-dimensional signal is transformed into two-dimensional time-frequency image by continuous wavelet transform. Then, a deep learning model based on ResNet50 is constructed. Attention mechanism is introduced into the model to make the model pay more attention to the useful features for the current task. The network parameters trained by ResNet50 network on ImageNet dataset were used to initialize the model and applied to the fault diagnosis field. Finally, to solve the problem of gear fault diagnosis under different working conditions, a small sample training set is proposed for fault diagnosis. The method is applied to gearbox fault diagnosis, and the results show that: The proposed deep model achieves 99.7% accuracy of gear fault diagnosis, which is better than the four models such as VGG19 and MobileNetV2. In the cross-working condition fault diagnosis, only 20% target dataset is used as the training set, and the proposed method achieves 93.5% accuracy.展开更多
文摘Pneumonia ranks as a leading cause of mortality, particularly in children aged five and under. Detecting this disease typically requires radiologists to examine chest X-rays and report their findings to physicians, a task susceptible to human error. The application of Deep Transfer Learning (DTL) for the identification of pneumonia through chest X-rays is hindered by a shortage of available images, which has led to less than optimal DTL performance and issues with overfitting. Overfitting is characterized by a model’s learning that is too closely fitted to the training data, reducing its effectiveness on unseen data. The problem of overfitting is especially prevalent in medical image processing due to the high costs and extensive time required for image annotation, as well as the challenge of collecting substantial datasets that also respect patient privacy concerning infectious diseases such as pneumonia. To mitigate these challenges, this paper introduces the use of conditional generative adversarial networks (CGAN) to enrich the pneumonia dataset with 2690 synthesized X-ray images of the minority class, aiming to even out the dataset distribution for improved diagnostic performance. Subsequently, we applied four modified lightweight deep transfer learning models such as Xception, MobileNetV2, MobileNet, and EfficientNetB0. These models have been fine-tuned and evaluated, demonstrating remarkable detection accuracies of 99.26%, 98.23%, 97.06%, and 94.55%, respectively, across fifty epochs. The experimental results validate that the models we have proposed achieve high detection accuracy rates, with the best model reaching up to 99.26% effectiveness, outperforming other models in the diagnosis of pneumonia from X-ray images.
基金supported by National Natural Science Youth Fund,China(No.61300115)China Postdoctoral Science Foundation(No.2014m561331)Science and Technology Research Project of Heilongjiang Provincial Education Department,China(No.12521073).
文摘In order to address the shortcoming of feature representation limitation in machine translation(MT)system,this paper presents a feature transfer method in MT.Meta feature transfer of the decoding process considered not only their own translation system,but also transferred knowledge of another translation system.The domain meta feature and the objective function of domain adaptation are used to better model the domain transfer task.In this paper,extensive experiments and comparisons are made.The experiment results show that the proposed model has a significant improvement in domain transfer task.The first model has better performance than baseline system,which improves 3.06 BLEU score on the news test set,improves 3.27 BLEU score on the education test set,and improves 3.93 BLEU score on the law test set;The second model improves 3.16 BLEU score on the news test set,improves 3.54 BLEU score on the education test set,and improves 4.2 BLEU score on the law test set.
文摘The development of artificial intelligence (AI), particularly deep learning, has made it possible to accelerate and improve the processing of data collected in different fields (commerce, medicine, surveillance or security, agriculture, etc.). Most related works use open source consistent image databases. This is the case for ImageNet reference data such as coco data, IP102, CIFAR-10, STL-10 and many others with variability representatives. The consistency of its images contributes to the spectacular results observed in its fields with deep learning. The application of deep learning which is making its debut in geology does not, to our knowledge, include a database of microscopic images of thin sections of open source rock minerals. In this paper, we evaluate three optimizers under the AlexNet architecture to check whether our acquired mineral images have object features or patterns that are clear and distinct to be extracted by a neural network. These are thin sections of magmatic rocks (biotite and 2-mica granite, granodiorite, simple granite, dolerite, charnokite and gabbros, etc.) which served as support. We use two hyper-parameters: the number of epochs to perform complete rounds on the entire data set and the “learning rate” to indicate how quickly the weights in the network will be modified during optimization. Using Transfer Learning, the three (3) optimizers all based on the gradient descent methods of Stochastic Momentum Gradient Descent (sgdm), Root Mean Square Propagation (RMSprop) algorithm and Adaptive Estimation of moment (Adam) achieved better performance. The recorded results indicate that the Momentum optimizer achieved the best scores respectively of 96.2% with a learning step set to 10−3 for a fixed choice of 350 epochs during this variation and 96, 7% over 300 epochs for the same value of the learning step. This performance is expected to provide excellent insight into image quality for future studies. Then they participate in the development of an intelligent system for the identification and classification of minerals, seven (7) in total (quartz, biotite, amphibole, plagioclase, feldspar, muscovite, pyroxene) and rocks.
文摘Aiming at the problems of lack of fault diagnosis samples and low model generalization ability of cross-working gear based on deep transfer learning, a fault diagnosis method based on improved deep residual network and transfer learning was proposed. Firstly, one-dimensional signal is transformed into two-dimensional time-frequency image by continuous wavelet transform. Then, a deep learning model based on ResNet50 is constructed. Attention mechanism is introduced into the model to make the model pay more attention to the useful features for the current task. The network parameters trained by ResNet50 network on ImageNet dataset were used to initialize the model and applied to the fault diagnosis field. Finally, to solve the problem of gear fault diagnosis under different working conditions, a small sample training set is proposed for fault diagnosis. The method is applied to gearbox fault diagnosis, and the results show that: The proposed deep model achieves 99.7% accuracy of gear fault diagnosis, which is better than the four models such as VGG19 and MobileNetV2. In the cross-working condition fault diagnosis, only 20% target dataset is used as the training set, and the proposed method achieves 93.5% accuracy.
