In recent years,there has been extensive research on object detection methods applied to optical remote sensing images utilizing convolutional neural networks.Despite these efforts,the detection of small objects in re...In recent years,there has been extensive research on object detection methods applied to optical remote sensing images utilizing convolutional neural networks.Despite these efforts,the detection of small objects in remote sensing remains a formidable challenge.The deep network structure will bring about the loss of object features,resulting in the loss of object features and the near elimination of some subtle features associated with small objects in deep layers.Additionally,the features of small objects are susceptible to interference from background features contained within the image,leading to a decline in detection accuracy.Moreover,the sensitivity of small objects to the bounding box perturbation further increases the detection difficulty.In this paper,we introduce a novel approach,Cross-Layer Fusion and Weighted Receptive Field-based YOLO(CAW-YOLO),specifically designed for small object detection in remote sensing.To address feature loss in deep layers,we have devised a cross-layer attention fusion module.Background noise is effectively filtered through the incorporation of Bi-Level Routing Attention(BRA).To enhance the model’s capacity to perceive multi-scale objects,particularly small-scale objects,we introduce a weightedmulti-receptive field atrous spatial pyramid poolingmodule.Furthermore,wemitigate the sensitivity arising from bounding box perturbation by incorporating the joint Normalized Wasserstein Distance(NWD)and Efficient Intersection over Union(EIoU)losses.The efficacy of the proposedmodel in detecting small objects in remote sensing has been validated through experiments conducted on three publicly available datasets.The experimental results unequivocally demonstrate the model’s pronounced advantages in small object detection for remote sensing,surpassing the performance of current mainstream models.展开更多
Objective This paper proposed a novel algorithm of discrete wavelet transform(DWT) which is used for multimodal medical image fusion. Methods The source medical images are initially transformed by DWT followed by fusi...Objective This paper proposed a novel algorithm of discrete wavelet transform(DWT) which is used for multimodal medical image fusion. Methods The source medical images are initially transformed by DWT followed by fusing low and high frequency sub-images. Then, the "coefficient absolute value" that can provide clear and detail parts is adapted to fuse high-frequency coefficients, where as the "region energy ratio" which can efficiently preserve most information of source images is employed to fuse low-frequency coefficients. Finally, the fused image is reconstructed by inverse wavelet transform. Results Visually and quantitatively experimental results indicate that the proposed fusion method is superior to traditional wavelet transform and the existing fusion methods. Conclusion The proposed method is a feasible approach for multimodal medical image fusion which can obtain more efficient and accurate fusions results even in the noise environment.展开更多
Walking as a unique biometric tool conveys important information for emotion recognition.Individuals in different emotional states exhibit distinct walking patterns.For this purpose,this paper proposes a novel approac...Walking as a unique biometric tool conveys important information for emotion recognition.Individuals in different emotional states exhibit distinct walking patterns.For this purpose,this paper proposes a novel approach to recognizing emotion during walking using electroencephalogram(EEG)and inertial signals.Accurate recognition of emotion is achieved by training in an end-to-end deep learning fashion and taking into account multi-modal fusion.Subjects wear virtual reality head-mounted display(VR-HMD)equipment to immerse in strong emotions during walking.VR environment shows excellent imitation and experience ability,which plays an important role in awakening and changing emotions.In addition,the multi-modal signals acquired from EEG and inertial sensors are separately represented as virtual emotion images by discrete wavelet transform(DWT).These serve as input to the attention-based convolutional neural network(CNN)fusion model.The designed network structure is simple and lightweight while integrating the channel attention mechanism to extract and enhance features.To effectively improve the performance of the recognition system,the proposed decision fusion algorithm combines Critic method and majority voting strategy to determine the weight values that affect the final decision results.An investigation is made on the effect of diverse mother wavelet types and wavelet decomposition levels on model performance which indicates that the 2.2-order reverse biorthogonal(rbio2.2)wavelet with two-level decomposition has the best recognition performance.Comparative experiment results show that the proposed method outperforms other existing state-of-the-art works with an accuracy of 98.73%.展开更多
Assuring medical images protection and robustness is a compulsory necessity nowadays.In this paper,a novel technique is proposed that fuses the wavelet-induced multi-resolution decomposition of the Discrete Wavelet Tr...Assuring medical images protection and robustness is a compulsory necessity nowadays.In this paper,a novel technique is proposed that fuses the wavelet-induced multi-resolution decomposition of the Discrete Wavelet Transform(DWT)with the energy compaction of the Discrete Wavelet Transform(DCT).The multi-level Encryption-based Hybrid Fusion Technique(EbhFT)aims to achieve great advances in terms of imperceptibility and security of medical images.A DWT disintegrated sub-band of a cover image is reformed simultaneously using the DCT transform.Afterwards,a 64-bit hex key is employed to encrypt the host image as well as participate in the second key creation process to encode the watermark.Lastly,a PN-sequence key is formed along with a supplementary key in the third layer of the EbHFT.Thus,the watermarked image is generated by enclosing both keys into DWT and DCT coefficients.The fusions ability of the proposed EbHFT technique makes the best use of the distinct privileges of using both DWT and DCT methods.In order to validate the proposed technique,a standard dataset of medical images is used.Simulation results show higher performance of the visual quality(i.e.,57.65)for the watermarked forms of all types of medical images.In addition,EbHFT robustness outperforms an existing scheme tested for the same dataset in terms of Normalized Correlation(NC).Finally,extra protection for digital images from against illegal replicating and unapproved tampering using the proposed technique.展开更多
This paper proposes a novel region based image fusion scheme based on multiresolution analysis. The low frequency band of the image multiresolution representation is segmented into important regions, sub-important reg...This paper proposes a novel region based image fusion scheme based on multiresolution analysis. The low frequency band of the image multiresolution representation is segmented into important regions, sub-important regions and background regions. Each feature of the regions is used to determine the region’s degree of membership in the multiresolution representation, and then to achieve multiresolution representation of the fusion result. The final image fusion result can be obtained by using the inverse multiresolution transform. Experiments showed that the proposed image fusion method can have better performance than existing image fusion methods.展开更多
For the last two decades,physicians and clinical experts have used a single imaging modality to identify the normal and abnormal structure of the human body.However,most of the time,medical experts are unable to accur...For the last two decades,physicians and clinical experts have used a single imaging modality to identify the normal and abnormal structure of the human body.However,most of the time,medical experts are unable to accurately analyze and examine the information from a single imaging modality due to the limited information.To overcome this problem,a multimodal approach is adopted to increase the qualitative and quantitative medical information which helps the doctors to easily diagnose diseases in their early stages.In the proposed method,a Multi-resolution Rigid Registration(MRR)technique is used for multimodal image registration while Discrete Wavelet Transform(DWT)along with Principal Component Averaging(PCAv)is utilized for image fusion.The proposed MRR method provides more accurate results as compared with Single Rigid Registration(SRR),while the proposed DWT-PCAv fusion process adds-on more constructive information with less computational time.The proposed method is tested on CT and MRI brain imaging modalities of the HARVARD dataset.The fusion results of the proposed method are compared with the existing fusion techniques.The quality assessment metrics such as Mutual Information(MI),Normalize Crosscorrelation(NCC)and Feature Mutual Information(FMI)are computed for statistical comparison of the proposed method.The proposed methodology provides more accurate results,better image quality and valuable information for medical diagnoses.展开更多
Laser powder bed fusion(LPBF)is a popular metal additive manufacturing technique.Generally,the materials employed for LPBF are discrete and particulate metal matters.Thus,the discontinuous behaviors exhibited by the p...Laser powder bed fusion(LPBF)is a popular metal additive manufacturing technique.Generally,the materials employed for LPBF are discrete and particulate metal matters.Thus,the discontinuous behaviors exhibited by the powder materials cannot be simulated solely using conventional continuum-based computational approaches,such as finite-element or finite-difference methods.The discrete element method(DEM)is a proven numerical method to model discrete matter,such as powder particles,by tracking the motion and temperature of individual particles.Recently,DEM simulation has gained popularity in LPBF studies.However,it has not been widely applied.This study reviews the existing applications of DEM in LPBF processing,such as powder spreading and fusion.A review of the existing literature indicates that DEM is a promising approach in the study of the kinetic and thermal fluid behaviors of powder particles in LPBF additive manufacturing.展开更多
基金supported in part by the National Natural Science Foundation of China under Grant 62006071part by the Science and Technology Research Project of Henan Province under Grant 232103810086.
文摘In recent years,there has been extensive research on object detection methods applied to optical remote sensing images utilizing convolutional neural networks.Despite these efforts,the detection of small objects in remote sensing remains a formidable challenge.The deep network structure will bring about the loss of object features,resulting in the loss of object features and the near elimination of some subtle features associated with small objects in deep layers.Additionally,the features of small objects are susceptible to interference from background features contained within the image,leading to a decline in detection accuracy.Moreover,the sensitivity of small objects to the bounding box perturbation further increases the detection difficulty.In this paper,we introduce a novel approach,Cross-Layer Fusion and Weighted Receptive Field-based YOLO(CAW-YOLO),specifically designed for small object detection in remote sensing.To address feature loss in deep layers,we have devised a cross-layer attention fusion module.Background noise is effectively filtered through the incorporation of Bi-Level Routing Attention(BRA).To enhance the model’s capacity to perceive multi-scale objects,particularly small-scale objects,we introduce a weightedmulti-receptive field atrous spatial pyramid poolingmodule.Furthermore,wemitigate the sensitivity arising from bounding box perturbation by incorporating the joint Normalized Wasserstein Distance(NWD)and Efficient Intersection over Union(EIoU)losses.The efficacy of the proposedmodel in detecting small objects in remote sensing has been validated through experiments conducted on three publicly available datasets.The experimental results unequivocally demonstrate the model’s pronounced advantages in small object detection for remote sensing,surpassing the performance of current mainstream models.
文摘Objective This paper proposed a novel algorithm of discrete wavelet transform(DWT) which is used for multimodal medical image fusion. Methods The source medical images are initially transformed by DWT followed by fusing low and high frequency sub-images. Then, the "coefficient absolute value" that can provide clear and detail parts is adapted to fuse high-frequency coefficients, where as the "region energy ratio" which can efficiently preserve most information of source images is employed to fuse low-frequency coefficients. Finally, the fused image is reconstructed by inverse wavelet transform. Results Visually and quantitatively experimental results indicate that the proposed fusion method is superior to traditional wavelet transform and the existing fusion methods. Conclusion The proposed method is a feasible approach for multimodal medical image fusion which can obtain more efficient and accurate fusions results even in the noise environment.
基金This work was supported by the National Natural Science Foundation of China(Nos.61903170,62173175,61877033)the Natural Science Foundation of Shandong Province(Nos.ZR2019BF045,ZR2019MF021)the Key Research and Development Project of Shandong Province of China(No.2019GGX101003).
文摘Walking as a unique biometric tool conveys important information for emotion recognition.Individuals in different emotional states exhibit distinct walking patterns.For this purpose,this paper proposes a novel approach to recognizing emotion during walking using electroencephalogram(EEG)and inertial signals.Accurate recognition of emotion is achieved by training in an end-to-end deep learning fashion and taking into account multi-modal fusion.Subjects wear virtual reality head-mounted display(VR-HMD)equipment to immerse in strong emotions during walking.VR environment shows excellent imitation and experience ability,which plays an important role in awakening and changing emotions.In addition,the multi-modal signals acquired from EEG and inertial sensors are separately represented as virtual emotion images by discrete wavelet transform(DWT).These serve as input to the attention-based convolutional neural network(CNN)fusion model.The designed network structure is simple and lightweight while integrating the channel attention mechanism to extract and enhance features.To effectively improve the performance of the recognition system,the proposed decision fusion algorithm combines Critic method and majority voting strategy to determine the weight values that affect the final decision results.An investigation is made on the effect of diverse mother wavelet types and wavelet decomposition levels on model performance which indicates that the 2.2-order reverse biorthogonal(rbio2.2)wavelet with two-level decomposition has the best recognition performance.Comparative experiment results show that the proposed method outperforms other existing state-of-the-art works with an accuracy of 98.73%.
文摘Assuring medical images protection and robustness is a compulsory necessity nowadays.In this paper,a novel technique is proposed that fuses the wavelet-induced multi-resolution decomposition of the Discrete Wavelet Transform(DWT)with the energy compaction of the Discrete Wavelet Transform(DCT).The multi-level Encryption-based Hybrid Fusion Technique(EbhFT)aims to achieve great advances in terms of imperceptibility and security of medical images.A DWT disintegrated sub-band of a cover image is reformed simultaneously using the DCT transform.Afterwards,a 64-bit hex key is employed to encrypt the host image as well as participate in the second key creation process to encode the watermark.Lastly,a PN-sequence key is formed along with a supplementary key in the third layer of the EbHFT.Thus,the watermarked image is generated by enclosing both keys into DWT and DCT coefficients.The fusions ability of the proposed EbHFT technique makes the best use of the distinct privileges of using both DWT and DCT methods.In order to validate the proposed technique,a standard dataset of medical images is used.Simulation results show higher performance of the visual quality(i.e.,57.65)for the watermarked forms of all types of medical images.In addition,EbHFT robustness outperforms an existing scheme tested for the same dataset in terms of Normalized Correlation(NC).Finally,extra protection for digital images from against illegal replicating and unapproved tampering using the proposed technique.
基金Project supported by the National Natural Science Foundation of China (No. 60375008), China Aviation Science Foundation (No.02D57003), China Ph.D Discipline Special Foundation (No.20020248029), and Shanghai Key Scientific Project (No.02DZ15001), China
文摘This paper proposes a novel region based image fusion scheme based on multiresolution analysis. The low frequency band of the image multiresolution representation is segmented into important regions, sub-important regions and background regions. Each feature of the regions is used to determine the region’s degree of membership in the multiresolution representation, and then to achieve multiresolution representation of the fusion result. The final image fusion result can be obtained by using the inverse multiresolution transform. Experiments showed that the proposed image fusion method can have better performance than existing image fusion methods.
文摘For the last two decades,physicians and clinical experts have used a single imaging modality to identify the normal and abnormal structure of the human body.However,most of the time,medical experts are unable to accurately analyze and examine the information from a single imaging modality due to the limited information.To overcome this problem,a multimodal approach is adopted to increase the qualitative and quantitative medical information which helps the doctors to easily diagnose diseases in their early stages.In the proposed method,a Multi-resolution Rigid Registration(MRR)technique is used for multimodal image registration while Discrete Wavelet Transform(DWT)along with Principal Component Averaging(PCAv)is utilized for image fusion.The proposed MRR method provides more accurate results as compared with Single Rigid Registration(SRR),while the proposed DWT-PCAv fusion process adds-on more constructive information with less computational time.The proposed method is tested on CT and MRI brain imaging modalities of the HARVARD dataset.The fusion results of the proposed method are compared with the existing fusion techniques.The quality assessment metrics such as Mutual Information(MI),Normalize Crosscorrelation(NCC)and Feature Mutual Information(FMI)are computed for statistical comparison of the proposed method.The proposed methodology provides more accurate results,better image quality and valuable information for medical diagnoses.
基金supported by National Natural Science Foundation of China(Grant No.51705170)National Research Foundation,Prime Minister’s Office,Singapore,under its Campus for Research Excellence and Technological Enterprise(CREATE)Program(Grant.No.NRF2018-ITS004-0011)Joint Funds of the National Natural Science Foundation of China(Grant No.U1808216).
文摘Laser powder bed fusion(LPBF)is a popular metal additive manufacturing technique.Generally,the materials employed for LPBF are discrete and particulate metal matters.Thus,the discontinuous behaviors exhibited by the powder materials cannot be simulated solely using conventional continuum-based computational approaches,such as finite-element or finite-difference methods.The discrete element method(DEM)is a proven numerical method to model discrete matter,such as powder particles,by tracking the motion and temperature of individual particles.Recently,DEM simulation has gained popularity in LPBF studies.However,it has not been widely applied.This study reviews the existing applications of DEM in LPBF processing,such as powder spreading and fusion.A review of the existing literature indicates that DEM is a promising approach in the study of the kinetic and thermal fluid behaviors of powder particles in LPBF additive manufacturing.