The aim of this study was to report a case of multi-visceral sarcoidosis at the Mother-Child Hospital Center (CHME) “Le Luxembourg” in Bamako, Mali. Observation: This is a patient aged 62 at the time of consultation...The aim of this study was to report a case of multi-visceral sarcoidosis at the Mother-Child Hospital Center (CHME) “Le Luxembourg” in Bamako, Mali. Observation: This is a patient aged 62 at the time of consultation, a housewife, residing in the Banconi district, who was referred to us for thoracic-abdominopelvic imaging for chronic liver disease. After several diagnostic errors, the thoracic-abdominopelvic CT scan and liver MRI performed in our center showed, at the thoracoabdominal level, bilateral diffuse pulmonary micronodules and bilateral mediastinal-hilar lymphadenopathy;on the abdominal level, a dysmorphic liver with plaques of steatosis and a granular appearance of the liver parenchyma without periportal fibrosis. These imaging data combined with those from the liver nodule biopsy and biology confirmed the diagnosis of sarcoidosis type II. Treatment with corticosteroids gave satisfactory results and the patient recovered after 18 months. Clinical and CT monitoring 2 years from the start of the disease and 2 months from the end of treatment showed complete resolution of the lesions. Conclusion: The multi-visceral location of sarcoidosis is an entity whose diagnosis remains difficult;diagnostic and interventional imaging has an important place in its management.展开更多
In the fusion of image,how to measure the local character and clarity is called activity measurement. According to the problem,the traditional measurement is decided only by the high-frequency detail coefficients, whi...In the fusion of image,how to measure the local character and clarity is called activity measurement. According to the problem,the traditional measurement is decided only by the high-frequency detail coefficients, which will make the energy expression insufficient to reflect the local clarity. Therefore,in this paper,a novel construction method for activity measurement is proposed. Firstly,it uses the wavelet decomposition for the fusion resource image, and then utilizes the high and low frequency wavelet coefficients synthetically. Meantime,it takes the normalized variance as the weight of high-frequency energy. Secondly,it calculates the measurement by the weighted energy,which can be used to measure the local character. Finally,the fusion coefficients can be got. In order to illustrate the superiority of this new method,three kinds of assessing indicators are provided. The experiment results show that,comparing with the traditional methods,this new method weakens the fuzzy and promotes the indicator value. Therefore,it has much more advantages for practical application.展开更多
Convolutional neural networks (CNNs) are widely used in image classification tasks, but their increasing model size and computation make them challenging to implement on embedded systems with constrained hardware reso...Convolutional neural networks (CNNs) are widely used in image classification tasks, but their increasing model size and computation make them challenging to implement on embedded systems with constrained hardware resources. To address this issue, the MobileNetV1 network was developed, which employs depthwise convolution to reduce network complexity. MobileNetV1 employs a stride of 2 in several convolutional layers to decrease the spatial resolution of feature maps, thereby lowering computational costs. However, this stride setting can lead to a loss of spatial information, particularly affecting the detection and representation of smaller objects or finer details in images. To maintain the trade-off between complexity and model performance, a lightweight convolutional neural network with hierarchical multi-scale feature fusion based on the MobileNetV1 network is proposed. The network consists of two main subnetworks. The first subnetwork uses a depthwise dilated separable convolution (DDSC) layer to learn imaging features with fewer parameters, which results in a lightweight and computationally inexpensive network. Furthermore, depthwise dilated convolution in DDSC layer effectively expands the field of view of filters, allowing them to incorporate a larger context. The second subnetwork is a hierarchical multi-scale feature fusion (HMFF) module that uses parallel multi-resolution branches architecture to process the input feature map in order to extract the multi-scale feature information of the input image. Experimental results on the CIFAR-10, Malaria, and KvasirV1 datasets demonstrate that the proposed method is efficient, reducing the network parameters and computational cost by 65.02% and 39.78%, respectively, while maintaining the network performance compared to the MobileNetV1 baseline.展开更多
Due to limited depth-of-field of digital single-lens reflex cameras,the scene content within a limited distance from the imaging plane remains in focus while other objects closer to or further away from the point of f...Due to limited depth-of-field of digital single-lens reflex cameras,the scene content within a limited distance from the imaging plane remains in focus while other objects closer to or further away from the point of focus appear as blurred(out-of-focus)in the image.Multi-Focus Image Fusion can be used to reconstruct a fully focused image from two or more partially focused images of the same scene.In this paper,a new Fuzzy Based Hybrid Focus Measure(FBHFM)for multi-focus image fusion has been proposed.Optimal block size is very critical step for multi-focus image fusion.Particle Swarm Optimization(PSO)algorithm has been used to find optimal size of the block of the images for extraction of focus measure features.After finding optimal blocks,three focus measures Sum of Modified Laplacian,Gray Level Variance and Contrast Visibility has been extracted and combined these focus measures by using intelligent fuzzy technique.Fuzzy based hybrid intelligent focus values were estimated using contrast visibility measure to generate focused image.Different sets of multi-focus images have been used in detailed experimentation and compared the results with state-of-the-art existing techniques such as Genetic Algorithm(GA),Principal Component Analysis(PCA),Laplacian Pyramid discrete wavelet transform(DWT),and aDWT for image fusion.It has been found that proposed method performs well as compare to existing methods.展开更多
Considering the continuous advancement in the field of imaging sensor, a host of other new issues have emerged. A major problem is how to find focus areas more accurately for multi-focus image fusion. The multi-focus ...Considering the continuous advancement in the field of imaging sensor, a host of other new issues have emerged. A major problem is how to find focus areas more accurately for multi-focus image fusion. The multi-focus image fusion extracts the focused information from the source images to construct a global in-focus image which includes more information than any of the source images. In this paper, a novel multi-focus image fusion based on Laplacian operator and region optimization is proposed. The evaluation of image saliency based on Laplacian operator can easily distinguish the focus region and out of focus region. And the decision map obtained by Laplacian operator processing has less the residual information than other methods. For getting precise decision map, focus area and edge optimization based on regional connectivity and edge detection have been taken. Finally, the original images are fused through the decision map. Experimental results indicate that the proposed algorithm outperforms the other series of algorithms in terms of both subjective and objective evaluations.展开更多
Two key points of pixel-level multi-focus image fusion are the clarity measure and the pixel coeffi- cients fusion rule. Along with different improvements on these two points, various fusion schemes have been proposed...Two key points of pixel-level multi-focus image fusion are the clarity measure and the pixel coeffi- cients fusion rule. Along with different improvements on these two points, various fusion schemes have been proposed in literatures. However, the traditional clarity measures are not designed for compressive imaging measurements which are maps of source sense with random or likely ran- dom measurements matrix. This paper presents a novel efficient multi-focus image fusion frame- work for compressive imaging sensor network. Here the clarity measure of the raw compressive measurements is not obtained from the random sampling data itself but from the selected Hada- mard coefficients which can also be acquired from compressive imaging system efficiently. Then, the compressive measurements with different images are fused by selecting fusion rule. Finally, the block-based CS which coupled with iterative projection-based reconstruction is used to re- cover the fused image. Experimental results on common used testing data demonstrate the effectiveness of the proposed method.展开更多
In order to narrow the semantic gap existing in content-based image retrieval (CBIR),a novel retrieval technology called auto-extended multi query examples (AMQE) is proposed.It expands the single one query image ...In order to narrow the semantic gap existing in content-based image retrieval (CBIR),a novel retrieval technology called auto-extended multi query examples (AMQE) is proposed.It expands the single one query image used in traditional image retrieval into multi query examples so as to include more image features related with semantics.Retrieving images for each of the multi query examples and integrating the retrieval results,more relevant images can be obtained.The property of the recall-precision curve of a general retrieval algorithm and the K-means clustering method are used to realize the expansion according to the distance of image features of the initially retrieved images.The experimental results demonstrate that the AMQE technology can greatly improve the recall and precision of the original algorithms.展开更多
We report a novel stimulated Raman scattering(SRS)microscopy technique featuring phase-controlled light focusing and aberration corrections for rapid,deep tissue 3D chemical imaging with subcellular resolution.To acco...We report a novel stimulated Raman scattering(SRS)microscopy technique featuring phase-controlled light focusing and aberration corrections for rapid,deep tissue 3D chemical imaging with subcellular resolution.To accomplish phasecontrolled SRS(PC-SRS),we utilize a single spatial light modulator to electronically tune the axial positioning of both the shortened-length Bessel pump and the focused Gaussian Stokes beams,enabling z-scanning-free optical sectioning in the sample.By incorporating Zernike polynomials into the phase patterns,we simultaneously correct the system aberrations at two separate wavelengths(~240 nm difference),achieving a~3-fold enhancement in signal-to-noise ratio over the uncorrected imaging system.PC-SRS provides>2-fold improvement in imaging depth in various samples(e.g.,polystyrene bead phantoms,porcine brain tissue)as well as achieves SRS 3D imaging speed of~13 Hz per volume for real-time monitoring of Brownian motion of polymer beads in water,superior to conventional point-scanning SRS 3D imaging.We further utilize PC-SRS to observe the metabolic activities of the entire tumor liver in living zebrafish in cellsilent region,unraveling the upregulated metabolism in liver tumor compared to normal liver.This work shows that PCSRS provides unprecedented insights into morpho-chemistry,metabolic and dynamic functioning of live cells and tissue in real-time at the subcellular level.展开更多
Detecting brain tumours is complex due to the natural variation in their location, shape, and intensity in images. While having accurate detection and segmentation of brain tumours would be beneficial, current methods...Detecting brain tumours is complex due to the natural variation in their location, shape, and intensity in images. While having accurate detection and segmentation of brain tumours would be beneficial, current methods still need to solve this problem despite the numerous available approaches. Precise analysis of Magnetic Resonance Imaging (MRI) is crucial for detecting, segmenting, and classifying brain tumours in medical diagnostics. Magnetic Resonance Imaging is a vital component in medical diagnosis, and it requires precise, efficient, careful, efficient, and reliable image analysis techniques. The authors developed a Deep Learning (DL) fusion model to classify brain tumours reliably. Deep Learning models require large amounts of training data to achieve good results, so the researchers utilised data augmentation techniques to increase the dataset size for training models. VGG16, ResNet50, and convolutional deep belief networks networks extracted deep features from MRI images. Softmax was used as the classifier, and the training set was supplemented with intentionally created MRI images of brain tumours in addition to the genuine ones. The features of two DL models were combined in the proposed model to generate a fusion model, which significantly increased classification accuracy. An openly accessible dataset from the internet was used to test the model's performance, and the experimental results showed that the proposed fusion model achieved a classification accuracy of 98.98%. Finally, the results were compared with existing methods, and the proposed model outperformed them significantly.展开更多
As image manipulation technology advances rapidly,the malicious use of image tampering has alarmingly escalated,posing a significant threat to social stability.In the realm of image tampering localization,accurately l...As image manipulation technology advances rapidly,the malicious use of image tampering has alarmingly escalated,posing a significant threat to social stability.In the realm of image tampering localization,accurately localizing limited samples,multiple types,and various sizes of regions remains a multitude of challenges.These issues impede the model’s universality and generalization capability and detrimentally affect its performance.To tackle these issues,we propose FL-MobileViT-an improved MobileViT model devised for image tampering localization.Our proposed model utilizes a dual-stream architecture that independently processes the RGB and noise domain,and captures richer traces of tampering through dual-stream integration.Meanwhile,the model incorporating the Focused Linear Attention mechanism within the lightweight network(MobileViT).This substitution significantly diminishes computational complexity and resolves homogeneity problems associated with traditional Transformer attention mechanisms,enhancing feature extraction diversity and improving the model’s localization performance.To comprehensively fuse the generated results from both feature extractors,we introduce the ASPP architecture for multi-scale feature fusion.This facilitates a more precise localization of tampered regions of various sizes.Furthermore,to bolster the model’s generalization ability,we adopt a contrastive learning method and devise a joint optimization training strategy that leverages fused features and captures the disparities in feature distribution in tampered images.This strategy enables the learning of contrastive loss at various stages of the feature extractor and employs it as an additional constraint condition in conjunction with cross-entropy loss.As a result,overfitting issues are effectively alleviated,and the differentiation between tampered and untampered regions is enhanced.Experimental evaluations on five benchmark datasets(IMD-20,CASIA,NIST-16,Columbia and Coverage)validate the effectiveness of our proposed model.The meticulously calibrated FL-MobileViT model consistently outperforms numerous existing general models regarding localization accuracy across diverse datasets,demonstrating superior adaptability.展开更多
Image-guided high-intensity focused ultrasound (HIFU) has been used for more than ten years, primarily in the treatment of liver and prostate cancers. HIFU has the advantages of precise cancer ablation and excellent p...Image-guided high-intensity focused ultrasound (HIFU) has been used for more than ten years, primarily in the treatment of liver and prostate cancers. HIFU has the advantages of precise cancer ablation and excellent protection of healthy tissue. Breast cancer is a common cancer in women. HIFU therapy, in combination with other therapies, has the potential to improve both oncologic and cosmetic outcomes for breast cancer patients by providing a curative therapy that conserves mammary shape. Currently, HIFU therapy is not commonly used in breast cancer treatment, and efforts to promote the application of HIFU is expected. In this article, we compare different image-guided models for HIFU and reviewed the status, drawbacks, and potential of HIFU therapy for breast cancer.展开更多
BACKGROUND Conventional magnifying endoscopy with narrow-band imaging(NBI)observation of the gastric body mucosa shows dominant patterns in relation to the regular arrangement of collecting venules,subepithelial capil...BACKGROUND Conventional magnifying endoscopy with narrow-band imaging(NBI)observation of the gastric body mucosa shows dominant patterns in relation to the regular arrangement of collecting venules,subepithelial capillary network,and gastric pits.AIM To evaluate the effectiveness of a new one-dual(near)focus,NBI mode in the assessment of the microscopic features of gastric body mucosa compared to conventional magnification.METHODS During 2021 and 2022,68 patients underwent proximal gastrointestinal endoscopy using magnification endoscopic modalities subsequently applying acetic acid(AA).The GIF-190HQ series NBI system with dual focus capability was used for the investigation of gastric mucosa.At the time of the endoscopy,the gastric body mucosa of all enrolled patients was photographed using the white light endoscopy(WLE),near focus(NF),NF-NBI,AA-NF,and AA-NF-NBI modes.RESULTS The WLE,NF and NF-NBI endoscopic modes for all patients(204 images)were classified in the same order into three groups.Two images from each patient for the AA-NF and AA-NF-NBI endoscopic modes were classified in the same order.According to all three observers who completed the work independently,NF magnification was significantly superior to WLE(P<0.01),and the NF-NBI mode was significantly superior to NF magnification(P<0.01).After applying AA,the three observers confirmed that AA-NF-NBI was significantly superior to AA-NF(P<0.01).Interobserver kappa values for WLE were 0.609,0.704,and 0.598,respectively and were 0.600,0.721,and 0.637,respectively,for NF magnification.For the NF-NBI mode,the values were 0.378,0.471,and 0.553,respectively.For AA-NF,they were 0.453,0.603,and 0.480,respectively,and for AA-NF-NBI,they were 0.643,0.506,and 0.354,respectively.CONCLUSION When investigating gastric mucosa in microscopic detail,NF-NBI was the most powerful endoscopic mode for assessing regular arrangement of collecting venules,subepithelial capillary network,and gastric pits among the five endoscopic modalities investigated in this study.AA-NF-NBI was the most powerful endoscopic mode for analyzing crypt opening and intervening part.展开更多
Based on the diffraction theory model for hot-image formation, the evolution of hot-images induced by multiscatterers located in the same plane perpendicular to the propagation axis is numerically simulated. The simul...Based on the diffraction theory model for hot-image formation, the evolution of hot-images induced by multiscatterers located in the same plane perpendicular to the propagation axis is numerically simulated. The simulation results show that hot-images induced by coplanar multi-scatterers are also coplanar no matter whether they exist simultaneously or severally. However, if they exist simultaneously the peak intensity of the primary hot-images is weaker than if they exist severally. The unequal competition for energy between the scattered beams from the scatterers leads to the fact that part of the corresponding hot-images are relatively enhanced and the others are restrained. The results show that the hot-images of certain scatterers become stronger when any of these parameters, i.e. amplitude modulation coefficient, phase modulation coefficient and size of the surrounding scatterer, decrease.展开更多
Considering that there is no single full reference image quality assessment method that could give the best performance in all situations, some multi-method fusion metrics were proposed. Machine learning techniques ar...Considering that there is no single full reference image quality assessment method that could give the best performance in all situations, some multi-method fusion metrics were proposed. Machine learning techniques are often involved in such multi-method fusion metrics so that its output would be more consistent with human visual perceptions. On the other hand, the robustness and generalization ability of these multi-method fusion metrics are questioned because of the scarce of images with mean opinion scores. In order to comprehensively validate whether or not the generalization ability of such multi-method fusion IQA metrics are satisfying, we construct a new image database which contains up to 60 reference images. The newly built image database is then used to test the generalization ability of different multi-method fusion IQA metrics. Cross database validation experiment indicates that in our new image database, the performances of all the multi-method fusion IQA metrics have no statistical significant different with some single-method IQA metrics such as FSIM and MAD. In the end, a thorough analysis is given to explain why the performance of multi-method fusion IQA framework drop significantly in cross database validation.展开更多
Mixture model based image segmentation method, which assumes that image pixels are independent and do not consider the position relationship between pixels, is not robust to noise and usually leads to misclassificatio...Mixture model based image segmentation method, which assumes that image pixels are independent and do not consider the position relationship between pixels, is not robust to noise and usually leads to misclassification. A new segmentation method, called multi-resolution Ganssian mixture model method, is proposed. First, an image pyramid is constructed and son-father link relationship is built between each level of pyramid. Then the mixture model segmentation method is applied to the top level. The segmentation result on the top level is passed top-down to the bottom level according to the son-father link relationship between levels. The proposed method considers not only local but also global information of image, it overcomes the effect of noise and can obtain better segmentation result. Experimental result demonstrates its effectiveness.展开更多
Pigmented spot is an important branch in the science of skin. But when processing those images, the microscopical focusing problem arises. It affects the image recognition later. In order to find the best method to so...Pigmented spot is an important branch in the science of skin. But when processing those images, the microscopical focusing problem arises. It affects the image recognition later. In order to find the best method to solve it, comparison and analysis are given to various existing methods of image fusion in this paper . The conclusion is wavelet transform based on pixel-level.展开更多
To overcome the shortcomings of 1 D and 2 D Otsu’s thresholding techniques, the 3 D Otsu method has been developed.Among all Otsu’s methods, 3 D Otsu technique provides the best threshold values for the multi-level ...To overcome the shortcomings of 1 D and 2 D Otsu’s thresholding techniques, the 3 D Otsu method has been developed.Among all Otsu’s methods, 3 D Otsu technique provides the best threshold values for the multi-level thresholding processes. In this paper, to improve the quality of segmented images, a simple and effective multilevel thresholding method is introduced. The proposed approach focuses on preserving edge detail by computing the 3 D Otsu along the fusion phenomena. The advantages of the presented scheme include higher quality outcomes, better preservation of tiny details and boundaries and reduced execution time with rising threshold levels. The fusion approach depends upon the differences between pixel intensity values within a small local space of an image;it aims to improve localized information after the thresholding process. The fusion of images based on local contrast can improve image segmentation performance by minimizing the loss of local contrast, loss of details and gray-level distributions. Results show that the proposed method yields more promising segmentation results when compared to conventional1 D Otsu, 2 D Otsu and 3 D Otsu methods, as evident from the objective and subjective evaluations.展开更多
Removal of cloud cover on the satellite remote sensing image can effectively improve the availability of remote sensing images. For thin cloud cover, support vector value contourlet transform is used to achieve multi-...Removal of cloud cover on the satellite remote sensing image can effectively improve the availability of remote sensing images. For thin cloud cover, support vector value contourlet transform is used to achieve multi-scale decomposition of the area of thin cloud cover on remote sensing images. Through enhancing coefficients of high frequency and suppressing coefficients of low frequency, the thin cloud is removed. For thick cloud cover, if the areas of thick cloud cover on multi-source or multi-temporal remote sensing images do not overlap, the multi-output support vector regression learning method is used to remove this kind of thick clouds. If the thick cloud cover areas overlap, by using the multi-output learning of the surrounding areas to predict the surface features of the overlapped thick cloud cover areas, this kind of thick cloud is removed. Experimental results show that the proposed cloud removal method can effectively solve the problems of the cloud overlapping and radiation difference among multi-source images. The cloud removal image is clear and smooth.展开更多
Histogram of collinear gradient-enhanced coding (HCGEC), a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detaile...Histogram of collinear gradient-enhanced coding (HCGEC), a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detailed textural information, which is desirable in multi-spectral image matching. Experiments on two multi-spectral data sets demonstrate that the proposed descriptor can yield significantly better results than some state-of- the-art descriptors.展开更多
To overcome the inherent limits of traditional single wave imaging for nondestructive testing,the multi-wave focusing and imaging method is thoroughly studied.This method makes the compressional waves and shear waves ...To overcome the inherent limits of traditional single wave imaging for nondestructive testing,the multi-wave focusing and imaging method is thoroughly studied.This method makes the compressional waves and shear waves focused in both emission and reception processes,which strengthens the focusing energy and improves the signal-to-noise ratio of received signals.A numerical model is developed to study the characteristics of a multi-wave focusing field.It is shown that the element width approaching 0.8 wavelengths of shear waves can keep a balance between the radiation energy of two waves,which can achieve a desirable multi-wave focusing performance.And an experiment using different imaging methods for a linear phased array is performed.It can be concluded that due to the combination of the propagation and reflection characteristics of two waves,the multi-wave focusing and imaging method can significantly improve the imaging distinguishability of defects and expand the available sweeping range to a sector of-650 to 65°.展开更多
文摘The aim of this study was to report a case of multi-visceral sarcoidosis at the Mother-Child Hospital Center (CHME) “Le Luxembourg” in Bamako, Mali. Observation: This is a patient aged 62 at the time of consultation, a housewife, residing in the Banconi district, who was referred to us for thoracic-abdominopelvic imaging for chronic liver disease. After several diagnostic errors, the thoracic-abdominopelvic CT scan and liver MRI performed in our center showed, at the thoracoabdominal level, bilateral diffuse pulmonary micronodules and bilateral mediastinal-hilar lymphadenopathy;on the abdominal level, a dysmorphic liver with plaques of steatosis and a granular appearance of the liver parenchyma without periportal fibrosis. These imaging data combined with those from the liver nodule biopsy and biology confirmed the diagnosis of sarcoidosis type II. Treatment with corticosteroids gave satisfactory results and the patient recovered after 18 months. Clinical and CT monitoring 2 years from the start of the disease and 2 months from the end of treatment showed complete resolution of the lesions. Conclusion: The multi-visceral location of sarcoidosis is an entity whose diagnosis remains difficult;diagnostic and interventional imaging has an important place in its management.
基金Sponsored by the Nation Nature Science Foundation of China(Grant No.61275010,61201237)the Fundamental Research Funds for the Central Universities(Grant No.HEUCFZ1129,No.HEUCF120805)
文摘In the fusion of image,how to measure the local character and clarity is called activity measurement. According to the problem,the traditional measurement is decided only by the high-frequency detail coefficients, which will make the energy expression insufficient to reflect the local clarity. Therefore,in this paper,a novel construction method for activity measurement is proposed. Firstly,it uses the wavelet decomposition for the fusion resource image, and then utilizes the high and low frequency wavelet coefficients synthetically. Meantime,it takes the normalized variance as the weight of high-frequency energy. Secondly,it calculates the measurement by the weighted energy,which can be used to measure the local character. Finally,the fusion coefficients can be got. In order to illustrate the superiority of this new method,three kinds of assessing indicators are provided. The experiment results show that,comparing with the traditional methods,this new method weakens the fuzzy and promotes the indicator value. Therefore,it has much more advantages for practical application.
文摘Convolutional neural networks (CNNs) are widely used in image classification tasks, but their increasing model size and computation make them challenging to implement on embedded systems with constrained hardware resources. To address this issue, the MobileNetV1 network was developed, which employs depthwise convolution to reduce network complexity. MobileNetV1 employs a stride of 2 in several convolutional layers to decrease the spatial resolution of feature maps, thereby lowering computational costs. However, this stride setting can lead to a loss of spatial information, particularly affecting the detection and representation of smaller objects or finer details in images. To maintain the trade-off between complexity and model performance, a lightweight convolutional neural network with hierarchical multi-scale feature fusion based on the MobileNetV1 network is proposed. The network consists of two main subnetworks. The first subnetwork uses a depthwise dilated separable convolution (DDSC) layer to learn imaging features with fewer parameters, which results in a lightweight and computationally inexpensive network. Furthermore, depthwise dilated convolution in DDSC layer effectively expands the field of view of filters, allowing them to incorporate a larger context. The second subnetwork is a hierarchical multi-scale feature fusion (HMFF) module that uses parallel multi-resolution branches architecture to process the input feature map in order to extract the multi-scale feature information of the input image. Experimental results on the CIFAR-10, Malaria, and KvasirV1 datasets demonstrate that the proposed method is efficient, reducing the network parameters and computational cost by 65.02% and 39.78%, respectively, while maintaining the network performance compared to the MobileNetV1 baseline.
文摘Due to limited depth-of-field of digital single-lens reflex cameras,the scene content within a limited distance from the imaging plane remains in focus while other objects closer to or further away from the point of focus appear as blurred(out-of-focus)in the image.Multi-Focus Image Fusion can be used to reconstruct a fully focused image from two or more partially focused images of the same scene.In this paper,a new Fuzzy Based Hybrid Focus Measure(FBHFM)for multi-focus image fusion has been proposed.Optimal block size is very critical step for multi-focus image fusion.Particle Swarm Optimization(PSO)algorithm has been used to find optimal size of the block of the images for extraction of focus measure features.After finding optimal blocks,three focus measures Sum of Modified Laplacian,Gray Level Variance and Contrast Visibility has been extracted and combined these focus measures by using intelligent fuzzy technique.Fuzzy based hybrid intelligent focus values were estimated using contrast visibility measure to generate focused image.Different sets of multi-focus images have been used in detailed experimentation and compared the results with state-of-the-art existing techniques such as Genetic Algorithm(GA),Principal Component Analysis(PCA),Laplacian Pyramid discrete wavelet transform(DWT),and aDWT for image fusion.It has been found that proposed method performs well as compare to existing methods.
文摘Considering the continuous advancement in the field of imaging sensor, a host of other new issues have emerged. A major problem is how to find focus areas more accurately for multi-focus image fusion. The multi-focus image fusion extracts the focused information from the source images to construct a global in-focus image which includes more information than any of the source images. In this paper, a novel multi-focus image fusion based on Laplacian operator and region optimization is proposed. The evaluation of image saliency based on Laplacian operator can easily distinguish the focus region and out of focus region. And the decision map obtained by Laplacian operator processing has less the residual information than other methods. For getting precise decision map, focus area and edge optimization based on regional connectivity and edge detection have been taken. Finally, the original images are fused through the decision map. Experimental results indicate that the proposed algorithm outperforms the other series of algorithms in terms of both subjective and objective evaluations.
文摘Two key points of pixel-level multi-focus image fusion are the clarity measure and the pixel coeffi- cients fusion rule. Along with different improvements on these two points, various fusion schemes have been proposed in literatures. However, the traditional clarity measures are not designed for compressive imaging measurements which are maps of source sense with random or likely ran- dom measurements matrix. This paper presents a novel efficient multi-focus image fusion frame- work for compressive imaging sensor network. Here the clarity measure of the raw compressive measurements is not obtained from the random sampling data itself but from the selected Hada- mard coefficients which can also be acquired from compressive imaging system efficiently. Then, the compressive measurements with different images are fused by selecting fusion rule. Finally, the block-based CS which coupled with iterative projection-based reconstruction is used to re- cover the fused image. Experimental results on common used testing data demonstrate the effectiveness of the proposed method.
基金The National High Technology Research and Develop-ment Program of China (863 Program) (No.2002AA413420).
文摘In order to narrow the semantic gap existing in content-based image retrieval (CBIR),a novel retrieval technology called auto-extended multi query examples (AMQE) is proposed.It expands the single one query image used in traditional image retrieval into multi query examples so as to include more image features related with semantics.Retrieving images for each of the multi query examples and integrating the retrieval results,more relevant images can be obtained.The property of the recall-precision curve of a general retrieval algorithm and the K-means clustering method are used to realize the expansion according to the distance of image features of the initially retrieved images.The experimental results demonstrate that the AMQE technology can greatly improve the recall and precision of the original algorithms.
基金supported by the Academic Research Fund(AcRF)from the Ministry of Education(MOE)(Tier 2(A-8000117-01-00)Tier 1(R397-000-334-114,R397-000-371-114,and R397-000-378-114)2024 Tsinghua-NUS Joint Research Initiative Fund,and the National Medical Research Council(NMRC)(A-0009502-01-00,and A-8001143-00-00),Singapore.
文摘We report a novel stimulated Raman scattering(SRS)microscopy technique featuring phase-controlled light focusing and aberration corrections for rapid,deep tissue 3D chemical imaging with subcellular resolution.To accomplish phasecontrolled SRS(PC-SRS),we utilize a single spatial light modulator to electronically tune the axial positioning of both the shortened-length Bessel pump and the focused Gaussian Stokes beams,enabling z-scanning-free optical sectioning in the sample.By incorporating Zernike polynomials into the phase patterns,we simultaneously correct the system aberrations at two separate wavelengths(~240 nm difference),achieving a~3-fold enhancement in signal-to-noise ratio over the uncorrected imaging system.PC-SRS provides>2-fold improvement in imaging depth in various samples(e.g.,polystyrene bead phantoms,porcine brain tissue)as well as achieves SRS 3D imaging speed of~13 Hz per volume for real-time monitoring of Brownian motion of polymer beads in water,superior to conventional point-scanning SRS 3D imaging.We further utilize PC-SRS to observe the metabolic activities of the entire tumor liver in living zebrafish in cellsilent region,unraveling the upregulated metabolism in liver tumor compared to normal liver.This work shows that PCSRS provides unprecedented insights into morpho-chemistry,metabolic and dynamic functioning of live cells and tissue in real-time at the subcellular level.
基金Ministry of Education,Youth and Sports of the Chezk Republic,Grant/Award Numbers:SP2023/039,SP2023/042the European Union under the REFRESH,Grant/Award Number:CZ.10.03.01/00/22_003/0000048。
文摘Detecting brain tumours is complex due to the natural variation in their location, shape, and intensity in images. While having accurate detection and segmentation of brain tumours would be beneficial, current methods still need to solve this problem despite the numerous available approaches. Precise analysis of Magnetic Resonance Imaging (MRI) is crucial for detecting, segmenting, and classifying brain tumours in medical diagnostics. Magnetic Resonance Imaging is a vital component in medical diagnosis, and it requires precise, efficient, careful, efficient, and reliable image analysis techniques. The authors developed a Deep Learning (DL) fusion model to classify brain tumours reliably. Deep Learning models require large amounts of training data to achieve good results, so the researchers utilised data augmentation techniques to increase the dataset size for training models. VGG16, ResNet50, and convolutional deep belief networks networks extracted deep features from MRI images. Softmax was used as the classifier, and the training set was supplemented with intentionally created MRI images of brain tumours in addition to the genuine ones. The features of two DL models were combined in the proposed model to generate a fusion model, which significantly increased classification accuracy. An openly accessible dataset from the internet was used to test the model's performance, and the experimental results showed that the proposed fusion model achieved a classification accuracy of 98.98%. Finally, the results were compared with existing methods, and the proposed model outperformed them significantly.
基金This study was funded by the Science and Technology Project in Xi’an(No.22GXFW0123)this work was supported by the Special Fund Construction Project of Key Disciplines in Ordinary Colleges and Universities in Shaanxi Province,the authors would like to thank the anonymous reviewers for their helpful comments and suggestions.
文摘As image manipulation technology advances rapidly,the malicious use of image tampering has alarmingly escalated,posing a significant threat to social stability.In the realm of image tampering localization,accurately localizing limited samples,multiple types,and various sizes of regions remains a multitude of challenges.These issues impede the model’s universality and generalization capability and detrimentally affect its performance.To tackle these issues,we propose FL-MobileViT-an improved MobileViT model devised for image tampering localization.Our proposed model utilizes a dual-stream architecture that independently processes the RGB and noise domain,and captures richer traces of tampering through dual-stream integration.Meanwhile,the model incorporating the Focused Linear Attention mechanism within the lightweight network(MobileViT).This substitution significantly diminishes computational complexity and resolves homogeneity problems associated with traditional Transformer attention mechanisms,enhancing feature extraction diversity and improving the model’s localization performance.To comprehensively fuse the generated results from both feature extractors,we introduce the ASPP architecture for multi-scale feature fusion.This facilitates a more precise localization of tampered regions of various sizes.Furthermore,to bolster the model’s generalization ability,we adopt a contrastive learning method and devise a joint optimization training strategy that leverages fused features and captures the disparities in feature distribution in tampered images.This strategy enables the learning of contrastive loss at various stages of the feature extractor and employs it as an additional constraint condition in conjunction with cross-entropy loss.As a result,overfitting issues are effectively alleviated,and the differentiation between tampered and untampered regions is enhanced.Experimental evaluations on five benchmark datasets(IMD-20,CASIA,NIST-16,Columbia and Coverage)validate the effectiveness of our proposed model.The meticulously calibrated FL-MobileViT model consistently outperforms numerous existing general models regarding localization accuracy across diverse datasets,demonstrating superior adaptability.
文摘Image-guided high-intensity focused ultrasound (HIFU) has been used for more than ten years, primarily in the treatment of liver and prostate cancers. HIFU has the advantages of precise cancer ablation and excellent protection of healthy tissue. Breast cancer is a common cancer in women. HIFU therapy, in combination with other therapies, has the potential to improve both oncologic and cosmetic outcomes for breast cancer patients by providing a curative therapy that conserves mammary shape. Currently, HIFU therapy is not commonly used in breast cancer treatment, and efforts to promote the application of HIFU is expected. In this article, we compare different image-guided models for HIFU and reviewed the status, drawbacks, and potential of HIFU therapy for breast cancer.
文摘BACKGROUND Conventional magnifying endoscopy with narrow-band imaging(NBI)observation of the gastric body mucosa shows dominant patterns in relation to the regular arrangement of collecting venules,subepithelial capillary network,and gastric pits.AIM To evaluate the effectiveness of a new one-dual(near)focus,NBI mode in the assessment of the microscopic features of gastric body mucosa compared to conventional magnification.METHODS During 2021 and 2022,68 patients underwent proximal gastrointestinal endoscopy using magnification endoscopic modalities subsequently applying acetic acid(AA).The GIF-190HQ series NBI system with dual focus capability was used for the investigation of gastric mucosa.At the time of the endoscopy,the gastric body mucosa of all enrolled patients was photographed using the white light endoscopy(WLE),near focus(NF),NF-NBI,AA-NF,and AA-NF-NBI modes.RESULTS The WLE,NF and NF-NBI endoscopic modes for all patients(204 images)were classified in the same order into three groups.Two images from each patient for the AA-NF and AA-NF-NBI endoscopic modes were classified in the same order.According to all three observers who completed the work independently,NF magnification was significantly superior to WLE(P<0.01),and the NF-NBI mode was significantly superior to NF magnification(P<0.01).After applying AA,the three observers confirmed that AA-NF-NBI was significantly superior to AA-NF(P<0.01).Interobserver kappa values for WLE were 0.609,0.704,and 0.598,respectively and were 0.600,0.721,and 0.637,respectively,for NF magnification.For the NF-NBI mode,the values were 0.378,0.471,and 0.553,respectively.For AA-NF,they were 0.453,0.603,and 0.480,respectively,and for AA-NF-NBI,they were 0.643,0.506,and 0.354,respectively.CONCLUSION When investigating gastric mucosa in microscopic detail,NF-NBI was the most powerful endoscopic mode for assessing regular arrangement of collecting venules,subepithelial capillary network,and gastric pits among the five endoscopic modalities investigated in this study.AA-NF-NBI was the most powerful endoscopic mode for analyzing crypt opening and intervening part.
基金supported by the Joint Foundation of National Natural Science Foundation of China and the Science Foundation of the Chinese Academy of Engineering Physics,China(Grant No 10576023)the Doctorate Foundation of Northwestern Polytechnical University,China(Grant No CX200714)
文摘Based on the diffraction theory model for hot-image formation, the evolution of hot-images induced by multiscatterers located in the same plane perpendicular to the propagation axis is numerically simulated. The simulation results show that hot-images induced by coplanar multi-scatterers are also coplanar no matter whether they exist simultaneously or severally. However, if they exist simultaneously the peak intensity of the primary hot-images is weaker than if they exist severally. The unequal competition for energy between the scattered beams from the scatterers leads to the fact that part of the corresponding hot-images are relatively enhanced and the others are restrained. The results show that the hot-images of certain scatterers become stronger when any of these parameters, i.e. amplitude modulation coefficient, phase modulation coefficient and size of the surrounding scatterer, decrease.
基金supported by “the Fundamental Research Funds for the Central Universities” No.2018CUCTJ081
文摘Considering that there is no single full reference image quality assessment method that could give the best performance in all situations, some multi-method fusion metrics were proposed. Machine learning techniques are often involved in such multi-method fusion metrics so that its output would be more consistent with human visual perceptions. On the other hand, the robustness and generalization ability of these multi-method fusion metrics are questioned because of the scarce of images with mean opinion scores. In order to comprehensively validate whether or not the generalization ability of such multi-method fusion IQA metrics are satisfying, we construct a new image database which contains up to 60 reference images. The newly built image database is then used to test the generalization ability of different multi-method fusion IQA metrics. Cross database validation experiment indicates that in our new image database, the performances of all the multi-method fusion IQA metrics have no statistical significant different with some single-method IQA metrics such as FSIM and MAD. In the end, a thorough analysis is given to explain why the performance of multi-method fusion IQA framework drop significantly in cross database validation.
基金This project was supported by the National Natural Foundation of China (60404022) and the Foundation of Department ofEducation of Hebei Province (2002209).
文摘Mixture model based image segmentation method, which assumes that image pixels are independent and do not consider the position relationship between pixels, is not robust to noise and usually leads to misclassification. A new segmentation method, called multi-resolution Ganssian mixture model method, is proposed. First, an image pyramid is constructed and son-father link relationship is built between each level of pyramid. Then the mixture model segmentation method is applied to the top level. The segmentation result on the top level is passed top-down to the bottom level according to the son-father link relationship between levels. The proposed method considers not only local but also global information of image, it overcomes the effect of noise and can obtain better segmentation result. Experimental result demonstrates its effectiveness.
文摘Pigmented spot is an important branch in the science of skin. But when processing those images, the microscopical focusing problem arises. It affects the image recognition later. In order to find the best method to solve it, comparison and analysis are given to various existing methods of image fusion in this paper . The conclusion is wavelet transform based on pixel-level.
文摘To overcome the shortcomings of 1 D and 2 D Otsu’s thresholding techniques, the 3 D Otsu method has been developed.Among all Otsu’s methods, 3 D Otsu technique provides the best threshold values for the multi-level thresholding processes. In this paper, to improve the quality of segmented images, a simple and effective multilevel thresholding method is introduced. The proposed approach focuses on preserving edge detail by computing the 3 D Otsu along the fusion phenomena. The advantages of the presented scheme include higher quality outcomes, better preservation of tiny details and boundaries and reduced execution time with rising threshold levels. The fusion approach depends upon the differences between pixel intensity values within a small local space of an image;it aims to improve localized information after the thresholding process. The fusion of images based on local contrast can improve image segmentation performance by minimizing the loss of local contrast, loss of details and gray-level distributions. Results show that the proposed method yields more promising segmentation results when compared to conventional1 D Otsu, 2 D Otsu and 3 D Otsu methods, as evident from the objective and subjective evaluations.
基金supported by the National Natural Science Foundation of China(61172127)the Natural Science Foundation of Anhui Province(1408085MF121)
文摘Removal of cloud cover on the satellite remote sensing image can effectively improve the availability of remote sensing images. For thin cloud cover, support vector value contourlet transform is used to achieve multi-scale decomposition of the area of thin cloud cover on remote sensing images. Through enhancing coefficients of high frequency and suppressing coefficients of low frequency, the thin cloud is removed. For thick cloud cover, if the areas of thick cloud cover on multi-source or multi-temporal remote sensing images do not overlap, the multi-output support vector regression learning method is used to remove this kind of thick clouds. If the thick cloud cover areas overlap, by using the multi-output learning of the surrounding areas to predict the surface features of the overlapped thick cloud cover areas, this kind of thick cloud is removed. Experimental results show that the proposed cloud removal method can effectively solve the problems of the cloud overlapping and radiation difference among multi-source images. The cloud removal image is clear and smooth.
文摘Histogram of collinear gradient-enhanced coding (HCGEC), a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detailed textural information, which is desirable in multi-spectral image matching. Experiments on two multi-spectral data sets demonstrate that the proposed descriptor can yield significantly better results than some state-of- the-art descriptors.
基金the National Natural Science Foundation of China(Grant No.11774377)。
文摘To overcome the inherent limits of traditional single wave imaging for nondestructive testing,the multi-wave focusing and imaging method is thoroughly studied.This method makes the compressional waves and shear waves focused in both emission and reception processes,which strengthens the focusing energy and improves the signal-to-noise ratio of received signals.A numerical model is developed to study the characteristics of a multi-wave focusing field.It is shown that the element width approaching 0.8 wavelengths of shear waves can keep a balance between the radiation energy of two waves,which can achieve a desirable multi-wave focusing performance.And an experiment using different imaging methods for a linear phased array is performed.It can be concluded that due to the combination of the propagation and reflection characteristics of two waves,the multi-wave focusing and imaging method can significantly improve the imaging distinguishability of defects and expand the available sweeping range to a sector of-650 to 65°.