We report a novel stimulated Raman scattering(SRS)microscopy technique featuring phase-controlled light focusing and aberration corrections for rapid,deep tissue 3D chemical imaging with subcellular resolution.To acco...We report a novel stimulated Raman scattering(SRS)microscopy technique featuring phase-controlled light focusing and aberration corrections for rapid,deep tissue 3D chemical imaging with subcellular resolution.To accomplish phasecontrolled SRS(PC-SRS),we utilize a single spatial light modulator to electronically tune the axial positioning of both the shortened-length Bessel pump and the focused Gaussian Stokes beams,enabling z-scanning-free optical sectioning in the sample.By incorporating Zernike polynomials into the phase patterns,we simultaneously correct the system aberrations at two separate wavelengths(~240 nm difference),achieving a~3-fold enhancement in signal-to-noise ratio over the uncorrected imaging system.PC-SRS provides>2-fold improvement in imaging depth in various samples(e.g.,polystyrene bead phantoms,porcine brain tissue)as well as achieves SRS 3D imaging speed of~13 Hz per volume for real-time monitoring of Brownian motion of polymer beads in water,superior to conventional point-scanning SRS 3D imaging.We further utilize PC-SRS to observe the metabolic activities of the entire tumor liver in living zebrafish in cellsilent region,unraveling the upregulated metabolism in liver tumor compared to normal liver.This work shows that PCSRS provides unprecedented insights into morpho-chemistry,metabolic and dynamic functioning of live cells and tissue in real-time at the subcellular level.展开更多
Sparse representation has attracted extensive attention and performed well on image super-resolution(SR) in the last decade. However, many current image SR methods face the contradiction of detail recovery and artif...Sparse representation has attracted extensive attention and performed well on image super-resolution(SR) in the last decade. However, many current image SR methods face the contradiction of detail recovery and artifact suppression. We propose a multi-resolution dictionary learning(MRDL) model to solve this contradiction, and give a fast single image SR method based on the MRDL model. To obtain the MRDL model, we first extract multi-scale patches by using our proposed adaptive patch partition method(APPM). The APPM divides images into patches of different sizes according to their detail richness. Then, the multiresolution dictionary pairs, which contain structural primitives of various resolutions, can be trained from these multi-scale patches.Owing to the MRDL strategy, our SR algorithm not only recovers details well, with less jag and noise, but also significantly improves the computational efficiency. Experimental results validate that our algorithm performs better than other SR methods in evaluation metrics and visual perception.展开更多
Image super-resolution(SR)is an important technique for improving the resolution and quality of images.With the great progress of deep learning,image super-resolution achieves remarkable improvements recently.In this ...Image super-resolution(SR)is an important technique for improving the resolution and quality of images.With the great progress of deep learning,image super-resolution achieves remarkable improvements recently.In this work,a brief survey on recent advances of deep learning based single image super-resolution methods is systematically described.The existing studies of SR techniques are roughly grouped into ten major categories.Besides,some other important issues are also introduced,such as publicly available benchmark datasets and performance evaluation metrics.Finally,this survey is concluded by highlighting four future trends.展开更多
Convolutional neural networks(CNNs) have shown great potential for image super-resolution(SR).However,most existing CNNs only reconstruct images in the spatial domain,resulting in insufficient high-frequency details o...Convolutional neural networks(CNNs) have shown great potential for image super-resolution(SR).However,most existing CNNs only reconstruct images in the spatial domain,resulting in insufficient high-frequency details of reconstructed images.To address this issue,a channel attention based wavelet cascaded network for image super-resolution(CWSR) is proposed.Specifically,a second-order channel attention(SOCA) mechanism is incorporated into the network,and the covariance matrix normalization is utilized to explore interdependencies between channel-wise features.Then,to boost the quality of residual features,the non-local module is adopted to further improve the global information integration ability of the network.Finally,taking the image loss in the spatial and wavelet domains into account,a dual-constrained loss function is proposed to optimize the network.Experimental results illustrate that CWSR outperforms several state-of-the-art methods in terms of both visual quality and quantitative metrics.展开更多
Previous deep learning-based super-resolution(SR)methods rely on the assumption that the degradation process is predefined(e.g.,bicubic downsampling).Thus,their performance would suffer from deterioration if the real ...Previous deep learning-based super-resolution(SR)methods rely on the assumption that the degradation process is predefined(e.g.,bicubic downsampling).Thus,their performance would suffer from deterioration if the real degradation is not consistent with the assumption.To deal with real-world scenarios,existing blind SR methods are committed to estimating both the degradation and the super-resolved image with an extra loss or iterative scheme.However,degradation estimation that requires more computation would result in limited SR performance due to the accumulated estimation errors.In this paper,we propose a contrastive regularization built upon contrastive learning to exploit both the information of blurry images and clear images as negative and positive samples,respectively.Contrastive regularization ensures that the restored image is pulled closer to the clear image and pushed far away from the blurry image in the representation space.Furthermore,instead of estimating the degradation,we extract global statistical prior information to capture the character of the distortion.Considering the coupling between the degradation and the low-resolution image,we embed the global prior into the distortion-specific SR network to make our method adaptive to the changes of distortions.We term our distortion-specific network with contrastive regularization as CRDNet.The extensive experiments on synthetic and realworld scenes demonstrate that our lightweight CRDNet surpasses state-of-the-art blind super-resolution approaches.展开更多
Super-resolution (SR) is a widely used tech- nology that increases image resolution using algorithmic methods. However, preserving the local edge structure and visual quality in infrared (IR) SR images is challeng...Super-resolution (SR) is a widely used tech- nology that increases image resolution using algorithmic methods. However, preserving the local edge structure and visual quality in infrared (IR) SR images is challenging because of their disadvantages, such as lack of detail, poor contrast, and blurry edges. Traditional and advanced methods maintain the quantitative measures, but they mostly fail to preserve edge and visual quality. This paper proposes an algorithm based on high frequency layer features. This algorithm focuses on the IR image edge texture in the reconstruction process. Experimental results show that the mean gradient of the IR image reconstructed by the proposed algorithm increased by 1.5, 1.4, and 1.2 times than that of the traditional algorithm based on L1- norm, L2-norm, and traditional mixed norm, respectively. The peak signal-to-noise ratio, structural similarity index, and visual effect of the reconstructed image also improved.展开更多
基金supported by the Academic Research Fund(AcRF)from the Ministry of Education(MOE)(Tier 2(A-8000117-01-00)Tier 1(R397-000-334-114,R397-000-371-114,and R397-000-378-114)2024 Tsinghua-NUS Joint Research Initiative Fund,and the National Medical Research Council(NMRC)(A-0009502-01-00,and A-8001143-00-00),Singapore.
文摘We report a novel stimulated Raman scattering(SRS)microscopy technique featuring phase-controlled light focusing and aberration corrections for rapid,deep tissue 3D chemical imaging with subcellular resolution.To accomplish phasecontrolled SRS(PC-SRS),we utilize a single spatial light modulator to electronically tune the axial positioning of both the shortened-length Bessel pump and the focused Gaussian Stokes beams,enabling z-scanning-free optical sectioning in the sample.By incorporating Zernike polynomials into the phase patterns,we simultaneously correct the system aberrations at two separate wavelengths(~240 nm difference),achieving a~3-fold enhancement in signal-to-noise ratio over the uncorrected imaging system.PC-SRS provides>2-fold improvement in imaging depth in various samples(e.g.,polystyrene bead phantoms,porcine brain tissue)as well as achieves SRS 3D imaging speed of~13 Hz per volume for real-time monitoring of Brownian motion of polymer beads in water,superior to conventional point-scanning SRS 3D imaging.We further utilize PC-SRS to observe the metabolic activities of the entire tumor liver in living zebrafish in cellsilent region,unraveling the upregulated metabolism in liver tumor compared to normal liver.This work shows that PCSRS provides unprecedented insights into morpho-chemistry,metabolic and dynamic functioning of live cells and tissue in real-time at the subcellular level.
文摘Sparse representation has attracted extensive attention and performed well on image super-resolution(SR) in the last decade. However, many current image SR methods face the contradiction of detail recovery and artifact suppression. We propose a multi-resolution dictionary learning(MRDL) model to solve this contradiction, and give a fast single image SR method based on the MRDL model. To obtain the MRDL model, we first extract multi-scale patches by using our proposed adaptive patch partition method(APPM). The APPM divides images into patches of different sizes according to their detail richness. Then, the multiresolution dictionary pairs, which contain structural primitives of various resolutions, can be trained from these multi-scale patches.Owing to the MRDL strategy, our SR algorithm not only recovers details well, with less jag and noise, but also significantly improves the computational efficiency. Experimental results validate that our algorithm performs better than other SR methods in evaluation metrics and visual perception.
基金the National Key Research and Development Program of China(No.2019YFB1405900)。
文摘Image super-resolution(SR)is an important technique for improving the resolution and quality of images.With the great progress of deep learning,image super-resolution achieves remarkable improvements recently.In this work,a brief survey on recent advances of deep learning based single image super-resolution methods is systematically described.The existing studies of SR techniques are roughly grouped into ten major categories.Besides,some other important issues are also introduced,such as publicly available benchmark datasets and performance evaluation metrics.Finally,this survey is concluded by highlighting four future trends.
基金Supported by the National Natural Science Foundation of China(No.61901183)Fundamental Research Funds for the Central Universities(No.ZQN921)+4 种基金Natural Science Foundation of Fujian Province Science and Technology Department(No.2021H6037)Key Project of Quanzhou Science and Technology Plan(No.2021C008R)Natural Science Foundation of Fujian Province(No.2019J01010561)Education and Scientific Research Project for Young and Middle-aged Teachers of Fujian Province 2019(No.JAT191080)Science and Technology Bureau of Quanzhou(No.2017G046)。
文摘Convolutional neural networks(CNNs) have shown great potential for image super-resolution(SR).However,most existing CNNs only reconstruct images in the spatial domain,resulting in insufficient high-frequency details of reconstructed images.To address this issue,a channel attention based wavelet cascaded network for image super-resolution(CWSR) is proposed.Specifically,a second-order channel attention(SOCA) mechanism is incorporated into the network,and the covariance matrix normalization is utilized to explore interdependencies between channel-wise features.Then,to boost the quality of residual features,the non-local module is adopted to further improve the global information integration ability of the network.Finally,taking the image loss in the spatial and wavelet domains into account,a dual-constrained loss function is proposed to optimize the network.Experimental results illustrate that CWSR outperforms several state-of-the-art methods in terms of both visual quality and quantitative metrics.
基金supported by the National Natural Science Foundation of China(61971165)the Key Research and Development Program of Hubei Province(2020BAB113)。
文摘Previous deep learning-based super-resolution(SR)methods rely on the assumption that the degradation process is predefined(e.g.,bicubic downsampling).Thus,their performance would suffer from deterioration if the real degradation is not consistent with the assumption.To deal with real-world scenarios,existing blind SR methods are committed to estimating both the degradation and the super-resolved image with an extra loss or iterative scheme.However,degradation estimation that requires more computation would result in limited SR performance due to the accumulated estimation errors.In this paper,we propose a contrastive regularization built upon contrastive learning to exploit both the information of blurry images and clear images as negative and positive samples,respectively.Contrastive regularization ensures that the restored image is pulled closer to the clear image and pushed far away from the blurry image in the representation space.Furthermore,instead of estimating the degradation,we extract global statistical prior information to capture the character of the distortion.Considering the coupling between the degradation and the low-resolution image,we embed the global prior into the distortion-specific SR network to make our method adaptive to the changes of distortions.We term our distortion-specific network with contrastive regularization as CRDNet.The extensive experiments on synthetic and realworld scenes demonstrate that our lightweight CRDNet surpasses state-of-the-art blind super-resolution approaches.
基金This work was supported by the National Natural Science Foundation of China (Grant Nos. 61275099 and 6 1671094) and the Natural Science foundation of Chongqing Science and Technology Commission (No, CSTC2015JCYJA40032).
文摘Super-resolution (SR) is a widely used tech- nology that increases image resolution using algorithmic methods. However, preserving the local edge structure and visual quality in infrared (IR) SR images is challenging because of their disadvantages, such as lack of detail, poor contrast, and blurry edges. Traditional and advanced methods maintain the quantitative measures, but they mostly fail to preserve edge and visual quality. This paper proposes an algorithm based on high frequency layer features. This algorithm focuses on the IR image edge texture in the reconstruction process. Experimental results show that the mean gradient of the IR image reconstructed by the proposed algorithm increased by 1.5, 1.4, and 1.2 times than that of the traditional algorithm based on L1- norm, L2-norm, and traditional mixed norm, respectively. The peak signal-to-noise ratio, structural similarity index, and visual effect of the reconstructed image also improved.