Although most of the existing image super-resolution(SR)methods have achieved superior performance,contrastive learning for high-level tasks has not been fully utilized in the existing image SR methods based on deep l...Although most of the existing image super-resolution(SR)methods have achieved superior performance,contrastive learning for high-level tasks has not been fully utilized in the existing image SR methods based on deep learning.This work focuses on two well-known strategies developed for lightweight and robust SR,i.e.,contrastive learning and feedback mechanism,and proposes an integrated solution called a split-based feedback network(SPFBN).The proposed SPFBN is based on a feedback mechanism to learn abstract representations and uses contrastive learning to explore high information in the representation space.Specifically,this work first uses hidden states and constraints in recurrent neural network(RNN)to implement a feedback mechanism.Then,use contrastive learning to perform representation learning to obtain high-level information by pushing the final image to the intermediate images and pulling the final SR image to the high-resolution image.Besides,a split-based feedback block(SPFB)is proposed to reduce model redundancy,which tolerates features with similar patterns but requires fewer parameters.Extensive experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-art methods.Moreover,this work extends the experiment to prove the effectiveness of this method and shows better overall reconstruction quality.展开更多
A super-resolution reconstruction algorithm is proposed. The algorithm is based on the idea of the sparse representation of signals, by using the fact that the sparsest representation of a sig- nal is unique as the co...A super-resolution reconstruction algorithm is proposed. The algorithm is based on the idea of the sparse representation of signals, by using the fact that the sparsest representation of a sig- nal is unique as the constraint of the patched-based reconstruction, and compensating residual errors of the reconstruction results both locally and globally to solve the distortion problem in patch-based reconstruction algorithms. Three reconstruction algorithms are compared. The results show that the images reconstructed with the new algorithm have the best quality.展开更多
A maximum a posteriori( MAP) algorithm is proposed to improve the accuracy of super resolution( SR) reconstruction in traditional methods. The algorithm applies both joints image registration and SR reconstruction...A maximum a posteriori( MAP) algorithm is proposed to improve the accuracy of super resolution( SR) reconstruction in traditional methods. The algorithm applies both joints image registration and SR reconstruction in the framework,but separates them in the process of iteratiion. Firstly,we estimate the shifting parameters through two lowresolution( LR) images and use the parameters to reconstruct initial HR images. Then,we update the shifting parameters using HR images. The aforementioned steps are repeated until the ideal HR images are obtained. The metrics such as PSNR and SSIM are used to fully evaluate the quality of the reconstructed image. Experimental results indicate that the proposed method can enhance image resolution efficiently.展开更多
A new method of super-resolution image reconstruction is proposed, which uses a three-step-training error backpropagation neural network (BPNN) to realize the super-resolution reconstruction (SRR) of satellite ima...A new method of super-resolution image reconstruction is proposed, which uses a three-step-training error backpropagation neural network (BPNN) to realize the super-resolution reconstruction (SRR) of satellite image. The method is based on BPNN. First, three groups learning samples with different resolutions are obtained according to image observation model, and then vector mappings are respectively used to those three group learning samples to speed up the convergence of BPNN, at last, three times consecutive training are carried on the BPNN. Training samples used in each step are of higher resolution than those used in the previous steps, so the increasing weights store a great amount of information for SRR, and network performance and generalization ability are improved greatly. Simulation and generalization tests are carried on the well-trained three-step-training NN respectively, and the reconstruction results with higher resolution images verify the effectiveness and validity of this method.展开更多
A multi-channel fast super-resolution image reconstruction algorithm based on matrix observation model is proposed in the paper,which consists of three steps to avoid the computational complexity: a single image SR re...A multi-channel fast super-resolution image reconstruction algorithm based on matrix observation model is proposed in the paper,which consists of three steps to avoid the computational complexity: a single image SR reconstruction step,a registration step and a wavelet-based image fusion. This algorithm decomposes two large matrixes to the tensor product of two little matrixes and uses the natural isomorphism between matrix space and vector space to transform cost function based on matrix-vector products model to matrix form. Furthermore,we prove that the regularization part can be transformed to the matrix formed. The conjugate-gradient method is used to solve this new model. Finally,the wavelet fusion is used to integrate all the registered highresolution images obtained from the single image SR reconstruction step. The proposed algorithm reduces the storage requirement and the calculating complexity,and can be applied to large-dimension low-resolution images.展开更多
MS or MS+PAN is usually applied separately in convolutional neural network(CNN)resolution reconstruction to obtain high-resolution MS images,but the difference between the two datasets is rarely studied.This paper int...MS or MS+PAN is usually applied separately in convolutional neural network(CNN)resolution reconstruction to obtain high-resolution MS images,but the difference between the two datasets is rarely studied.This paper introduced a dual-channel network and took MS and MS+PAN of Jilin-1 spectrum satellites as two datasets to evaluate the performance of CNN resolution reconstruction,and analyzed the difference with bicubic and GS methods.The result of CNN reconstruction shows that MS+PAN dataset performed better than MS,with about 6%improvement in spatial and spectral components,and the overall quality of MS+PAN dataset was slightly higher than that of MS dataset,with QNR from 0.9559 to 0.9584.The bicubic performed best in spectral components with the quality value of 0.017,and GS performed best in spatial components with the quality values of 0.0443.CNN showed similar performance in spectral and spatial components with the two traditional methods and achieved the best overall quality with QNR value of 0.9584.展开更多
Previous deep learning-based super-resolution(SR)methods rely on the assumption that the degradation process is predefined(e.g.,bicubic downsampling).Thus,their performance would suffer from deterioration if the real ...Previous deep learning-based super-resolution(SR)methods rely on the assumption that the degradation process is predefined(e.g.,bicubic downsampling).Thus,their performance would suffer from deterioration if the real degradation is not consistent with the assumption.To deal with real-world scenarios,existing blind SR methods are committed to estimating both the degradation and the super-resolved image with an extra loss or iterative scheme.However,degradation estimation that requires more computation would result in limited SR performance due to the accumulated estimation errors.In this paper,we propose a contrastive regularization built upon contrastive learning to exploit both the information of blurry images and clear images as negative and positive samples,respectively.Contrastive regularization ensures that the restored image is pulled closer to the clear image and pushed far away from the blurry image in the representation space.Furthermore,instead of estimating the degradation,we extract global statistical prior information to capture the character of the distortion.Considering the coupling between the degradation and the low-resolution image,we embed the global prior into the distortion-specific SR network to make our method adaptive to the changes of distortions.We term our distortion-specific network with contrastive regularization as CRDNet.The extensive experiments on synthetic and realworld scenes demonstrate that our lightweight CRDNet surpasses state-of-the-art blind super-resolution approaches.展开更多
Super-resolution reconstruction in medical imaging has become more demanding due to the necessity of obtaining high-quality images with minimal radiation dose,such as in low-field magnetic resonance imaging(MRI).Howev...Super-resolution reconstruction in medical imaging has become more demanding due to the necessity of obtaining high-quality images with minimal radiation dose,such as in low-field magnetic resonance imaging(MRI).However,image super-resolution reconstruction remains a difficult task because of the complexity and high textual requirements for diagnosis purpose.In this paper,we offer a deep learning based strategy for reconstructing medical images from low resolutions utilizing Transformer and generative adversarial networks(T-GANs).The integrated system can extract more precise texture information and focus more on important locations through global image matching after successfully inserting Transformer into the generative adversarial network for picture reconstruction.Furthermore,we weighted the combination of content loss,adversarial loss,and adversarial feature loss as the final multi-task loss function during the training of our proposed model T-GAN.In comparison to established measures like peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM),our suggested T-GAN achieves optimal performance and recovers more texture features in super-resolution reconstruction of MRI scanned images of the knees and belly.展开更多
The algorithm used for reconstruction or resolution enhancement is one of the factors affectingthe quality of super-resolution images obtained by fluorescence microscopy.Deep-learning-basedalgorithms have achieved sta...The algorithm used for reconstruction or resolution enhancement is one of the factors affectingthe quality of super-resolution images obtained by fluorescence microscopy.Deep-learning-basedalgorithms have achieved stateof-the-art performance in super-resolution fluorescence micros-copy and are becoming increasingly attractive.We firstly introduce commonly-used deep learningmodels,and then review the latest applications in terms of the net work architectures,the trainingdata and the loss functions.Additionally,we discuss the challenges and limits when using deeplearning to analyze the fluorescence microscopic data,and suggest ways to improve the reliability and robustness of deep learning applications.展开更多
Underwater imaging is widely used in ocean,river and lake exploration,but it is affected by properties of water and the optics.In order to solve the lower-resolution underwater image formed by the influence of water a...Underwater imaging is widely used in ocean,river and lake exploration,but it is affected by properties of water and the optics.In order to solve the lower-resolution underwater image formed by the influence of water and light,the image super-resolution reconstruction technique is applied to the underwater image processing.This paper addresses the problem of generating super-resolution underwater images by convolutional neural network framework technology.We research the degradation model of underwater images,and analyze the lower-resolution factors of underwater images in different situations,and compare different traditional super-resolution image reconstruction algorithms.We further show that the algorithm of super-resolution using deep convolution networks(SRCNN)which applied to super-resolution underwater images achieves good results.展开更多
Sparse representation has attracted extensive attention and performed well on image super-resolution(SR) in the last decade. However, many current image SR methods face the contradiction of detail recovery and artif...Sparse representation has attracted extensive attention and performed well on image super-resolution(SR) in the last decade. However, many current image SR methods face the contradiction of detail recovery and artifact suppression. We propose a multi-resolution dictionary learning(MRDL) model to solve this contradiction, and give a fast single image SR method based on the MRDL model. To obtain the MRDL model, we first extract multi-scale patches by using our proposed adaptive patch partition method(APPM). The APPM divides images into patches of different sizes according to their detail richness. Then, the multiresolution dictionary pairs, which contain structural primitives of various resolutions, can be trained from these multi-scale patches.Owing to the MRDL strategy, our SR algorithm not only recovers details well, with less jag and noise, but also significantly improves the computational efficiency. Experimental results validate that our algorithm performs better than other SR methods in evaluation metrics and visual perception.展开更多
Image super-resolution(SR)is an important technique for improving the resolution and quality of images.With the great progress of deep learning,image super-resolution achieves remarkable improvements recently.In this ...Image super-resolution(SR)is an important technique for improving the resolution and quality of images.With the great progress of deep learning,image super-resolution achieves remarkable improvements recently.In this work,a brief survey on recent advances of deep learning based single image super-resolution methods is systematically described.The existing studies of SR techniques are roughly grouped into ten major categories.Besides,some other important issues are also introduced,such as publicly available benchmark datasets and performance evaluation metrics.Finally,this survey is concluded by highlighting four future trends.展开更多
The image reconstruction process in super-resolution structured illumination microscopy(SIM)is investigated.The structured pattern is generated by the interference of two Gaussian beams to encode undetectable spectra ...The image reconstruction process in super-resolution structured illumination microscopy(SIM)is investigated.The structured pattern is generated by the interference of two Gaussian beams to encode undetectable spectra into detectable region of microscope.After parameters estimation of the structured pattern,the encoded spectra are computationally decoded and recombined in Fourier domain to equivalently increase the cut-off frequency of microscope,resulting in the extension of detectable spectra and a reconstructed image with about two-fold enhanced resolution.Three di®erent methods to estimate the initial phase of structured pattern are compared,verifying the auto-correlation algorithm a®ords the fast,most precise and robust measurement.The artifacts sources and detailed reconstruction°owchart for both linear and nonlinear SIM are also presented.展开更多
Structured illumination microscopy has been a useful method for achieving lateral super-resolution,but it typically requires at least three precise phase shifts per orientation.In this paper,we propose a super-resolut...Structured illumination microscopy has been a useful method for achieving lateral super-resolution,but it typically requires at least three precise phase shifts per orientation.In this paper,we propose a super-resolution method that utilizes structured illumination without phase shift.The reconstruction process requires only a conventionally illuminated image and an image with structured illumination.This method achieves the same effect as the traditional phase shift method,and more than doubles the resolution by synthesizing a few reconstructions at different illumination frequencies.We verify the resolution improvement process using a combination of theoretical derivations and diagrams,and demonstrate its effectiveness with numerical simulations.展开更多
Vegetation is crucial for wetland ecosystems.Human activities and climate changes are increasingly threatening wetland ecosystems.Combining satellite images and deep learning for classifying marsh vegetation communiti...Vegetation is crucial for wetland ecosystems.Human activities and climate changes are increasingly threatening wetland ecosystems.Combining satellite images and deep learning for classifying marsh vegetation communities has faced great challenges because of its coarse spatial resolution and limited spectral bands.This study aimed to propose a method to classify marsh vegetation using multi-resolution multispectral and hyperspectral images,combining super-resolution techniques and a novel self-constructing graph attention neural network(SGA-Net)algorithm.The SGA-Net algorithm includes a decoding layer(SCE-Net)to preciselyfine marsh vegetation classification in Honghe National Nature Reserve,Northeast China.The results indicated that the hyperspectral reconstruction images based on the super-resolution convolutional neural network(SRCNN)obtained higher accuracy with a peak signal-to-noise ratio(PSNR)of 28.87 and structural similarity(SSIM)of 0.76 in spatial quality and root mean squared error(RMSE)of 0.11 and R^(2) of 0.63 in spectral quality.The improvement of classification accuracy(MIoU)by enhanced super-resolution generative adversarial network(ESRGAN)(6.19%)was greater than that of SRCNN(4.33%)and super-resolution generative adversarial network(SRGAN)(3.64%).In most classification schemes,the SGA-Net outperformed DeepLabV3+and SegFormer algorithms for marsh vegetation and achieved the highest F1-score(78.47%).This study demonstrated that collaborative use of super-resolution reconstruction and deep learning is an effective approach for marsh vegetation mapping.展开更多
Optical microscopy promises researchers to soe most tiny substances directly.However,the resolution of conventional microscopy is resticted by the diffraction limit.This makes it a challenge to observe subcellular pro...Optical microscopy promises researchers to soe most tiny substances directly.However,the resolution of conventional microscopy is resticted by the diffraction limit.This makes it a challenge to observe subcellular processes happened in nanoscale.The development of super-resolution microscopy provides a solution to this challenge.Here,we briefly review several commonly used super-resolution techniques,explicating their basic principles and applications in biological science,especially in neuroscience.In addition,characteristics and limitations of each techrique are compared to provide a guidance for biologists to choose the most suitable tool.展开更多
Convolutional neural networks(CNNs) have shown great potential for image super-resolution(SR).However,most existing CNNs only reconstruct images in the spatial domain,resulting in insufficient high-frequency details o...Convolutional neural networks(CNNs) have shown great potential for image super-resolution(SR).However,most existing CNNs only reconstruct images in the spatial domain,resulting in insufficient high-frequency details of reconstructed images.To address this issue,a channel attention based wavelet cascaded network for image super-resolution(CWSR) is proposed.Specifically,a second-order channel attention(SOCA) mechanism is incorporated into the network,and the covariance matrix normalization is utilized to explore interdependencies between channel-wise features.Then,to boost the quality of residual features,the non-local module is adopted to further improve the global information integration ability of the network.Finally,taking the image loss in the spatial and wavelet domains into account,a dual-constrained loss function is proposed to optimize the network.Experimental results illustrate that CWSR outperforms several state-of-the-art methods in terms of both visual quality and quantitative metrics.展开更多
基金the National Key R&D Program of China(No.2019YFB1405900)the National Natural Science Foundation of China(No.62172035,61976098)。
文摘Although most of the existing image super-resolution(SR)methods have achieved superior performance,contrastive learning for high-level tasks has not been fully utilized in the existing image SR methods based on deep learning.This work focuses on two well-known strategies developed for lightweight and robust SR,i.e.,contrastive learning and feedback mechanism,and proposes an integrated solution called a split-based feedback network(SPFBN).The proposed SPFBN is based on a feedback mechanism to learn abstract representations and uses contrastive learning to explore high information in the representation space.Specifically,this work first uses hidden states and constraints in recurrent neural network(RNN)to implement a feedback mechanism.Then,use contrastive learning to perform representation learning to obtain high-level information by pushing the final image to the intermediate images and pulling the final SR image to the high-resolution image.Besides,a split-based feedback block(SPFB)is proposed to reduce model redundancy,which tolerates features with similar patterns but requires fewer parameters.Extensive experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-art methods.Moreover,this work extends the experiment to prove the effectiveness of this method and shows better overall reconstruction quality.
基金Supported by the Basic Research Foundation of Beijing Institute of Technology(3050012211105)
文摘A super-resolution reconstruction algorithm is proposed. The algorithm is based on the idea of the sparse representation of signals, by using the fact that the sparsest representation of a sig- nal is unique as the constraint of the patched-based reconstruction, and compensating residual errors of the reconstruction results both locally and globally to solve the distortion problem in patch-based reconstruction algorithms. Three reconstruction algorithms are compared. The results show that the images reconstructed with the new algorithm have the best quality.
基金Supported by the National Natural Science Foundation of China(61405191)
文摘A maximum a posteriori( MAP) algorithm is proposed to improve the accuracy of super resolution( SR) reconstruction in traditional methods. The algorithm applies both joints image registration and SR reconstruction in the framework,but separates them in the process of iteratiion. Firstly,we estimate the shifting parameters through two lowresolution( LR) images and use the parameters to reconstruct initial HR images. Then,we update the shifting parameters using HR images. The aforementioned steps are repeated until the ideal HR images are obtained. The metrics such as PSNR and SSIM are used to fully evaluate the quality of the reconstructed image. Experimental results indicate that the proposed method can enhance image resolution efficiently.
文摘A new method of super-resolution image reconstruction is proposed, which uses a three-step-training error backpropagation neural network (BPNN) to realize the super-resolution reconstruction (SRR) of satellite image. The method is based on BPNN. First, three groups learning samples with different resolutions are obtained according to image observation model, and then vector mappings are respectively used to those three group learning samples to speed up the convergence of BPNN, at last, three times consecutive training are carried on the BPNN. Training samples used in each step are of higher resolution than those used in the previous steps, so the increasing weights store a great amount of information for SRR, and network performance and generalization ability are improved greatly. Simulation and generalization tests are carried on the well-trained three-step-training NN respectively, and the reconstruction results with higher resolution images verify the effectiveness and validity of this method.
基金Sponsored by the National Natural Science Foundation of China(Grant No.60474016)the Fundamental Research Funds for the Central Universities(Grant No.HIT.NSRIF.2009046)
文摘A multi-channel fast super-resolution image reconstruction algorithm based on matrix observation model is proposed in the paper,which consists of three steps to avoid the computational complexity: a single image SR reconstruction step,a registration step and a wavelet-based image fusion. This algorithm decomposes two large matrixes to the tensor product of two little matrixes and uses the natural isomorphism between matrix space and vector space to transform cost function based on matrix-vector products model to matrix form. Furthermore,we prove that the regularization part can be transformed to the matrix formed. The conjugate-gradient method is used to solve this new model. Finally,the wavelet fusion is used to integrate all the registered highresolution images obtained from the single image SR reconstruction step. The proposed algorithm reduces the storage requirement and the calculating complexity,and can be applied to large-dimension low-resolution images.
文摘MS or MS+PAN is usually applied separately in convolutional neural network(CNN)resolution reconstruction to obtain high-resolution MS images,but the difference between the two datasets is rarely studied.This paper introduced a dual-channel network and took MS and MS+PAN of Jilin-1 spectrum satellites as two datasets to evaluate the performance of CNN resolution reconstruction,and analyzed the difference with bicubic and GS methods.The result of CNN reconstruction shows that MS+PAN dataset performed better than MS,with about 6%improvement in spatial and spectral components,and the overall quality of MS+PAN dataset was slightly higher than that of MS dataset,with QNR from 0.9559 to 0.9584.The bicubic performed best in spectral components with the quality value of 0.017,and GS performed best in spatial components with the quality values of 0.0443.CNN showed similar performance in spectral and spatial components with the two traditional methods and achieved the best overall quality with QNR value of 0.9584.
基金supported by the National Natural Science Foundation of China(61971165)the Key Research and Development Program of Hubei Province(2020BAB113)。
文摘Previous deep learning-based super-resolution(SR)methods rely on the assumption that the degradation process is predefined(e.g.,bicubic downsampling).Thus,their performance would suffer from deterioration if the real degradation is not consistent with the assumption.To deal with real-world scenarios,existing blind SR methods are committed to estimating both the degradation and the super-resolved image with an extra loss or iterative scheme.However,degradation estimation that requires more computation would result in limited SR performance due to the accumulated estimation errors.In this paper,we propose a contrastive regularization built upon contrastive learning to exploit both the information of blurry images and clear images as negative and positive samples,respectively.Contrastive regularization ensures that the restored image is pulled closer to the clear image and pushed far away from the blurry image in the representation space.Furthermore,instead of estimating the degradation,we extract global statistical prior information to capture the character of the distortion.Considering the coupling between the degradation and the low-resolution image,we embed the global prior into the distortion-specific SR network to make our method adaptive to the changes of distortions.We term our distortion-specific network with contrastive regularization as CRDNet.The extensive experiments on synthetic and realworld scenes demonstrate that our lightweight CRDNet surpasses state-of-the-art blind super-resolution approaches.
文摘Super-resolution reconstruction in medical imaging has become more demanding due to the necessity of obtaining high-quality images with minimal radiation dose,such as in low-field magnetic resonance imaging(MRI).However,image super-resolution reconstruction remains a difficult task because of the complexity and high textual requirements for diagnosis purpose.In this paper,we offer a deep learning based strategy for reconstructing medical images from low resolutions utilizing Transformer and generative adversarial networks(T-GANs).The integrated system can extract more precise texture information and focus more on important locations through global image matching after successfully inserting Transformer into the generative adversarial network for picture reconstruction.Furthermore,we weighted the combination of content loss,adversarial loss,and adversarial feature loss as the final multi-task loss function during the training of our proposed model T-GAN.In comparison to established measures like peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM),our suggested T-GAN achieves optimal performance and recovers more texture features in super-resolution reconstruction of MRI scanned images of the knees and belly.
基金supported by the National Key R&D Program of China(2021YFF0502900)the National Natural Science Foundation of China(61835009/62127819).
文摘The algorithm used for reconstruction or resolution enhancement is one of the factors affectingthe quality of super-resolution images obtained by fluorescence microscopy.Deep-learning-basedalgorithms have achieved stateof-the-art performance in super-resolution fluorescence micros-copy and are becoming increasingly attractive.We firstly introduce commonly-used deep learningmodels,and then review the latest applications in terms of the net work architectures,the trainingdata and the loss functions.Additionally,we discuss the challenges and limits when using deeplearning to analyze the fluorescence microscopic data,and suggest ways to improve the reliability and robustness of deep learning applications.
基金This work is supported by Hainan Provincial Natural Science Foundation of China(project number:20166235)project supported by the Education Department of Hainan Province(project number:Hnky2017-57).
文摘Underwater imaging is widely used in ocean,river and lake exploration,but it is affected by properties of water and the optics.In order to solve the lower-resolution underwater image formed by the influence of water and light,the image super-resolution reconstruction technique is applied to the underwater image processing.This paper addresses the problem of generating super-resolution underwater images by convolutional neural network framework technology.We research the degradation model of underwater images,and analyze the lower-resolution factors of underwater images in different situations,and compare different traditional super-resolution image reconstruction algorithms.We further show that the algorithm of super-resolution using deep convolution networks(SRCNN)which applied to super-resolution underwater images achieves good results.
文摘Sparse representation has attracted extensive attention and performed well on image super-resolution(SR) in the last decade. However, many current image SR methods face the contradiction of detail recovery and artifact suppression. We propose a multi-resolution dictionary learning(MRDL) model to solve this contradiction, and give a fast single image SR method based on the MRDL model. To obtain the MRDL model, we first extract multi-scale patches by using our proposed adaptive patch partition method(APPM). The APPM divides images into patches of different sizes according to their detail richness. Then, the multiresolution dictionary pairs, which contain structural primitives of various resolutions, can be trained from these multi-scale patches.Owing to the MRDL strategy, our SR algorithm not only recovers details well, with less jag and noise, but also significantly improves the computational efficiency. Experimental results validate that our algorithm performs better than other SR methods in evaluation metrics and visual perception.
基金the National Key Research and Development Program of China(No.2019YFB1405900)。
文摘Image super-resolution(SR)is an important technique for improving the resolution and quality of images.With the great progress of deep learning,image super-resolution achieves remarkable improvements recently.In this work,a brief survey on recent advances of deep learning based single image super-resolution methods is systematically described.The existing studies of SR techniques are roughly grouped into ten major categories.Besides,some other important issues are also introduced,such as publicly available benchmark datasets and performance evaluation metrics.Finally,this survey is concluded by highlighting four future trends.
基金This work is supported by National Natural Science Foundation of China (Nos.61361160418 and 61327902).
文摘The image reconstruction process in super-resolution structured illumination microscopy(SIM)is investigated.The structured pattern is generated by the interference of two Gaussian beams to encode undetectable spectra into detectable region of microscope.After parameters estimation of the structured pattern,the encoded spectra are computationally decoded and recombined in Fourier domain to equivalently increase the cut-off frequency of microscope,resulting in the extension of detectable spectra and a reconstructed image with about two-fold enhanced resolution.Three di®erent methods to estimate the initial phase of structured pattern are compared,verifying the auto-correlation algorithm a®ords the fast,most precise and robust measurement.The artifacts sources and detailed reconstruction°owchart for both linear and nonlinear SIM are also presented.
基金supported by the National Natural Science Foundation of China(Grant No.51775381)National Key Scientific Instrument and Equipment Development Project(Grant No.2017YFF0107001)
文摘Structured illumination microscopy has been a useful method for achieving lateral super-resolution,but it typically requires at least three precise phase shifts per orientation.In this paper,we propose a super-resolution method that utilizes structured illumination without phase shift.The reconstruction process requires only a conventionally illuminated image and an image with structured illumination.This method achieves the same effect as the traditional phase shift method,and more than doubles the resolution by synthesizing a few reconstructions at different illumination frequencies.We verify the resolution improvement process using a combination of theoretical derivations and diagrams,and demonstrate its effectiveness with numerical simulations.
基金supported by National Natural Science Foundation of China:[Grant Number 21976043,42122009]Guangxi Science&Technology Program:[Grant Number GuikeAD20159037]+1 种基金‘Ba Gui Scholars’program of the provincial government of Guangxi,and the Guilin University of Technology Foundation:[Grant Number GUTQDJJ2017096]Innovation Project of Guangxi Graduate Education:[Grant Number YCSW2022328].
文摘Vegetation is crucial for wetland ecosystems.Human activities and climate changes are increasingly threatening wetland ecosystems.Combining satellite images and deep learning for classifying marsh vegetation communities has faced great challenges because of its coarse spatial resolution and limited spectral bands.This study aimed to propose a method to classify marsh vegetation using multi-resolution multispectral and hyperspectral images,combining super-resolution techniques and a novel self-constructing graph attention neural network(SGA-Net)algorithm.The SGA-Net algorithm includes a decoding layer(SCE-Net)to preciselyfine marsh vegetation classification in Honghe National Nature Reserve,Northeast China.The results indicated that the hyperspectral reconstruction images based on the super-resolution convolutional neural network(SRCNN)obtained higher accuracy with a peak signal-to-noise ratio(PSNR)of 28.87 and structural similarity(SSIM)of 0.76 in spatial quality and root mean squared error(RMSE)of 0.11 and R^(2) of 0.63 in spectral quality.The improvement of classification accuracy(MIoU)by enhanced super-resolution generative adversarial network(ESRGAN)(6.19%)was greater than that of SRCNN(4.33%)and super-resolution generative adversarial network(SRGAN)(3.64%).In most classification schemes,the SGA-Net outperformed DeepLabV3+and SegFormer algorithms for marsh vegetation and achieved the highest F1-score(78.47%).This study demonstrated that collaborative use of super-resolution reconstruction and deep learning is an effective approach for marsh vegetation mapping.
基金support from National Basic Research Program of China (973 Program) (2015CB352005)National Natural Science Foundation of China (No.6142780065,31571110,81527901)+1 种基金Natural Science Foundation of Zhejiang Province of China (No.Y16F050002)the Fundamental Research Funds for the Central Universities.
文摘Optical microscopy promises researchers to soe most tiny substances directly.However,the resolution of conventional microscopy is resticted by the diffraction limit.This makes it a challenge to observe subcellular processes happened in nanoscale.The development of super-resolution microscopy provides a solution to this challenge.Here,we briefly review several commonly used super-resolution techniques,explicating their basic principles and applications in biological science,especially in neuroscience.In addition,characteristics and limitations of each techrique are compared to provide a guidance for biologists to choose the most suitable tool.
基金Supported by the National Natural Science Foundation of China(No.61901183)Fundamental Research Funds for the Central Universities(No.ZQN921)+4 种基金Natural Science Foundation of Fujian Province Science and Technology Department(No.2021H6037)Key Project of Quanzhou Science and Technology Plan(No.2021C008R)Natural Science Foundation of Fujian Province(No.2019J01010561)Education and Scientific Research Project for Young and Middle-aged Teachers of Fujian Province 2019(No.JAT191080)Science and Technology Bureau of Quanzhou(No.2017G046)。
文摘Convolutional neural networks(CNNs) have shown great potential for image super-resolution(SR).However,most existing CNNs only reconstruct images in the spatial domain,resulting in insufficient high-frequency details of reconstructed images.To address this issue,a channel attention based wavelet cascaded network for image super-resolution(CWSR) is proposed.Specifically,a second-order channel attention(SOCA) mechanism is incorporated into the network,and the covariance matrix normalization is utilized to explore interdependencies between channel-wise features.Then,to boost the quality of residual features,the non-local module is adopted to further improve the global information integration ability of the network.Finally,taking the image loss in the spatial and wavelet domains into account,a dual-constrained loss function is proposed to optimize the network.Experimental results illustrate that CWSR outperforms several state-of-the-art methods in terms of both visual quality and quantitative metrics.