A super-resolution reconstruction approach of (SVD) technique was presented, and its performance was radar image using an adaptive-threshold singular value decomposition analyzed, compared and assessed detailedly. F...A super-resolution reconstruction approach of (SVD) technique was presented, and its performance was radar image using an adaptive-threshold singular value decomposition analyzed, compared and assessed detailedly. First, radar imaging model and super-resolution reconstruction mechanism were outlined. Then, the adaptive-threshold SVD super-resolution algorithm, and its two key aspects, namely the determination method of point spread function (PSF) matrix T and the selection scheme of singular value threshold, were presented. Finally, the super-resolution algorithm was demonstrated successfully using the measured synthetic-aperture radar (SAR) images, and a Monte Carlo assessment was carried out to evaluate the performance of the algorithm by using the input/output signal-to-noise ratio (SNR). Five versions of SVD algorithms, namely 1 ) using all singular values, 2) using the top 80% singular values, 3) using the top 50% singular values, 4) using the top 20% singular values and 5) using singular values s such that S2≥/max(s2)/rinsNR were tested. The experimental results indicate that when the singular value threshold is set as Smax/(rinSNR)1/2, the super-resolution algorithm provides a good compromise between too much noise and too much bias and has good reconstruction results.展开更多
A super-resolution reconstruction algorithm is proposed. The algorithm is based on the idea of the sparse representation of signals, by using the fact that the sparsest representation of a sig- nal is unique as the co...A super-resolution reconstruction algorithm is proposed. The algorithm is based on the idea of the sparse representation of signals, by using the fact that the sparsest representation of a sig- nal is unique as the constraint of the patched-based reconstruction, and compensating residual errors of the reconstruction results both locally and globally to solve the distortion problem in patch-based reconstruction algorithms. Three reconstruction algorithms are compared. The results show that the images reconstructed with the new algorithm have the best quality.展开更多
A new method of super-resolution image reconstruction is proposed, which uses a three-step-training error backpropagation neural network (BPNN) to realize the super-resolution reconstruction (SRR) of satellite ima...A new method of super-resolution image reconstruction is proposed, which uses a three-step-training error backpropagation neural network (BPNN) to realize the super-resolution reconstruction (SRR) of satellite image. The method is based on BPNN. First, three groups learning samples with different resolutions are obtained according to image observation model, and then vector mappings are respectively used to those three group learning samples to speed up the convergence of BPNN, at last, three times consecutive training are carried on the BPNN. Training samples used in each step are of higher resolution than those used in the previous steps, so the increasing weights store a great amount of information for SRR, and network performance and generalization ability are improved greatly. Simulation and generalization tests are carried on the well-trained three-step-training NN respectively, and the reconstruction results with higher resolution images verify the effectiveness and validity of this method.展开更多
A multi-channel fast super-resolution image reconstruction algorithm based on matrix observation model is proposed in the paper,which consists of three steps to avoid the computational complexity: a single image SR re...A multi-channel fast super-resolution image reconstruction algorithm based on matrix observation model is proposed in the paper,which consists of three steps to avoid the computational complexity: a single image SR reconstruction step,a registration step and a wavelet-based image fusion. This algorithm decomposes two large matrixes to the tensor product of two little matrixes and uses the natural isomorphism between matrix space and vector space to transform cost function based on matrix-vector products model to matrix form. Furthermore,we prove that the regularization part can be transformed to the matrix formed. The conjugate-gradient method is used to solve this new model. Finally,the wavelet fusion is used to integrate all the registered highresolution images obtained from the single image SR reconstruction step. The proposed algorithm reduces the storage requirement and the calculating complexity,and can be applied to large-dimension low-resolution images.展开更多
Super-resolution reconstruction in medical imaging has become more demanding due to the necessity of obtaining high-quality images with minimal radiation dose,such as in low-field magnetic resonance imaging(MRI).Howev...Super-resolution reconstruction in medical imaging has become more demanding due to the necessity of obtaining high-quality images with minimal radiation dose,such as in low-field magnetic resonance imaging(MRI).However,image super-resolution reconstruction remains a difficult task because of the complexity and high textual requirements for diagnosis purpose.In this paper,we offer a deep learning based strategy for reconstructing medical images from low resolutions utilizing Transformer and generative adversarial networks(T-GANs).The integrated system can extract more precise texture information and focus more on important locations through global image matching after successfully inserting Transformer into the generative adversarial network for picture reconstruction.Furthermore,we weighted the combination of content loss,adversarial loss,and adversarial feature loss as the final multi-task loss function during the training of our proposed model T-GAN.In comparison to established measures like peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM),our suggested T-GAN achieves optimal performance and recovers more texture features in super-resolution reconstruction of MRI scanned images of the knees and belly.展开更多
Deep learning is capable of greatly promoting the progress of super-resolution imaging technology in terms of imaging and reconstruction speed,imaging resolution,and imagingflux.This paper proposes a deep neural netwo...Deep learning is capable of greatly promoting the progress of super-resolution imaging technology in terms of imaging and reconstruction speed,imaging resolution,and imagingflux.This paper proposes a deep neural network based on a generative adversarial network(GAN).The generator employs a U-Net-based network,which integrates Dense Net for the downsampling component.The proposed method has excellent properties,for example,the network model is trained with several different datasets of biological structures;the trained model can improve the imaging resolution of different microscopy imaging modalities such as confocal imaging and wide-field imaging;and the model demonstrates a generalized ability to improve the resolution of different biological structures even out of the datasets.In addition,experimental results showed that the method improved the resolution of caveolin-coated pits(CCPs)structures from 264 nm to 138 nm,a 1.91-fold increase,and nearly doubled the resolution of DNA molecules imaged while being transported through microfluidic channels.展开更多
Underwater imaging is widely used in ocean,river and lake exploration,but it is affected by properties of water and the optics.In order to solve the lower-resolution underwater image formed by the influence of water a...Underwater imaging is widely used in ocean,river and lake exploration,but it is affected by properties of water and the optics.In order to solve the lower-resolution underwater image formed by the influence of water and light,the image super-resolution reconstruction technique is applied to the underwater image processing.This paper addresses the problem of generating super-resolution underwater images by convolutional neural network framework technology.We research the degradation model of underwater images,and analyze the lower-resolution factors of underwater images in different situations,and compare different traditional super-resolution image reconstruction algorithms.We further show that the algorithm of super-resolution using deep convolution networks(SRCNN)which applied to super-resolution underwater images achieves good results.展开更多
The image reconstruction process in super-resolution structured illumination microscopy(SIM)is investigated.The structured pattern is generated by the interference of two Gaussian beams to encode undetectable spectra ...The image reconstruction process in super-resolution structured illumination microscopy(SIM)is investigated.The structured pattern is generated by the interference of two Gaussian beams to encode undetectable spectra into detectable region of microscope.After parameters estimation of the structured pattern,the encoded spectra are computationally decoded and recombined in Fourier domain to equivalently increase the cut-off frequency of microscope,resulting in the extension of detectable spectra and a reconstructed image with about two-fold enhanced resolution.Three di®erent methods to estimate the initial phase of structured pattern are compared,verifying the auto-correlation algorithm a®ords the fast,most precise and robust measurement.The artifacts sources and detailed reconstruction°owchart for both linear and nonlinear SIM are also presented.展开更多
This letter proposes a novel method of compressed video super-resolution reconstruction based on MAP-POCS (Maximum Posterior Probability-Projection Onto Convex Set). At first assuming the high-resolution model subject...This letter proposes a novel method of compressed video super-resolution reconstruction based on MAP-POCS (Maximum Posterior Probability-Projection Onto Convex Set). At first assuming the high-resolution model subject to Poisson-Markov distribution, then constructing the projecting convex based on MAP. According to the characteristics of compressed video, two different convexes are constructed based on integrating the inter-frame and intra-frame information in the wavelet-domain. The results of the experiment demonstrate that the new method not only outperforms the traditional algorithms on the aspects of PSNR (Peak Signal-to-Noise Ratio), MSE (Mean Square Error) and reconstruction vision effect, but also has the advantages of rapid convergence and easy extension.展开更多
Vegetation is crucial for wetland ecosystems.Human activities and climate changes are increasingly threatening wetland ecosystems.Combining satellite images and deep learning for classifying marsh vegetation communiti...Vegetation is crucial for wetland ecosystems.Human activities and climate changes are increasingly threatening wetland ecosystems.Combining satellite images and deep learning for classifying marsh vegetation communities has faced great challenges because of its coarse spatial resolution and limited spectral bands.This study aimed to propose a method to classify marsh vegetation using multi-resolution multispectral and hyperspectral images,combining super-resolution techniques and a novel self-constructing graph attention neural network(SGA-Net)algorithm.The SGA-Net algorithm includes a decoding layer(SCE-Net)to preciselyfine marsh vegetation classification in Honghe National Nature Reserve,Northeast China.The results indicated that the hyperspectral reconstruction images based on the super-resolution convolutional neural network(SRCNN)obtained higher accuracy with a peak signal-to-noise ratio(PSNR)of 28.87 and structural similarity(SSIM)of 0.76 in spatial quality and root mean squared error(RMSE)of 0.11 and R^(2) of 0.63 in spectral quality.The improvement of classification accuracy(MIoU)by enhanced super-resolution generative adversarial network(ESRGAN)(6.19%)was greater than that of SRCNN(4.33%)and super-resolution generative adversarial network(SRGAN)(3.64%).In most classification schemes,the SGA-Net outperformed DeepLabV3+and SegFormer algorithms for marsh vegetation and achieved the highest F1-score(78.47%).This study demonstrated that collaborative use of super-resolution reconstruction and deep learning is an effective approach for marsh vegetation mapping.展开更多
The algorithm used for reconstruction or resolution enhancement is one of the factors affectingthe quality of super-resolution images obtained by fluorescence microscopy.Deep-learning-basedalgorithms have achieved sta...The algorithm used for reconstruction or resolution enhancement is one of the factors affectingthe quality of super-resolution images obtained by fluorescence microscopy.Deep-learning-basedalgorithms have achieved stateof-the-art performance in super-resolution fluorescence micros-copy and are becoming increasingly attractive.We firstly introduce commonly-used deep learningmodels,and then review the latest applications in terms of the net work architectures,the trainingdata and the loss functions.Additionally,we discuss the challenges and limits when using deeplearning to analyze the fluorescence microscopic data,and suggest ways to improve the reliability and robustness of deep learning applications.展开更多
In order to reconstruct and render the weak and repetitive texture of the damaged functional surface of aviation,an improved neural radiance field,named TranSR-NeRF,is proposed.In this paper,a data acquisition system ...In order to reconstruct and render the weak and repetitive texture of the damaged functional surface of aviation,an improved neural radiance field,named TranSR-NeRF,is proposed.In this paper,a data acquisition system was designed and built.The acquired images generated initial point clouds through TransMVSNet.Meanwhile,after extracting features from the images through the improved SE-ConvNeXt network,the extracted features were aligned and fused with the initial point cloud to generate high-quality neural point cloud.After ray-tracing and sampling of the neural point cloud,the ResMLP neural network designed in this paper was used to regress the volume density and radiance under a given viewing angle,which introduced spatial coordinate and relative positional encoding.The reconstruction and rendering of arbitrary-scale super-resolution of damaged functional surface is realized.In this paper,the influence of illumination conditions and background environment on the model performance is also studied through experiments,and the comparison and ablation experiments for the improved methods proposed in this paper is conducted.The experimental results show that the improved model has good effect.Finally,the application experiment of object detection task is carried out,and the experimental results show that the model has good practicability.展开更多
Aiming at solving the problem of low resolu- tion and visual blur in infrared imaging, a super-resolution infrared image reconstruction method using human vision processing mechanism (HVPM) was proposed. This method...Aiming at solving the problem of low resolu- tion and visual blur in infrared imaging, a super-resolution infrared image reconstruction method using human vision processing mechanism (HVPM) was proposed. This method combined a mechanism of vision lateral inhibition with an algorithm projection onto convex sets (POCS) reconstruction, the improved vision lateral inhibition network was utilized to enhance the contrast between object and background of low-resolution image sequences, then POCS algorithm was adopted to reconstruct super- resolution image. Experimental results showed that the proposed method can significantly improve the visual effect of image, whose contrast and information entropy of reconstructed infrared images were improved by approxi- mately 5 times and 1.6 times compared with traditional POCS reconstruction algorithm, respectively.展开更多
Super-resolution (SR) is a widely used tech- nology that increases image resolution using algorithmic methods. However, preserving the local edge structure and visual quality in infrared (IR) SR images is challeng...Super-resolution (SR) is a widely used tech- nology that increases image resolution using algorithmic methods. However, preserving the local edge structure and visual quality in infrared (IR) SR images is challenging because of their disadvantages, such as lack of detail, poor contrast, and blurry edges. Traditional and advanced methods maintain the quantitative measures, but they mostly fail to preserve edge and visual quality. This paper proposes an algorithm based on high frequency layer features. This algorithm focuses on the IR image edge texture in the reconstruction process. Experimental results show that the mean gradient of the IR image reconstructed by the proposed algorithm increased by 1.5, 1.4, and 1.2 times than that of the traditional algorithm based on L1- norm, L2-norm, and traditional mixed norm, respectively. The peak signal-to-noise ratio, structural similarity index, and visual effect of the reconstructed image also improved.展开更多
In this work, we describe a new multiframe Super-Resolution(SR) framework based on time-scale adaptive Normalized Convolution(NC), and apply it to astronomical images. The method mainly uses the conceptual basis o...In this work, we describe a new multiframe Super-Resolution(SR) framework based on time-scale adaptive Normalized Convolution(NC), and apply it to astronomical images. The method mainly uses the conceptual basis of NC where each neighborhood of a signal is expressed in terms of the corresponding subspace expanded by the chosen polynomial basis function. Instead of the conventional NC, the introduced spatially adaptive filtering kernel is utilized as the applicability function of shape-adaptive NC, which fits the local image structure information including shape and orientation. This makes it possible to obtain image patches with the same modality,which are collected for polynomial expansion to maximize the signal-to-noise ratio and suppress aliasing artifacts across lines and edges. The robust signal certainty takes the confidence value at each point into account before a local polynomial expansion to minimize the influence of outliers.Finally, the temporal scale applicability is considered to omit accurate motion estimation since it is easy to result in annoying registration errors in real astronomical applications. Excellent SR reconstruction capability of the time-scale adaptive NC is demonstrated through fundamental experiments on both synthetic images and real astronomical images when compared with other SR reconstruction methods.展开更多
We demonstrate that, by undersampling scanning object with a reconstruction algorithm related to compressed sensing, an image with the resolution exceeding the finest resolution defined by the numerical aperture of th...We demonstrate that, by undersampling scanning object with a reconstruction algorithm related to compressed sensing, an image with the resolution exceeding the finest resolution defined by the numerical aperture of the system can be obtained. Experimental results show that the measurements needed to achieve sub-Rayleigh resolution enhancement can be less than 10% of the pixels of the object. This method offers a general approach applicable to point-by-point illumination super-resolution techniques.展开更多
Various super-resolution microscopy techniques have been presented to explore fine structures of biological specimens.However,the super-resolution capability is often achieved at the expense of reducing imaging speed ...Various super-resolution microscopy techniques have been presented to explore fine structures of biological specimens.However,the super-resolution capability is often achieved at the expense of reducing imaging speed by either point scanning or multiframe computation.The contradiction between spatial resolution and imaging speed seriously hampers the observation of high-speed dynamics of fine structures.To overcome this contradiction,here we propose and demonstrate a temporal compressive super-resolution microscopy(TCSRM)technique.This technique is to merge an enhanced temporal compressive microscopy and a deep-learning-based super-resolution image reconstruction,where the enhanced temporal compressive microscopy is utilized to improve the imaging speed,and the deep-learning-based super-resolution image reconstruction is used to realize the resolution enhancement.The high-speed super-resolution imaging ability of TCSRM with a frame rate of 1200 frames per second(fps)and spatial resolution of 100 nm is experimentally demonstrated by capturing the flowing fluorescent beads in microfluidic chip.Given the outstanding imaging performance with high-speed super-resolution,TCSRM provides a desired tool for the studies of high-speed dynamical behaviors in fine structures,especially in the biomedical field.展开更多
基金Project(2008041001) supported by the Academician Foundation of China Project(N0601-041) supported by the General Armament Department Science Foundation of China
文摘A super-resolution reconstruction approach of (SVD) technique was presented, and its performance was radar image using an adaptive-threshold singular value decomposition analyzed, compared and assessed detailedly. First, radar imaging model and super-resolution reconstruction mechanism were outlined. Then, the adaptive-threshold SVD super-resolution algorithm, and its two key aspects, namely the determination method of point spread function (PSF) matrix T and the selection scheme of singular value threshold, were presented. Finally, the super-resolution algorithm was demonstrated successfully using the measured synthetic-aperture radar (SAR) images, and a Monte Carlo assessment was carried out to evaluate the performance of the algorithm by using the input/output signal-to-noise ratio (SNR). Five versions of SVD algorithms, namely 1 ) using all singular values, 2) using the top 80% singular values, 3) using the top 50% singular values, 4) using the top 20% singular values and 5) using singular values s such that S2≥/max(s2)/rinsNR were tested. The experimental results indicate that when the singular value threshold is set as Smax/(rinSNR)1/2, the super-resolution algorithm provides a good compromise between too much noise and too much bias and has good reconstruction results.
基金Supported by the Basic Research Foundation of Beijing Institute of Technology(3050012211105)
文摘A super-resolution reconstruction algorithm is proposed. The algorithm is based on the idea of the sparse representation of signals, by using the fact that the sparsest representation of a sig- nal is unique as the constraint of the patched-based reconstruction, and compensating residual errors of the reconstruction results both locally and globally to solve the distortion problem in patch-based reconstruction algorithms. Three reconstruction algorithms are compared. The results show that the images reconstructed with the new algorithm have the best quality.
文摘A new method of super-resolution image reconstruction is proposed, which uses a three-step-training error backpropagation neural network (BPNN) to realize the super-resolution reconstruction (SRR) of satellite image. The method is based on BPNN. First, three groups learning samples with different resolutions are obtained according to image observation model, and then vector mappings are respectively used to those three group learning samples to speed up the convergence of BPNN, at last, three times consecutive training are carried on the BPNN. Training samples used in each step are of higher resolution than those used in the previous steps, so the increasing weights store a great amount of information for SRR, and network performance and generalization ability are improved greatly. Simulation and generalization tests are carried on the well-trained three-step-training NN respectively, and the reconstruction results with higher resolution images verify the effectiveness and validity of this method.
基金Sponsored by the National Natural Science Foundation of China(Grant No.60474016)the Fundamental Research Funds for the Central Universities(Grant No.HIT.NSRIF.2009046)
文摘A multi-channel fast super-resolution image reconstruction algorithm based on matrix observation model is proposed in the paper,which consists of three steps to avoid the computational complexity: a single image SR reconstruction step,a registration step and a wavelet-based image fusion. This algorithm decomposes two large matrixes to the tensor product of two little matrixes and uses the natural isomorphism between matrix space and vector space to transform cost function based on matrix-vector products model to matrix form. Furthermore,we prove that the regularization part can be transformed to the matrix formed. The conjugate-gradient method is used to solve this new model. Finally,the wavelet fusion is used to integrate all the registered highresolution images obtained from the single image SR reconstruction step. The proposed algorithm reduces the storage requirement and the calculating complexity,and can be applied to large-dimension low-resolution images.
文摘Super-resolution reconstruction in medical imaging has become more demanding due to the necessity of obtaining high-quality images with minimal radiation dose,such as in low-field magnetic resonance imaging(MRI).However,image super-resolution reconstruction remains a difficult task because of the complexity and high textual requirements for diagnosis purpose.In this paper,we offer a deep learning based strategy for reconstructing medical images from low resolutions utilizing Transformer and generative adversarial networks(T-GANs).The integrated system can extract more precise texture information and focus more on important locations through global image matching after successfully inserting Transformer into the generative adversarial network for picture reconstruction.Furthermore,we weighted the combination of content loss,adversarial loss,and adversarial feature loss as the final multi-task loss function during the training of our proposed model T-GAN.In comparison to established measures like peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM),our suggested T-GAN achieves optimal performance and recovers more texture features in super-resolution reconstruction of MRI scanned images of the knees and belly.
基金Subjects funded by the National Natural Science Foundation of China(Nos.62275216 and 61775181)the Natural Science Basic Research Programme of Shaanxi Province-Major Basic Research Special Project(Nos.S2018-ZC-TD-0061 and TZ0393)the Special Project for the Development of National Key Scientific Instruments and Equipment No.(51927804).
文摘Deep learning is capable of greatly promoting the progress of super-resolution imaging technology in terms of imaging and reconstruction speed,imaging resolution,and imagingflux.This paper proposes a deep neural network based on a generative adversarial network(GAN).The generator employs a U-Net-based network,which integrates Dense Net for the downsampling component.The proposed method has excellent properties,for example,the network model is trained with several different datasets of biological structures;the trained model can improve the imaging resolution of different microscopy imaging modalities such as confocal imaging and wide-field imaging;and the model demonstrates a generalized ability to improve the resolution of different biological structures even out of the datasets.In addition,experimental results showed that the method improved the resolution of caveolin-coated pits(CCPs)structures from 264 nm to 138 nm,a 1.91-fold increase,and nearly doubled the resolution of DNA molecules imaged while being transported through microfluidic channels.
基金This work is supported by Hainan Provincial Natural Science Foundation of China(project number:20166235)project supported by the Education Department of Hainan Province(project number:Hnky2017-57).
文摘Underwater imaging is widely used in ocean,river and lake exploration,but it is affected by properties of water and the optics.In order to solve the lower-resolution underwater image formed by the influence of water and light,the image super-resolution reconstruction technique is applied to the underwater image processing.This paper addresses the problem of generating super-resolution underwater images by convolutional neural network framework technology.We research the degradation model of underwater images,and analyze the lower-resolution factors of underwater images in different situations,and compare different traditional super-resolution image reconstruction algorithms.We further show that the algorithm of super-resolution using deep convolution networks(SRCNN)which applied to super-resolution underwater images achieves good results.
基金This work is supported by National Natural Science Foundation of China (Nos.61361160418 and 61327902).
文摘The image reconstruction process in super-resolution structured illumination microscopy(SIM)is investigated.The structured pattern is generated by the interference of two Gaussian beams to encode undetectable spectra into detectable region of microscope.After parameters estimation of the structured pattern,the encoded spectra are computationally decoded and recombined in Fourier domain to equivalently increase the cut-off frequency of microscope,resulting in the extension of detectable spectra and a reconstructed image with about two-fold enhanced resolution.Three di®erent methods to estimate the initial phase of structured pattern are compared,verifying the auto-correlation algorithm a®ords the fast,most precise and robust measurement.The artifacts sources and detailed reconstruction°owchart for both linear and nonlinear SIM are also presented.
基金Supported by the Natural Science Foundation of Jiangsu Province (No. BK2004151).
文摘This letter proposes a novel method of compressed video super-resolution reconstruction based on MAP-POCS (Maximum Posterior Probability-Projection Onto Convex Set). At first assuming the high-resolution model subject to Poisson-Markov distribution, then constructing the projecting convex based on MAP. According to the characteristics of compressed video, two different convexes are constructed based on integrating the inter-frame and intra-frame information in the wavelet-domain. The results of the experiment demonstrate that the new method not only outperforms the traditional algorithms on the aspects of PSNR (Peak Signal-to-Noise Ratio), MSE (Mean Square Error) and reconstruction vision effect, but also has the advantages of rapid convergence and easy extension.
基金supported by National Natural Science Foundation of China:[Grant Number 21976043,42122009]Guangxi Science&Technology Program:[Grant Number GuikeAD20159037]+1 种基金‘Ba Gui Scholars’program of the provincial government of Guangxi,and the Guilin University of Technology Foundation:[Grant Number GUTQDJJ2017096]Innovation Project of Guangxi Graduate Education:[Grant Number YCSW2022328].
文摘Vegetation is crucial for wetland ecosystems.Human activities and climate changes are increasingly threatening wetland ecosystems.Combining satellite images and deep learning for classifying marsh vegetation communities has faced great challenges because of its coarse spatial resolution and limited spectral bands.This study aimed to propose a method to classify marsh vegetation using multi-resolution multispectral and hyperspectral images,combining super-resolution techniques and a novel self-constructing graph attention neural network(SGA-Net)algorithm.The SGA-Net algorithm includes a decoding layer(SCE-Net)to preciselyfine marsh vegetation classification in Honghe National Nature Reserve,Northeast China.The results indicated that the hyperspectral reconstruction images based on the super-resolution convolutional neural network(SRCNN)obtained higher accuracy with a peak signal-to-noise ratio(PSNR)of 28.87 and structural similarity(SSIM)of 0.76 in spatial quality and root mean squared error(RMSE)of 0.11 and R^(2) of 0.63 in spectral quality.The improvement of classification accuracy(MIoU)by enhanced super-resolution generative adversarial network(ESRGAN)(6.19%)was greater than that of SRCNN(4.33%)and super-resolution generative adversarial network(SRGAN)(3.64%).In most classification schemes,the SGA-Net outperformed DeepLabV3+and SegFormer algorithms for marsh vegetation and achieved the highest F1-score(78.47%).This study demonstrated that collaborative use of super-resolution reconstruction and deep learning is an effective approach for marsh vegetation mapping.
基金supported by the National Key R&D Program of China(2021YFF0502900)the National Natural Science Foundation of China(61835009/62127819).
文摘The algorithm used for reconstruction or resolution enhancement is one of the factors affectingthe quality of super-resolution images obtained by fluorescence microscopy.Deep-learning-basedalgorithms have achieved stateof-the-art performance in super-resolution fluorescence micros-copy and are becoming increasingly attractive.We firstly introduce commonly-used deep learningmodels,and then review the latest applications in terms of the net work architectures,the trainingdata and the loss functions.Additionally,we discuss the challenges and limits when using deeplearning to analyze the fluorescence microscopic data,and suggest ways to improve the reliability and robustness of deep learning applications.
基金supported by the National Science and Technology Major Project,China(No.J2019-Ⅲ-0009-0053)the National Natural Science Foundation of China(No.12075319)。
文摘In order to reconstruct and render the weak and repetitive texture of the damaged functional surface of aviation,an improved neural radiance field,named TranSR-NeRF,is proposed.In this paper,a data acquisition system was designed and built.The acquired images generated initial point clouds through TransMVSNet.Meanwhile,after extracting features from the images through the improved SE-ConvNeXt network,the extracted features were aligned and fused with the initial point cloud to generate high-quality neural point cloud.After ray-tracing and sampling of the neural point cloud,the ResMLP neural network designed in this paper was used to regress the volume density and radiance under a given viewing angle,which introduced spatial coordinate and relative positional encoding.The reconstruction and rendering of arbitrary-scale super-resolution of damaged functional surface is realized.In this paper,the influence of illumination conditions and background environment on the model performance is also studied through experiments,and the comparison and ablation experiments for the improved methods proposed in this paper is conducted.The experimental results show that the improved model has good effect.Finally,the application experiment of object detection task is carried out,and the experimental results show that the model has good practicability.
文摘Aiming at solving the problem of low resolu- tion and visual blur in infrared imaging, a super-resolution infrared image reconstruction method using human vision processing mechanism (HVPM) was proposed. This method combined a mechanism of vision lateral inhibition with an algorithm projection onto convex sets (POCS) reconstruction, the improved vision lateral inhibition network was utilized to enhance the contrast between object and background of low-resolution image sequences, then POCS algorithm was adopted to reconstruct super- resolution image. Experimental results showed that the proposed method can significantly improve the visual effect of image, whose contrast and information entropy of reconstructed infrared images were improved by approxi- mately 5 times and 1.6 times compared with traditional POCS reconstruction algorithm, respectively.
基金This work was supported by the National Natural Science Foundation of China (Grant Nos. 61275099 and 6 1671094) and the Natural Science foundation of Chongqing Science and Technology Commission (No, CSTC2015JCYJA40032).
文摘Super-resolution (SR) is a widely used tech- nology that increases image resolution using algorithmic methods. However, preserving the local edge structure and visual quality in infrared (IR) SR images is challenging because of their disadvantages, such as lack of detail, poor contrast, and blurry edges. Traditional and advanced methods maintain the quantitative measures, but they mostly fail to preserve edge and visual quality. This paper proposes an algorithm based on high frequency layer features. This algorithm focuses on the IR image edge texture in the reconstruction process. Experimental results show that the mean gradient of the IR image reconstructed by the proposed algorithm increased by 1.5, 1.4, and 1.2 times than that of the traditional algorithm based on L1- norm, L2-norm, and traditional mixed norm, respectively. The peak signal-to-noise ratio, structural similarity index, and visual effect of the reconstructed image also improved.
文摘In this work, we describe a new multiframe Super-Resolution(SR) framework based on time-scale adaptive Normalized Convolution(NC), and apply it to astronomical images. The method mainly uses the conceptual basis of NC where each neighborhood of a signal is expressed in terms of the corresponding subspace expanded by the chosen polynomial basis function. Instead of the conventional NC, the introduced spatially adaptive filtering kernel is utilized as the applicability function of shape-adaptive NC, which fits the local image structure information including shape and orientation. This makes it possible to obtain image patches with the same modality,which are collected for polynomial expansion to maximize the signal-to-noise ratio and suppress aliasing artifacts across lines and edges. The robust signal certainty takes the confidence value at each point into account before a local polynomial expansion to minimize the influence of outliers.Finally, the temporal scale applicability is considered to omit accurate motion estimation since it is easy to result in annoying registration errors in real astronomical applications. Excellent SR reconstruction capability of the time-scale adaptive NC is demonstrated through fundamental experiments on both synthetic images and real astronomical images when compared with other SR reconstruction methods.
基金Project supported by the National Natural Science Foundation of China(Grant Nos.61605218 and 61601442)the National Defense Science and Technology Innovation Foundation of the Chinese Academy of Sciences(Grant No.CXJJ-16S047)the National Major Scientific Instruments Development Project of China(Grant No.2013YQ030595)
文摘We demonstrate that, by undersampling scanning object with a reconstruction algorithm related to compressed sensing, an image with the resolution exceeding the finest resolution defined by the numerical aperture of the system can be obtained. Experimental results show that the measurements needed to achieve sub-Rayleigh resolution enhancement can be less than 10% of the pixels of the object. This method offers a general approach applicable to point-by-point illumination super-resolution techniques.
基金the National Natural Science Foundation of China(91850202,92150301,12074121,62105101,62175066,11727810,12034008,12274129,12274139)Science and Technology Commission of Shanghai Municipality(21XD1400900,20ZR1417100,21JM0010700).
文摘Various super-resolution microscopy techniques have been presented to explore fine structures of biological specimens.However,the super-resolution capability is often achieved at the expense of reducing imaging speed by either point scanning or multiframe computation.The contradiction between spatial resolution and imaging speed seriously hampers the observation of high-speed dynamics of fine structures.To overcome this contradiction,here we propose and demonstrate a temporal compressive super-resolution microscopy(TCSRM)technique.This technique is to merge an enhanced temporal compressive microscopy and a deep-learning-based super-resolution image reconstruction,where the enhanced temporal compressive microscopy is utilized to improve the imaging speed,and the deep-learning-based super-resolution image reconstruction is used to realize the resolution enhancement.The high-speed super-resolution imaging ability of TCSRM with a frame rate of 1200 frames per second(fps)and spatial resolution of 100 nm is experimentally demonstrated by capturing the flowing fluorescent beads in microfluidic chip.Given the outstanding imaging performance with high-speed super-resolution,TCSRM provides a desired tool for the studies of high-speed dynamical behaviors in fine structures,especially in the biomedical field.