Pyramid Separable Channel Attention Network for Single Image Super-Resolution

Single Image Super-Resolution(SISR)technology aims to reconstruct a clear,high-resolution image with more information from an input low-resolution image that is blurry and contains less information.This technology has significant research value and is widely used in fields such as medical imaging,satellite image processing,and security surveillance.Despite significant progress in existing research,challenges remain in reconstructing clear and complex texture details,with issues such as edge blurring and artifacts still present.The visual perception effect still needs further enhancement.Therefore,this study proposes a Pyramid Separable Channel Attention Network(PSCAN)for the SISR task.Thismethod designs a convolutional backbone network composed of Pyramid Separable Channel Attention blocks to effectively extract and fuse multi-scale features.This expands the model’s receptive field,reduces resolution loss,and enhances the model’s ability to reconstruct texture details.Additionally,an innovative artifact loss function is designed to better distinguish between artifacts and real edge details,reducing artifacts in the reconstructed images.We conducted comprehensive ablation and comparative experiments on the Arabidopsis root image dataset and several public datasets.The experimental results show that the proposed PSCAN method achieves the best-known performance in both subjective visual effects and objective evaluation metrics,with improvements of 0.84 in Peak Signal-to-Noise Ratio(PSNR)and 0.017 in Structural Similarity Index(SSIM).This demonstrates that the method can effectively preserve high-frequency texture details,reduce artifacts,and have good generalization performance.

Research on single image super-resolution based on very deep super-resolution convolutional neural network

Single image super-resolution(SISR)is a fundamentally challenging problem because a low-resolution(LR)image can correspond to a set of high-resolution(HR)images,while most are not expected.Recently,SISR can be achieved by a deep learning-based method.By constructing a very deep super-resolution convolutional neural network(VDSRCNN),the LR images can be improved to HR images.This study mainly achieves two objectives:image super-resolution(ISR)and deblurring the image from VDSRCNN.Firstly,by analyzing ISR,we modify different training parameters to test the performance of VDSRCNN.Secondly,we add the motion blurred images to the training set to optimize the performance of VDSRCNN.Finally,we use image quality indexes to evaluate the difference between the images from classical methods and VDSRCNN.The results indicate that the VDSRCNN performs better in generating HR images from LR images using the optimized VDSRCNN in a proper method.

Deep Learning Based Single Image Super-resolution:A Survey

Single image super-resolution has attracted increasing attention and has a wide range of applications in satellite imaging, medical imaging, computer vision, security surveillance imaging, remote sensing, objection detection, and recognition. Recently, deep learning techniques have emerged and blossomed, producing " the state-of-the-art” in many domains. Due to their capability in feature extraction and mapping, it is very helpful to predict high-frequency details lost in low-resolution images. In this paper, we give an overview of recent advances in deep learning-based models and methods that have been applied to single image super-resolution tasks. We also summarize, compare and discuss various models from the past and present for comprehensive understanding and finally provide open problems and possible directions for future research.

Adaptive deep residual network for single image super-resolution

In recent years,deep learning has achieved great success in the field of image processing.In the single image super-resolution(SISR)task,the convolutional neural network(CNN)extracts the features of the image through deeper layers,and has achieved impressive results.In this paper,we propose a single image super-resolution model based on Adaptive Deep Residual named as ADR-SR,which uses the Input Output Same Size(IOSS)structure,and releases the dependence of upsampling layers compared with the existing SR methods.Specifically,the key element of our model is the Adaptive Residual Block(ARB),which replaces the commonly used constant factor with an adaptive residual factor.The experiments prove the effectiveness of our ADR-SR model,which can not only reconstruct images with better visual effects,but also get better objective performances.

Single color image super-resolution using sparse representation and color constraint

Color image super-resolution reconstruction based on the sparse representation model usually adopts the regularization norm(e.g.,L1 or L2).These methods have limited ability to keep image texture detail to some extent and are easy to cause the problem of blurring details and color artifacts in color reconstructed images.This paper presents a color super-resolution reconstruction method combining the L2/3 sparse regularization model with color channel constraints.The method converts the low-resolution color image from RGB to YCbCr.The L2/3 sparse regularization model is designed to reconstruct the brightness channel of the input low-resolution color image.Then the color channel-constraint method is adopted to remove artifacts of the reconstructed highresolution image.The method not only ensures the reconstruction quality of the color image details,but also improves the removal ability of color artifacts.The experimental results on natural images validate that our method has improved both subjective and objective evaluation.

Hyperspectral Image Super-Resolution Meets Deep Learning:A Survey and Perspective

Hyperspectral image super-resolution,which refers to reconstructing the high-resolution hyperspectral image from the input low-resolution observation,aims to improve the spatial resolution of the hyperspectral image,which is beneficial for subsequent applications.The development of deep learning has promoted significant progress in hyperspectral image super-resolution,and the powerful expression capabilities of deep neural networks make the predicted results more reliable.Recently,several latest deep learning technologies have made the hyperspectral image super-resolution method explode.However,a comprehensive review and analysis of the latest deep learning methods from the hyperspectral image super-resolution perspective is absent.To this end,in this survey,we first introduce the concept of hyperspectral image super-resolution and classify the methods from the perspectives with or without auxiliary information.Then,we review the learning-based methods in three categories,including single hyperspectral image super-resolution,panchromatic-based hyperspectral image super-resolution,and multispectral-based hyperspectral image super-resolution.Subsequently,we summarize the commonly used hyperspectral dataset,and the evaluations for some representative methods in three categories are performed qualitatively and quantitatively.Moreover,we briefly introduce several typical applications of hyperspectral image super-resolution,including ground object classification,urban change detection,and ecosystem monitoring.Finally,we provide the conclusion and challenges in existing learning-based methods,looking forward to potential future research directions.

IRMIRS:Inception-ResNet-Based Network for MRI Image Super-Resolution

Medical image super-resolution is a fundamental challenge due to absorption and scattering in tissues.These challenges are increasing the interest in the quality of medical images.Recent research has proven that the rapid progress in convolutional neural networks(CNNs)has achieved superior performance in the area of medical image super-resolution.However,the traditional CNN approaches use interpolation techniques as a preprocessing stage to enlarge low-resolution magnetic resonance(MR)images,adding extra noise in the models and more memory consumption.Furthermore,conventional deep CNN approaches used layers in series-wise connection to create the deeper mode,because this later end layer cannot receive complete information and work as a dead layer.In this paper,we propose Inception-ResNet-based Network for MRI Image Super-Resolution known as IRMRIS.In our proposed approach,a bicubic interpolation is replaced with a deconvolution layer to learn the upsampling filters.Furthermore,a residual skip connection with the Inception block is used to reconstruct a high-resolution output image from a low-quality input image.Quantitative and qualitative evaluations of the proposed method are supported through extensive experiments in reconstructing sharper and clean texture details as compared to the state-of-the-art methods.

A Single Image Derain Method Based on Residue Channel Decomposition in Edge Computing

The numerous photos captured by low-price Internet of Things(IoT)sensors are frequently affected by meteorological factors,especially rainfall.It causes varying sizes of white streaks on the image,destroying the image texture and ruining the performance of the outdoor computer vision system.Existing methods utilise training with pairs of images,which is difficult to cover all scenes and leads to domain gaps.In addition,the network structures adopt deep learning to map rain images to rain-free images,failing to use prior knowledge effectively.To solve these problems,we introduce a single image derain model in edge computing that combines prior knowledge of rain patterns with the learning capability of the neural network.Specifically,the algorithm first uses Residue Channel Prior to filter out the rainfall textural features then it uses the Feature Fusion Module to fuse the original image with the background feature information.This results in a pre-processed image which is fed into Half Instance Net(HINet)to recover a high-quality rain-free image with a clear and accurate structure,and the model does not rely on any rainfall assumptions.Experimental results on synthetic and real-world datasets show that the average peak signal-to-noise ratio of the model decreases by 0.37 dB on the synthetic dataset and increases by 0.43 dB on the real-world dataset,demonstrating that a combined model reduces the gap between synthetic data and natural rain scenes,improves the generalization ability of the derain network,and alleviates the overfitting problem.

Fast image super-resolution algorithm based on multi-resolution dictionary learning and sparse representation

Sparse representation has attracted extensive attention and performed well on image super-resolution（SR） in the last decade. However, many current image SR methods face the contradiction of detail recovery and artifact suppression. We propose a multi-resolution dictionary learning（MRDL） model to solve this contradiction, and give a fast single image SR method based on the MRDL model. To obtain the MRDL model, we first extract multi-scale patches by using our proposed adaptive patch partition method（APPM）. The APPM divides images into patches of different sizes according to their detail richness. Then, the multiresolution dictionary pairs, which contain structural primitives of various resolutions, can be trained from these multi-scale patches.Owing to the MRDL strategy, our SR algorithm not only recovers details well, with less jag and noise, but also significantly improves the computational efficiency. Experimental results validate that our algorithm performs better than other SR methods in evaluation metrics and visual perception.

Image Super-Resolution Based on Generative Adversarial Networks: A Brief Review

Single image super resolution(SISR)is an important research content in the field of computer vision and image processing.With the rapid development of deep neural networks,different image super-resolution models have emerged.Compared to some traditional SISR methods,deep learning-based methods can complete the super-resolution tasks through a single image.In addition,compared with the SISR methods using traditional convolutional neural networks,SISR based on generative adversarial networks(GAN)has achieved the most advanced visual performance.In this review,we first explore the challenges faced by SISR and introduce some common datasets and evaluation metrics.Then,we review the improved network structures and loss functions of GAN-based perceptual SISR.Subsequently,the advantages and disadvantages of different networks are analyzed by multiple comparative experiments.Finally,we summarize the paper and look forward to the future development trends of GAN-based perceptual SISR.

Better Visual Image Super-Resolution with Laplacian Pyramid of Generative Adversarial Networks

Although there has been a great breakthrough in the accuracy and speed of super-resolution(SR)reconstruction of a single image by using a convolutional neural network,an important problem remains unresolved:how to restore finer texture details during image super-resolution reconstruction?This paper proposes an Enhanced Laplacian Pyramid Generative Adversarial Network(ELSRGAN),based on the Laplacian pyramid to capture the high-frequency details of the image.By combining Laplacian pyramids and generative adversarial networks,progressive reconstruction of super-resolution images can be made,making model applications more flexible.In order to solve the problem of gradient disappearance,we introduce the Residual-in-Residual Dense Block(RRDB)as the basic network unit.Network capacity benefits more from dense connections,is able to capture more visual features with better reconstruction effects,and removes BN layers to increase calculation speed and reduce calculation complexity.In addition,a loss of content driven by perceived similarity is used instead of content loss driven by spatial similarity,thereby enhancing the visual effect of the super-resolution image,making it more consistent with human visual perception.Extensive qualitative and quantitative evaluation of the baseline datasets shows that the proposed algorithm has higher mean-sort-score(MSS)than any state-of-the-art method and has better visual perception.

Centimeter-sized Cs_(3)Cu_(2)I_(5)single crystals grown by oleic acid assisted inverse temperature crystallization strategy and their films for high-quality X-ray imaging

Low-dimensional halide perovskites have become the most promising candidates for X-ray imaging,yet the issues of the poor chemical stability of hybrid halide perovskite,the high poisonousness of lead halides and the relatively low detectivity of the lead-free halide perovskites which seriously restrain its commercialization.Here,we developed a solution inverse temperature crystal growth(ITCG)method to bring-up high quality Cs_(3)Cu_(2)I_(5)crystals with large size of centimeter order,in which the oleic acid(OA)is introduced as an antioxidative ligand to inhibit the oxidation of cuprous ions effieiently,as well as to decelerate the crystallization rate remarkalby.Based on these fine crystals,the vapor deposition technique is empolyed to prepare high quality Cs_(3)Cu_(2)I_(5)films for efficient X-ray imaging.Smooth surface morphology,high light yields and short decay time endow the Cs_(3)Cu_(2)I_(5)films with strong radioluminescence,high resolution(12 lp/mm),low detection limits(53 nGyair/s)and desirable stability.Subsequently,the Cs_(3)Cu_(2)I_(5)films have been applied to the practical radiography which exhibit superior X-ray imaging performance.Our work provides a paradigm to fabricate nonpoisonous and chemically stable inorganic halide perovskite for X-ray imaging.

Impact of cognition-related single nucleotide polymorphisms on brain imaging phenotype in Parkinson’s disease

Multiple single nucleotide polymorphisms may contribute to cognitive decline in Parkinson’s disease. However, the mechanism by which these single nucleotide polymorphisms modify brain imaging phenotype remains unclear. The aim of this study was to investigate the potential effects of multiple single nucleotide polymorphisms on brain imaging phenotype in Parkinson’s disease. Forty-eight Parkinson’s disease patients and 39 matched healthy controls underwent genotyping and 7 T magnetic resonance imaging. A cognitive-weighted polygenic risk score model was designed, in which the effect sizes were determined individually for 36 single nucleotide polymorphisms. The correlations between polygenic risk score, neuroimaging features, and clinical data were analyzed. Furthermore, individual single nucleotide polymorphism analysis was performed to explore the main effects of genotypes and their interactive effects with Parkinson’s disease diagnosis. We found that, in Parkinson’s disease, the polygenic risk score was correlated with the neural activity of the hippocampus, parahippocampus, and fusiform gyrus, and with hippocampal-prefrontal and fusiform-temporal connectivity, as well as with gray matter alterations in the orbitofrontal cortex. In addition, we found that single nucleotide polymorphisms in α-synuclein(SNCA) were associated with white matter microstructural changes in the superior corona radiata, corpus callosum, and external capsule. A single nucleotide polymorphism in catechol-O-methyltransferase was associated with the neural activities of the lingual, fusiform, and occipital gyri, which are involved in visual cognitive dysfunction. Furthermore, DRD3 was associated with frontal and temporal lobe function and structure. In conclusion, imaging genetics is useful for providing a better understanding of the genetic pathways involved in the pathophysiologic processes underlying Parkinson’s disease. This study provides evidence of an association between genetic factors, cognitive functions, and multi-modality neuroimaging biomarkers in Parkinson’s disease.

Observing single cells in whole organs with optical imaging

Cells are the basic unit of human organs that are not fully understood.The revolutionary advancements of optical imaging alowed us to observe single cells in whole organs,revealing the complicated composition of cells with spatial information.Therefore,in this review,we revisit the principles of optical contrast related to those biomolecules and the optical techniques that transform optical contrast into detectable optical signals.Then,we describe optical imaging to achieve threedimensional spatial discrimination for biological tisutes.Due to the milky appearance of tissues,the spatial information burred deep in the whole organ.Fortunately,strategies developed in the last decade could circumvent this issue and lead us into a new era of investigation of the cells with their original spatial information.

Single exposure passive three-dimensional information reconstruction based on an ordinary imaging system

Existing three-dimensional(3D) imaging technologies have issues such as requiring active illumination, multiple exposures, or coding modulation. We propose a passive single 3D imaging method based on an ordinary imaging system.Using the point spread function of the imaging system to realize the non-coding measurement on the target, the full-focus images and depth information of the 3D target can be extracted from a single two-dimensional(2D) image through the compressed sensing algorithm. Simulation and experiments show that this approach can complete passive 3D imaging based on an ordinary imaging system without any coding operations. This method can achieve millimeter-level vertical resolution under single exposure conditions and has the potential for real-time dynamic 3D imaging. It improves the efficiency of 3D information detection, reduces the complexity of the imaging system, and may be of considerable value to the field of computer vision and other related applications.

Single frame super-resolution reconstruction based on sparse representation

In order to effectively improve the quality of recovered images, a single frame super-resolution reconstruction method based on sparse representation is proposed. The combination method of local orientation estimation-based image patch clustering and principal component analysis is used to obtain a series of geometric dictionaries of different orientations in the dictionary learning process. Subsequently, the dictionary of the nearest orientation is adaptively assigned to each of the input patches that need to be represented in the sparse coding process. Moreover, the consistency of gradients is further incorporated into the basic framework to make more substantial progress in preserving more fine edges and producing sharper results. Two groups of experiments on different types of natural images indicate that the proposed method outperforms some state-of- the-art counterparts in terms of both numerical indicators and visual quality.

Super-resolution reconstruction of synthetic-aperture radar image using adaptive-threshold singular value decomposition technique

A super-resolution reconstruction approach of （SVD） technique was presented, and its performance was radar image using an adaptive-threshold singular value decomposition analyzed, compared and assessed detailedly. First, radar imaging model and super-resolution reconstruction mechanism were outlined. Then, the adaptive-threshold SVD super-resolution algorithm, and its two key aspects, namely the determination method of point spread function （PSF） matrix T and the selection scheme of singular value threshold, were presented. Finally, the super-resolution algorithm was demonstrated successfully using the measured synthetic-aperture radar （SAR） images, and a Monte Carlo assessment was carried out to evaluate the performance of the algorithm by using the input/output signal-to-noise ratio （SNR）. Five versions of SVD algorithms, namely 1 ） using all singular values, 2） using the top 80% singular values, 3） using the top 50% singular values, 4） using the top 20% singular values and 5） using singular values s such that S2≥/max（s2）/rinsNR were tested. The experimental results indicate that when the singular value threshold is set as Smax/（rinSNR）1/2, the super-resolution algorithm provides a good compromise between too much noise and too much bias and has good reconstruction results.

R2N: A Novel Deep Learning Architecture for Rain Removal from Single Image

Visual degradation of captured images caused by rainy streaks under rainy weather can adversely affect the performance of many open-air vision systems.Hence,it is necessary to address the problem of eliminating rain streaks from the individual rainy image.In this work,a deep convolution neural network(CNN)based method is introduced,called Rain-Removal Net(R2N),to solve the single image de-raining issue.Firstly,we decomposed the rainy image into its high-frequency detail layer and lowfrequency base layer.Then,we used the high-frequency detail layer to input the carefully designed CNN architecture to learn the mapping between it and its corresponding derained high-frequency detail layer.The CNN architecture consists of four convolution layers and four deconvolution layers,as well as three skip connections.The experiments on synthetic and real-world rainy images show that the performance of our architecture outperforms the compared state-of-the-art de-raining models with respects to the quality of de-rained images and computing efficiency.

Super-resolution processing of passive millimeter-wave images based on conjugate-gradient algorithm

This paper designs a 3 mm radiometer and validate with experiments based on the principle of passive millimeter wave （PMMW） imaging. The poor spatial resolution, which is limited by antenna size, should be improved by post data processing. A conjugate-gradient （CG） algorithm is adopted to circumvent this drawback. Simulation and real data collected in laboratory environment are given, and the results show that the CG algorithm improves the spatial resolution and convergent rate. Further, it can reduce the ringing effects which are caused by regularizing the image restoration. Thus, the CG algorithm is easily implemented for PMMW imaging.

Image super-resolution reconstruction based on sparse representation and residual compensation

A super-resolution reconstruction algorithm is proposed. The algorithm is based on the idea of the sparse representation of signals, by using the fact that the sparsest representation of a sig- nal is unique as the constraint of the patched-based reconstruction, and compensating residual errors of the reconstruction results both locally and globally to solve the distortion problem in patch-based reconstruction algorithms. Three reconstruction algorithms are compared. The results show that the images reconstructed with the new algorithm have the best quality.