Numerical Simulation of Super-Resolution Structured Illumination Microscopy (SIM) Using Heintzmann-Cremer Algorithm with Non-Continuous Spatial Frequency Support

We report a comprehensive numerical study of super resolution (SR) structured illumination microscopy (SIM) utilizing the classic Heintzmann-Cremer SIM process and algorithm. In particular, we investigated the impact of the diffraction limit of the underlying imaging system on the optimal SIM grating frequency that can be used to obtain the highest SR enhancement with non-continuous spatial frequency support. Besides confirming the previous theoretical and experimental work that SR-SIM can achieve an enhancement close to 3 times the diffraction limit with grating pattern illuminations, we also observe and report a series of more subtle effects of SR-SIM with non-continuous spatial frequency support. Our simulations show that when the SIM grating frequency exceeds twice that of the diffraction limit, the higher SIM grating frequency can help achieve a higher SR enhancement for the underlying imaging systems whose diffraction limit is low, though this enhancement is obtained at the cost of losing resolution at some lower resolution targets. Our simulations also show that, for underlying imaging systems with high diffraction limits, however, SR-SIM grating frequencies above twice the diffraction limits tend to bring no significant extra enhancement. Furthermore, we observed that there exists a limit grating frequency above which the SR enhancement effect is lost, and the reconstructed images essentially have the same resolution as the one obtained directly from the underlying imaging system without using the SIM process.

Shear Let Transform Residual Learning Approach for Single-Image Super-Resolution

Super-resolution techniques are employed to enhance image resolution by reconstructing high-resolution images from one or more low-resolution inputs.Super-resolution is of paramount importance in the context of remote sensing,satellite,aerial,security and surveillance imaging.Super-resolution remote sensing imagery is essential for surveillance and security purposes,enabling authorities to monitor remote or sensitive areas with greater clarity.This study introduces a single-image super-resolution approach for remote sensing images,utilizing deep shearlet residual learning in the shearlet transform domain,and incorporating the Enhanced Deep Super-Resolution network(EDSR).Unlike conventional approaches that estimate residuals between high and low-resolution images,the proposed approach calculates the shearlet coefficients for the desired high-resolution image using the provided low-resolution image instead of estimating a residual image between the high-and low-resolution image.The shearlet transform is chosen for its excellent sparse approximation capabilities.Initially,remote sensing images are transformed into the shearlet domain,which divides the input image into low and high frequencies.The shearlet coefficients are fed into the EDSR network.The high-resolution image is subsequently reconstructed using the inverse shearlet transform.The incorporation of the EDSR network enhances training stability,leading to improved generated images.The experimental results from the Deep Shearlet Residual Learning approach demonstrate its superior performance in remote sensing image recovery,effectively restoring both global topology and local edge detail information,thereby enhancing image quality.Compared to other networks,our proposed approach outperforms the state-of-the-art in terms of image quality,achieving an average peak signal-to-noise ratio of 35 and a structural similarity index measure of approximately 0.9.

AFBNet: A Lightweight Adaptive Feature Fusion Module for Super-Resolution Algorithms

At present,super-resolution algorithms are employed to tackle the challenge of low image resolution,but it is difficult to extract differentiated feature details based on various inputs,resulting in poor generalization ability.Given this situation,this study first analyzes the features of some feature extraction modules of the current super-resolution algorithm and then proposes an adaptive feature fusion block(AFB)for feature extraction.This module mainly comprises dynamic convolution,attention mechanism,and pixel-based gating mechanism.Combined with dynamic convolution with scale information,the network can extract more differentiated feature information.The introduction of a channel spatial attention mechanism combined with multi-feature fusion further enables the network to retain more important feature information.Dynamic convolution and pixel-based gating mechanisms enhance the module’s adaptability.Finally,a comparative experiment of a super-resolution algorithm based on the AFB module is designed to substantiate the efficiency of the AFB module.The results revealed that the network combined with the AFB module has stronger generalization ability and expression ability.

PSMFNet:Lightweight Partial Separation and Multiscale Fusion Network for Image Super-Resolution

The employment of deep convolutional neural networks has recently contributed to significant progress in single image super-resolution(SISR)research.However,the high computational demands of most SR techniques hinder their applicability to edge devices,despite their satisfactory reconstruction performance.These methods commonly use standard convolutions,which increase the convolutional operation cost of the model.In this paper,a lightweight Partial Separation and Multiscale Fusion Network(PSMFNet)is proposed to alleviate this problem.Specifically,this paper introduces partial convolution(PConv),which reduces the redundant convolution operations throughout the model by separating some of the features of an image while retaining features useful for image reconstruction.Additionally,it is worth noting that the existing methods have not fully utilized the rich feature information,leading to information loss,which reduces the ability to learn feature representations.Inspired by self-attention,this paper develops a multiscale feature fusion block(MFFB),which can better utilize the non-local features of an image.MFFB can learn long-range dependencies from the spatial dimension and extract features from the channel dimension,thereby obtaining more comprehensive and rich feature information.As the role of the MFFB is to capture rich global features,this paper further introduces an efficient inverted residual block(EIRB)to supplement the local feature extraction ability of PSMFNet.A comprehensive analysis of the experimental results shows that PSMFNet maintains a better performance with fewer parameters than the state-of-the-art models.

Efficient 2-D MUSIC algorithm for super-resolution moving target tracking based on an FMCW radar

Frequency modulated continuous wave(FMCW)radar is an advantageous sensor scheme for target estimation and environmental perception.However,existing algorithms based on discrete Fourier transform(DFT),multiple signal classification(MUSIC)and compressed sensing,etc.,cannot achieve both low complexity and high resolution simultaneously.This paper proposes an efficient 2-D MUSIC algorithm for super-resolution target estimation/tracking based on FMCW radar.Firstly,we enhance the efficiency of 2-D MUSIC azimuth-range spectrum estimation by incorporating 2-D DFT and multi-level resolution searching strategy.Secondly,we apply the gradient descent method to tightly integrate the spatial continuity of object motion into spectrum estimation when processing multi-epoch radar data,which improves the efficiency of continuous target tracking.These two approaches have improved the algorithm efficiency by nearly 2-4 orders of magnitude without losing accuracy and resolution.Simulation experiments are conducted to validate the effectiveness of the algorithm in both single-epoch estimation and multi-epoch tracking scenarios.

Pyramid Separable Channel Attention Network for Single Image Super-Resolution

Single Image Super-Resolution(SISR)technology aims to reconstruct a clear,high-resolution image with more information from an input low-resolution image that is blurry and contains less information.This technology has significant research value and is widely used in fields such as medical imaging,satellite image processing,and security surveillance.Despite significant progress in existing research,challenges remain in reconstructing clear and complex texture details,with issues such as edge blurring and artifacts still present.The visual perception effect still needs further enhancement.Therefore,this study proposes a Pyramid Separable Channel Attention Network(PSCAN)for the SISR task.Thismethod designs a convolutional backbone network composed of Pyramid Separable Channel Attention blocks to effectively extract and fuse multi-scale features.This expands the model’s receptive field,reduces resolution loss,and enhances the model’s ability to reconstruct texture details.Additionally,an innovative artifact loss function is designed to better distinguish between artifacts and real edge details,reducing artifacts in the reconstructed images.We conducted comprehensive ablation and comparative experiments on the Arabidopsis root image dataset and several public datasets.The experimental results show that the proposed PSCAN method achieves the best-known performance in both subjective visual effects and objective evaluation metrics,with improvements of 0.84 in Peak Signal-to-Noise Ratio(PSNR)and 0.017 in Structural Similarity Index(SSIM).This demonstrates that the method can effectively preserve high-frequency texture details,reduce artifacts,and have good generalization performance.

Multi-prior physics-enhanced neural network enables pixel super-resolution and twin-imagefree phase retrieval from single-shot hologram

Digital in-line holographic microscopy(DIHM)is a widely used interference technique for real-time reconstruction of living cells’morphological information with large space-bandwidth product and compact setup.However,the need for a larger pixel size of detector to improve imaging photosensitivity,field-of-view,and signal-to-noise ratio often leads to the loss of sub-pixel information and limited pixel resolution.Additionally,the twin-image appearing in the reconstruction severely degrades the quality of the reconstructed image.The deep learning(DL)approach has emerged as a powerful tool for phase retrieval in DIHM,effectively addressing these challenges.However,most DL-based strategies are datadriven or end-to-end net approaches,suffering from excessive data dependency and limited generalization ability.Herein,a novel multi-prior physics-enhanced neural network with pixel super-resolution(MPPN-PSR)for phase retrieval of DIHM is proposed.It encapsulates the physical model prior,sparsity prior and deep image prior in an untrained deep neural network.The effectiveness and feasibility of MPPN-PSR are demonstrated by comparing it with other traditional and learning-based phase retrieval methods.With the capabilities of pixel super-resolution,twin-image elimination and high-throughput jointly from a single-shot intensity measurement,the proposed DIHM approach is expected to be widely adopted in biomedical workflow and industrial measurement.

Faster split-based feedback network for image super-resolution

Although most of the existing image super-resolution(SR)methods have achieved superior performance,contrastive learning for high-level tasks has not been fully utilized in the existing image SR methods based on deep learning.This work focuses on two well-known strategies developed for lightweight and robust SR,i.e.,contrastive learning and feedback mechanism,and proposes an integrated solution called a split-based feedback network(SPFBN).The proposed SPFBN is based on a feedback mechanism to learn abstract representations and uses contrastive learning to explore high information in the representation space.Specifically,this work first uses hidden states and constraints in recurrent neural network(RNN)to implement a feedback mechanism.Then,use contrastive learning to perform representation learning to obtain high-level information by pushing the final image to the intermediate images and pulling the final SR image to the high-resolution image.Besides,a split-based feedback block(SPFB)is proposed to reduce model redundancy,which tolerates features with similar patterns but requires fewer parameters.Extensive experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-art methods.Moreover,this work extends the experiment to prove the effectiveness of this method and shows better overall reconstruction quality.

Generative adversarial networks for hyperspectral image spatial super-resolution

It is becoming increasingly easier to obtain more abundant supplies for hyperspectral images(HSIs). Despite this, achieving high resolution is still critical. In this paper, a method named hyperspectral images super-resolution generative adversarial network(HSI-SRGAN) is proposed to enhance the spatial resolution of HSI without decreasing its spectral resolution. Different from existing methods with the same purpose, which are based on convolutional neural networks(CNNs) and driven by a pixel-level loss function, the new generative adversarial network(GAN) has a redesigned framework and a targeted loss function. Specifically, the discriminator uses the structure of the relativistic discriminator, which provides feedback on how much the generated HSI looks like the ground truth. The generator achieves more authentic details and textures by removing the place of the pooling layer and the batch normalization layer and presenting smaller filter size and two-step upsampling layers. Furthermore, the loss function is improved to specially take spectral distinctions into account to avoid artifacts and minimize potential spectral distortion, which may be introduced by neural networks. Furthermore, pre-training with the visual geometry group(VGG) network helps the entire model to initialize more easily. Benefiting from these changes, the proposed method obtains significant advantages compared to the original GAN. Experimental results also reveal that the proposed method performs better than several state-of-the-art methods.

Spatio-Temporal Adaptive Super-Resolution Reconstruction Model Based on Zemike Moment for Spatial Video Sequences

Video Super-Resolution （SR） reconstruction produces video sequences with High Resolution （HR） via the fusion of several Low-Resolution （LR） video frames. Traditional methods rely on the accurate estimation of subpixel motion, which constrains their applicability to video sequences with relatively simple motions such as global translation. We propose an efficient iterative spatio-temporal adaptive SR reconstruction model based on Zemike Moment （ZM）, which is effective for spatial video sequences with arbitrary motion. The model uses region correlation judgment and self-adaptive threshold strategies to improve the effect and time efficiency of the ZM-based SR method. This leads to better mining of non-local self-similarity and local structural regularity, and is robust to noise and rotation. An efficient iterative curvature-based interpolation scheme is introduced to obtain the initial HR estimation of each LR video frame. Experimental results both on spatial and standard video sequences demonstrate that the proposed method outperforms existing methods in terms of both subjective visual and objective quantitative evaluations, and greatly improves the time efficiency.

Polarimetric super-resolution algorithm for radar range imaging via spatial smoothing processing

A full-polarimetric super-resolution algorithm with spatial smoothing processing is presented for one-dimensional（1-D）radar imaging.The coherence between scattering centers is minimized by using spatial smoothing processing（SSP）.Then the range and polarimetric scattering matrix of the scattering centers are estimated.The impact of different lengths of the smoothing window on the imaging quality is mainly analyzed with different signal-to-noise ratios（SNR）.Simulation and experimental results show that an improved radar super-resolution range profile and more precise estimation can be obtained by adjusting the length of the smoothing window under different SNR conditions.

Single-cell and spatial omics:exploring hypothalamic heterogeneity

Elucidating the complex dynamic cellular organization in the hypothalamus is critical for understanding its role in coordinating fundamental body functions. Over the past decade, single-cell and spatial omics technologies have significantly evolved, overcoming initial technical challenges in capturing and analyzing individual cells. These high-throughput omics technologies now offer a remarkable opportunity to comprehend the complex spatiotemporal patterns of transcriptional diversity and cell-type characteristics across the entire hypothalamus. Current single-cell and single-nucleus RNA sequencing methods comprehensively quantify gene expression by exploring distinct phenotypes across various subregions of the hypothalamus. However, single-cell/single-nucleus RNA sequencing requires isolating the cell/nuclei from the tissue, potentially resulting in the loss of spatial information concerning neuronal networks. Spatial transcriptomics methods, by bypassing the cell dissociation, can elucidate the intricate spatial organization of neural networks through their imaging and sequencing technologies. In this review, we highlight the applicative value of single-cell and spatial transcriptomics in exploring the complex molecular-genetic diversity of hypothalamic cell types, driven by recent high-throughput achievements.

Spatial transcriptomics combined with single-nucleus RNA sequencing reveals glial cell heterogeneity in the human spinal cord

Glial cells play crucial roles in regulating physiological and pathological functions,including sensation,the response to infection and acute injury,and chronic neurodegenerative disorders.Glial cells include astrocytes,microglia,and oligodendrocytes in the central nervous system,and satellite glial cells and Schwann cells in the peripheral nervous system.Despite the greater understanding of glial cell types and functional heterogeneity achieved through single-cell and single-nucleus RNA sequencing in animal models,few studies have investigated the transcriptomic profiles of glial cells in the human spinal cord.Here,we used high-throughput single-nucleus RNA sequencing and spatial transcriptomics to map the cellular and molecular heterogeneity of astrocytes,microglia,and oligodendrocytes in the human spinal cord.To explore the conservation and divergence across species,we compared these findings with those from mice.In the human spinal cord,astrocytes,microglia,and oligodendrocytes were each divided into six distinct transcriptomic subclusters.In the mouse spinal cord,astrocytes,microglia,and oligodendrocytes were divided into five,four,and five distinct transcriptomic subclusters,respectively.The comparative results revealed substantial heterogeneity in all glial cell types between humans and mice.Additionally,we detected sex differences in gene expression in human spinal cord glial cells.Specifically,in all astrocyte subtypes,the levels of NEAT1 and CHI3L1 were higher in males than in females,whereas the levels of CST3 were lower in males than in females.In all microglial subtypes,all differentially expressed genes were located on the sex chromosomes.In addition to sex-specific gene differences,the levels of MT-ND4,MT2A,MT-ATP6,MT-CO3,MT-ND2,MT-ND3,and MT-CO_(2) in all spinal cord oligodendrocyte subtypes were higher in females than in males.Collectively,the present dataset extensively characterizes glial cell heterogeneity and offers a valuable resource for exploring the cellular basis of spinal cordrelated illnesses,including chronic pain,amyotrophic lateral sclerosis,and multiple sclerosis.

Super-resolution reconstruction for license plate images of moving vehicles

A novel reconstruction method to improve the recognition of license plate texts of moving vehicles in real traffic videos is proposed, which fuses complimentary information among low resolution （LR） images to yield a high resolution （HR） image. Based on the regularization super-resolution （SR） reconstruction schemes, this paper first introduces a residual gradient （RG） term as a new regularization term to improve the quality of the reconstructed image. Moreover, L1 norm is used to measure the residual data （RD） term and the RG term in order to improve the robustness of the proposed method. Finally, the steepest descent method is exploited to solve the energy functional. Simulated and real acquired video sequence experiments show the effectiveness and practicability of the proposed method and demonstrate its superiority over the bi-cubic interpolation and discontinuity adaptive Markov random field （DAMRF） SR method in both signal to noise ratios （SNR） and visual effects.

Lightweight Image Super-Resolution via Weighted Multi-Scale Residual Network

The tradeoff between efficiency and model size of the convolutional neural network(CNN)is an essential issue for applications of CNN-based algorithms to diverse real-world tasks.Although deep learning-based methods have achieved significant improvements in image super-resolution(SR),current CNNbased techniques mainly contain massive parameters and a high computational complexity,limiting their practical applications.In this paper,we present a fast and lightweight framework,named weighted multi-scale residual network(WMRN),for a better tradeoff between SR performance and computational efficiency.With the modified residual structure,depthwise separable convolutions(DS Convs)are employed to improve convolutional operations’efficiency.Furthermore,several weighted multi-scale residual blocks(WMRBs)are stacked to enhance the multi-scale representation capability.In the reconstruction subnetwork,a group of Conv layers are introduced to filter feature maps to reconstruct the final high-quality image.Extensive experiments were conducted to evaluate the proposed model,and the comparative results with several state-of-the-art algorithms demonstrate the effectiveness of WMRN.

A Review of Clinical Applications for Super-resolution Ultrasound Localization Microscopy

Microvascular structure and hemodynamics are important indicators for the diagnosis and assessment of many diseases and pathologies.The structural and functional imaging of tissue microvasculature in vivo is a clinically significant objective for the development of many imaging modalities.Contrast-enhanced ultrasound(CEUS)is a popular clinical tool for characterizing tissue microvasculature,due to the moderate cost,wide accessibility,and absence of ionizing radiation of ultrasound.

Single frame super-resolution reconstruction based on sparse representation

In order to effectively improve the quality of recovered images, a single frame super-resolution reconstruction method based on sparse representation is proposed. The combination method of local orientation estimation-based image patch clustering and principal component analysis is used to obtain a series of geometric dictionaries of different orientations in the dictionary learning process. Subsequently, the dictionary of the nearest orientation is adaptively assigned to each of the input patches that need to be represented in the sparse coding process. Moreover, the consistency of gradients is further incorporated into the basic framework to make more substantial progress in preserving more fine edges and producing sharper results. Two groups of experiments on different types of natural images indicate that the proposed method outperforms some state-of- the-art counterparts in terms of both numerical indicators and visual quality.

Hyperspectral Image Super-Resolution Meets Deep Learning:A Survey and Perspective

Hyperspectral image super-resolution,which refers to reconstructing the high-resolution hyperspectral image from the input low-resolution observation,aims to improve the spatial resolution of the hyperspectral image,which is beneficial for subsequent applications.The development of deep learning has promoted significant progress in hyperspectral image super-resolution,and the powerful expression capabilities of deep neural networks make the predicted results more reliable.Recently,several latest deep learning technologies have made the hyperspectral image super-resolution method explode.However,a comprehensive review and analysis of the latest deep learning methods from the hyperspectral image super-resolution perspective is absent.To this end,in this survey,we first introduce the concept of hyperspectral image super-resolution and classify the methods from the perspectives with or without auxiliary information.Then,we review the learning-based methods in three categories,including single hyperspectral image super-resolution,panchromatic-based hyperspectral image super-resolution,and multispectral-based hyperspectral image super-resolution.Subsequently,we summarize the commonly used hyperspectral dataset,and the evaluations for some representative methods in three categories are performed qualitatively and quantitatively.Moreover,we briefly introduce several typical applications of hyperspectral image super-resolution,including ground object classification,urban change detection,and ecosystem monitoring.Finally,we provide the conclusion and challenges in existing learning-based methods,looking forward to potential future research directions.

Super-resolution imaging of low-contrast periodic nanoparticle arrays by microsphere-assisted microscopy

We use the label-free microsphere-assisted microscopy to image low-contrast hexagonally close-packed polystyrene nanoparticle arrays with diameters of 300 and 250 nm.When a nanoparticle array is directly placed on a glass slide,it cannot be distinguished.If a 30-nm-thick Ag film is deposited on the surface of a nanoparticle array,the nanoparticle array with nanoparticle diameters of 300 and 250 nm can be distinguished.In addition,the Talbot effect of the 300-nm-diameter nanoparticle array is also observed.If a nanoparticle sample is assembled on a glass slide deposited with a 30-nm-thick Ag film,an array of 300-nm-diameter nanoparticles can be discerned.We propose that in microsphere-assisted microscopy imaging,the resolution can be improved by the excitation of surface plasmon polaritons(SPPs) on the sample surface or at the sample/substrate interface,and a higher near-field intensity due to the excited SPPs would benefit the resolution improvement.Our study of label-free super-resolution imaging of low-contrast objects will promote the applications of microsphere-assisted microscopy in life sciences.

Super-resolution reconstruction of synthetic-aperture radar image using adaptive-threshold singular value decomposition technique

A super-resolution reconstruction approach of （SVD） technique was presented, and its performance was radar image using an adaptive-threshold singular value decomposition analyzed, compared and assessed detailedly. First, radar imaging model and super-resolution reconstruction mechanism were outlined. Then, the adaptive-threshold SVD super-resolution algorithm, and its two key aspects, namely the determination method of point spread function （PSF） matrix T and the selection scheme of singular value threshold, were presented. Finally, the super-resolution algorithm was demonstrated successfully using the measured synthetic-aperture radar （SAR） images, and a Monte Carlo assessment was carried out to evaluate the performance of the algorithm by using the input/output signal-to-noise ratio （SNR）. Five versions of SVD algorithms, namely 1 ） using all singular values, 2） using the top 80% singular values, 3） using the top 50% singular values, 4） using the top 20% singular values and 5） using singular values s such that S2≥/max（s2）/rinsNR were tested. The experimental results indicate that when the singular value threshold is set as Smax/（rinSNR）1/2, the super-resolution algorithm provides a good compromise between too much noise and too much bias and has good reconstruction results.