Shear Let Transform Residual Learning Approach for Single-Image Super-Resolution

Super-resolution techniques are employed to enhance image resolution by reconstructing high-resolution images from one or more low-resolution inputs.Super-resolution is of paramount importance in the context of remote sensing,satellite,aerial,security and surveillance imaging.Super-resolution remote sensing imagery is essential for surveillance and security purposes,enabling authorities to monitor remote or sensitive areas with greater clarity.This study introduces a single-image super-resolution approach for remote sensing images,utilizing deep shearlet residual learning in the shearlet transform domain,and incorporating the Enhanced Deep Super-Resolution network(EDSR).Unlike conventional approaches that estimate residuals between high and low-resolution images,the proposed approach calculates the shearlet coefficients for the desired high-resolution image using the provided low-resolution image instead of estimating a residual image between the high-and low-resolution image.The shearlet transform is chosen for its excellent sparse approximation capabilities.Initially,remote sensing images are transformed into the shearlet domain,which divides the input image into low and high frequencies.The shearlet coefficients are fed into the EDSR network.The high-resolution image is subsequently reconstructed using the inverse shearlet transform.The incorporation of the EDSR network enhances training stability,leading to improved generated images.The experimental results from the Deep Shearlet Residual Learning approach demonstrate its superior performance in remote sensing image recovery,effectively restoring both global topology and local edge detail information,thereby enhancing image quality.Compared to other networks,our proposed approach outperforms the state-of-the-art in terms of image quality,achieving an average peak signal-to-noise ratio of 35 and a structural similarity index measure of approximately 0.9.

Faster split-based feedback network for image super-resolution

Although most of the existing image super-resolution(SR)methods have achieved superior performance,contrastive learning for high-level tasks has not been fully utilized in the existing image SR methods based on deep learning.This work focuses on two well-known strategies developed for lightweight and robust SR,i.e.,contrastive learning and feedback mechanism,and proposes an integrated solution called a split-based feedback network(SPFBN).The proposed SPFBN is based on a feedback mechanism to learn abstract representations and uses contrastive learning to explore high information in the representation space.Specifically,this work first uses hidden states and constraints in recurrent neural network(RNN)to implement a feedback mechanism.Then,use contrastive learning to perform representation learning to obtain high-level information by pushing the final image to the intermediate images and pulling the final SR image to the high-resolution image.Besides,a split-based feedback block(SPFB)is proposed to reduce model redundancy,which tolerates features with similar patterns but requires fewer parameters.Extensive experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-art methods.Moreover,this work extends the experiment to prove the effectiveness of this method and shows better overall reconstruction quality.

3D MERGE与3D SPACE STIR序列在腰椎间盘突出症检查中的应用比较

目的:对比三维多回波恢复梯度回波(3D MERGE)、三维可变反转角快速自旋回波(3D SPACE STIR)序列在腰椎间盘突出症(LDH)检查中的应用效果。方法:选择2020年1月~2022年11月收治的135例LDH患者,回顾性分析患者临床和磁共振成像(MRI)资料,所有患者均接受常规MRI扫描及3D MERGE、3D SPACE STIR序列扫描,对比3D MERGE、3D SPACE STIR序列测量神经根直径的一致性,评价两种序列的图像质量参数[信噪比(SNR)、对比噪声比(CNR)]、图像清晰度评分。结果:3D MERGE和3D SPACE STIR序列测量的L3~S1神经根直径比较差异无统计学意义(P>0.05),且两组序列测量的L3、L4、L5和S1直径均显示出较高相关性(r=0.957,0.986,0.975,0.972,P<0.05);3D MERGE序列的SNR及CNR均高于3D SPACE STIR序列,神经根显示分级、图像清晰度评分优于3D SPACE STIR序列,差异有统计学意义(P<0.05)。结论:3D MERGE、3D SPACE STIR序列在LDH神经根直径测量中具有极高一致性,3D MERGE序列较3D SPACE STIR序列能够更清晰显示神经跟的解剖形态,图像质量更好。

Contrastive Learning for Blind Super-Resolution via A Distortion-Specific Network

Previous deep learning-based super-resolution(SR)methods rely on the assumption that the degradation process is predefined(e.g.,bicubic downsampling).Thus,their performance would suffer from deterioration if the real degradation is not consistent with the assumption.To deal with real-world scenarios,existing blind SR methods are committed to estimating both the degradation and the super-resolved image with an extra loss or iterative scheme.However,degradation estimation that requires more computation would result in limited SR performance due to the accumulated estimation errors.In this paper,we propose a contrastive regularization built upon contrastive learning to exploit both the information of blurry images and clear images as negative and positive samples,respectively.Contrastive regularization ensures that the restored image is pulled closer to the clear image and pushed far away from the blurry image in the representation space.Furthermore,instead of estimating the degradation,we extract global statistical prior information to capture the character of the distortion.Considering the coupling between the degradation and the low-resolution image,we embed the global prior into the distortion-specific SR network to make our method adaptive to the changes of distortions.We term our distortion-specific network with contrastive regularization as CRDNet.The extensive experiments on synthetic and realworld scenes demonstrate that our lightweight CRDNet surpasses state-of-the-art blind super-resolution approaches.

Hyperspectral Image Super-Resolution Meets Deep Learning:A Survey and Perspective

Hyperspectral image super-resolution,which refers to reconstructing the high-resolution hyperspectral image from the input low-resolution observation,aims to improve the spatial resolution of the hyperspectral image,which is beneficial for subsequent applications.The development of deep learning has promoted significant progress in hyperspectral image super-resolution,and the powerful expression capabilities of deep neural networks make the predicted results more reliable.Recently,several latest deep learning technologies have made the hyperspectral image super-resolution method explode.However,a comprehensive review and analysis of the latest deep learning methods from the hyperspectral image super-resolution perspective is absent.To this end,in this survey,we first introduce the concept of hyperspectral image super-resolution and classify the methods from the perspectives with or without auxiliary information.Then,we review the learning-based methods in three categories,including single hyperspectral image super-resolution,panchromatic-based hyperspectral image super-resolution,and multispectral-based hyperspectral image super-resolution.Subsequently,we summarize the commonly used hyperspectral dataset,and the evaluations for some representative methods in three categories are performed qualitatively and quantitatively.Moreover,we briefly introduce several typical applications of hyperspectral image super-resolution,including ground object classification,urban change detection,and ecosystem monitoring.Finally,we provide the conclusion and challenges in existing learning-based methods,looking forward to potential future research directions.

Residual Feature Attentional Fusion Network for Lightweight Chest CT Image Super-Resolution

The diagnosis of COVID-19 requires chest computed tomography(CT).High-resolution CT images can provide more diagnostic information to help doctors better diagnose the disease,so it is of clinical importance to study super-resolution(SR)algorithms applied to CT images to improve the reso-lution of CT images.However,most of the existing SR algorithms are studied based on natural images,which are not suitable for medical images;and most of these algorithms improve the reconstruction quality by increasing the network depth,which is not suitable for machines with limited resources.To alleviate these issues,we propose a residual feature attentional fusion network for lightweight chest CT image super-resolution(RFAFN).Specifically,we design a contextual feature extraction block(CFEB)that can extract CT image features more efficiently and accurately than ordinary residual blocks.In addition,we propose a feature-weighted cascading strategy(FWCS)based on attentional feature fusion blocks(AFFB)to utilize the high-frequency detail information extracted by CFEB as much as possible via selectively fusing adjacent level feature information.Finally,we suggest a global hierarchical feature fusion strategy(GHFFS),which can utilize the hierarchical features more effectively than dense concatenation by progressively aggregating the feature information at various levels.Numerous experiments show that our method performs better than most of the state-of-the-art(SOTA)methods on the COVID-19 chest CT dataset.In detail,the peak signal-to-noise ratio(PSNR)is 0.11 dB and 0.47 dB higher on CTtest1 and CTtest2 at×3 SR compared to the suboptimal method,but the number of parameters and multi-adds are reduced by 22K and 0.43G,respectively.Our method can better recover chest CT image quality with fewer computational resources and effectively assist in COVID-19.

Improved spatiotemporal resolution of anti-scattering super-resolution label-free microscopy via synthetic wave 3D metalens imaging

Super-resolution(SR)microscopy has dramatically enhanced our understanding of biological processes.However,scattering media in thick specimens severely limits the spatial resolution,often rendering the images unclear or indistinguishable.Additionally,live-cell imaging faces challenges in achieving high temporal resolution for fast-moving subcellular structures.Here,we present the principles of a synthetic wave microscopy(SWM)to extract three-dimensional information from thick unlabeled specimens,where photobleaching and phototoxicity are avoided.SWM exploits multiple-wave interferometry to reveal the specimen’s phase information in the area of interest,which is not affected by the scattering media in the optical path.SWM achieves~0.42λ/NA resolution at an imaging speed of up to 106 pixels/s.SWM proves better temporal resolution and sensitivity than the most conventional microscopes currently available while maintaining exceptional SR and anti-scattering capabilities.Penetrating through the scattering media is challenging for conventional imaging techniques.Remarkably,SWM retains its efficacy even in conditions of low signal-to-noise ratios.It facilitates the visualization of dynamic subcellular structures in live cells,encompassing tubular endoplasmic reticulum(ER),lipid droplets,mitochondria,and lysosomes.

基于Cite Space可视化分析我国多发伤急救研究热点及趋势

目的梳理国内多发伤急救相关研究文献,分析研究现状、热点和趋势,为我国多发伤急救研究提供借鉴和指导。方法检索中国知网数据库中2011—2021年关于多发伤急救的相关文献,使用Cite Space 6.1.R3可视化软件对该领域的年发文量、机构、作者、关键词进行分析。结果最终纳入多发伤急救研究文献2519篇,整体发文数量较平稳,以2016年为小高峰;发文量最高的机构是华中科技大学附属同济医院。多发伤急救研究热点包括院前急救、并发症护理、风险因素分析和预后效果评估,研究前沿包括不同多发伤人群的诊断、治疗、手术和护理体会等方面。结论本文通过可视化分析国内多发伤急救研究的热点及趋势,指明了多发伤目前研究存在的问题和未来研究发展的方向,为进一步完善多发伤急救卫生服务和管理体系提供指导。

SOFFLFM:Super-resolution optical fluctuation Fourierlight-field microscopy

Fourier light-field microscopy(FLFM)uses a microlens aray(MLA)to segment the Fourierplane of the microscopic objective lens to generate multiple two-dimensional perspective views,thereby reconstructing the threedimensional(3D)structure of the sample using 3D deconvo-lution calculation without scanning.However,the resolution of FLFM is stil limited by dif-fraction,and furthermore,it is dependent on the aperture division.In order to improve itsresolution,a super-resolution opticai fuctuation Fourier light-field microscopy(SOFFLFM)wasproposed here,in which the super-resolution optical fluctuation imaging(SOFI)with the abilityof super-resolution was introduced into FLFM.SOFFLFM uses higher-order cumulants statis-tical analysis on an image sequence collected by FLFM,and then carries out 3D deconvolutioncalculation to reconstruct the 3D structure of the sample.The theoretical basis of SOFFLFM onimproving resolution was explained and then verified with the simulations.Simulation resultsdemonstrated that SOFFLFM improved the lateral and axial resolution by more than V2 and 2times in the second-and fourth-order accumulations,compared with that of FLFM.

Super-resolution parameter estimation of monopulse radar by wide-narrowband joint processing

The angular resolution of radar is of crucial signifi-cance to its tracking performance.In this paper,a super-resolu-tion parameter estimation algorithm based on wide-narrowband joint processing is proposed to improve the angular resolution of wideband monopulse radar.The range cells containing resolv-able scattering points are detected in the wideband mode,and these range cells are adopted to estimate part of the target parameters by algorithms of low computational requirement.Then,the likelihood function of the echo is constructed in the narrow-band mode to estimate the rest of the parameters,and the parameters estimated in the wideband mode are employed to reduce computation and enhance estimation accuracy.Simu-lation results demonstrate that the proposed algorithm has higher estimation accuracy and lower computational complexity than the current algorithm and can avoid the risk of model mis-match.

基于CiteSpace的我国高校公共空间研究热点及趋势分析

文章基于CiteSpace软件对CNKI数据库中相关609篇文献进行可视化分析,发现当前我国关于高校公共空间的研究具有阶段性、各地域间相互独立的特点;研究热点分布于空间扩充、功能拓展、设计优化多个角度,并朝着精细化、人性化、多学科交叉等趋势探索。总结现有研究提出加强地域间机构合作、融合多学科研究视角、引入创新性研究方法等发展方向,以期为新时代我国高校公共空间的研究提供思路和参考。

Accelerate Single Image Super-Resolution Using Object Detection Process

Image Super-Resolution(SR)research has achieved great success with powerful neural networks.The deeper networks with more parameters improve the restoration quality but add the computation complexity,which means more inference time would be cost,hindering image SR from practical usage.Noting the spatial distribution of the objects or things in images,a twostage local objects SR system is proposed,which consists of two modules,the object detection module and the SR module.Firstly,You Only Look Once(YOLO),which is efficient in generic object detection tasks,is selected to detect the input images for obtaining objects of interest,then put them into the SR module and output corresponding High-Resolution(HR)subimages.The computational power consumption of image SR is optimized by reducing the resolution of input images.In addition,we establish a dataset,TrafficSign500,for our experiment.Finally,the performance of the proposed system is evaluated under several State-Of-The-Art(SOTA)YOLOv5 and SISR models.Results show that our system can achieve a tremendous computation improvement in image SR.

基于CiteSpace知识图谱的智慧养老领域研究文献综述

“十四五”规划将发展智慧养老产业上升为国家战略高度。文章借助Cite Space和Vosviewer绘图软件对2012-2022年国内外智慧养老领域研究的发文量、突现词等进行可视化分析。发现国内外研究都经历了三个发展阶段,国外研究起步早,研究成果丰富;国内研究虽然起步较晚,但进展快速。总结出“智慧养老内涵”“智慧养老模式”“智慧养老产业”“智慧养老平台”“智慧养老产品”“智慧养老用户”六大国内外都重点关注的研究议题,发现技术赋能智慧养老发展是近年来国内外共同关注的研究热点,大数据、物联网、养老金融、数字技术、区块链等成为围绕智慧养老文献的关键词。

3D-CNNHSR: A 3-Dimensional Convolutional Neural Network for Hyperspectral Super-Resolution

Hyperspectral images can easily discriminate different materials due to their fine spectral resolution.However,obtaining a hyperspectral image(HSI)with a high spatial resolution is still a challenge as we are limited by the high computing requirements.The spatial resolution of HSI can be enhanced by utilizing Deep Learning(DL)based Super-resolution(SR).A 3D-CNNHSR model is developed in the present investigation for 3D spatial super-resolution for HSI,without losing the spectral content.The 3DCNNHSR model was tested for the Hyperion HSI.The pre-processing of the HSI was done before applying the SR model so that the full advantage of hyperspectral data can be utilized with minimizing the errors.The key innovation of the present investigation is that it used 3D convolution as it simultaneously applies convolution in both the spatial and spectral dimensions and captures spatial-spectral features.By clustering contiguous spectral content together,a cube is formed and by convolving the cube with the 3D kernel a 3D convolution is realized.The 3D-CNNHSR model was compared with a 2D-CNN model,additionally,the assessment was based on higherresolution data from the Sentinel-2 satellite.Based on the evaluation metrics it was observed that the 3D-CNNHSR model yields better results for the SR of HSI with efficient computational speed,which is significantly less than previous studies.

体育教师信念的国际研究现状与趋势——基于CiteSpace的文献计量分析

高质量教师是高质量教育发展的中坚力量。教师信念作为教师专业素养构成的关键要素,对促进教师专业发展、提升教师质量具有重要作用与影响。为借鉴国际体育教师信念研究的成果与经验,促进国内对体育教师信念的研究,研究利用CiteSpace软件,对Web of Science核心合集数据库中1960—2022年的英文文献进行可视化研究。发现:体育教师信念研究高潮出现于2021年,载文数量最多的期刊是Journal of Teaching in Physical Education;研究中心度最高的国家是美国,核心圈层的代表学者是Richards KAR、Kulinna PH和Curtner-smith MD等人;研究热点趋势集中于体力活动促进、职业社会化、批判性教学法、职前体育教师、专业发展等方面。启示:国内未来研究应重点关注体育教师信念对课程改革的影响以及促进职前、职后阶段体育教师信念的发展。

Using GAN Neural Networks for Super-Resolution Reconstruction of Temperature Fields

A Generative Adversarial Neural(GAN)network is designed based on deep learning for the Super-Resolution(SR)reconstruction task of temperaturefields(comparable to downscaling in the meteorologicalfield),which is limited by the small number of ground stations and the sparse distribution of observations,resulting in a lack offineness of data.To improve the network’s generalization performance,the residual structure,and batch normalization are used.Applying the nearest interpolation method to avoid over-smoothing of the climate element values instead of the conventional Bicubic interpolation in the computer visionfield.Sub-pixel convolution is used instead of transposed convolution or interpolation methods for up-sampling to speed up network inference.The experimental dataset is the European Centre for Medium-Range Weather Forecasts Reanalysis v5(ERA5)with a bidirectional resolution of 0:1°×0:1°.On the other hand,the task aims to scale up the size by a factor of 8,which is rare compared to conventional methods.The comparison methods include traditional interpolation methods and a more widely used GAN-based network such as the SRGAN.Thefinal experimental results show that the proposed scheme advances the performance of Root Mean Square Error(RMSE)by 37.25%,the Peak Signal-to-noise Ratio(PNSR)by 14.4%,and the Structural Similarity(SSIM)by 10.3%compared to the Bicubic Interpolation.For the traditional SRGAN network,a relatively obvious performance improvement is observed by experimental demonstration.Meanwhile,the GAN network can converge stably and reach the approximate Nash equilibrium for various initialization parameters to empirically illustrate the effectiveness of the method in the temperature fields.

A Hybrid Regularization-Based Multi-Frame Super-Resolution Using Bayesian Framework

The prime purpose for the image reconstruction of a multi-frame super-resolution is to reconstruct a higher-resolution image through incorporating the knowledge obtained from a series of relevant low-resolution images,which is useful in numerousfields.Nevertheless,super-resolution image reconstruction methods are usually damaged by undesirable restorative artifacts,which include blurring distortion,noises,and stair-casing effects.Consequently,it is always challenging to achieve balancing between image smoothness and preservation of the edges inside the image.In this research work,we seek to increase the effectiveness of multi-frame super-resolution image reconstruction by increasing the visual information and improving the automated machine perception,which improves human analysis and interpretation processes.Accordingly,we propose a new approach to the image reconstruction of multi-frame super-resolution,so that it is created through the use of the regularization framework.In the proposed approach,the bilateral edge preserving and bilateral total variation regularizations are employed to approximate a high-resolution image generated from a sequence of corresponding images with low-resolution to protect significant features of an image,including sharp image edges and texture details while preventing artifacts.The experimental results of the synthesized image demonstrate that the new proposed approach has improved efficacy both visually and numerically more than other approaches.

Super-Resolution Based on Curvelet Transform and Sparse Representation

Super-resolution techniques are used to reconstruct an image with a high resolution from one or more low-resolution image(s).In this paper,we proposed a single image super-resolution algorithm.It uses the nonlocal mean filter as a prior step to produce a denoised image.The proposed algorithm is based on curvelet transform.It converts the denoised image into low and high frequencies(sub-bands).Then we applied a multi-dimensional interpolation called Lancozos interpolation over both sub-bands.In parallel,we applied sparse representation with over complete dictionary for the denoised image.The proposed algorithm then combines the dictionary learning in the sparse representation and the interpolated sub-bands using inverse curvelet transform to have an image with a higher resolution.The experimental results of the proposed super-resolution algorithm show superior performance and obviously better-recovering images with enhanced edges.The comparison study shows that the proposed super-resolution algorithm outperforms the state-of-the-art.The mean absolute error is 0.021±0.008 and the structural similarity index measure is 0.89±0.08.

Deep-learning-based methods for super-resolution fluorescence microscopy

The algorithm used for reconstruction or resolution enhancement is one of the factors affectingthe quality of super-resolution images obtained by fluorescence microscopy.Deep-learning-basedalgorithms have achieved stateof-the-art performance in super-resolution fluorescence micros-copy and are becoming increasingly attractive.We firstly introduce commonly-used deep learningmodels,and then review the latest applications in terms of the net work architectures,the trainingdata and the loss functions.Additionally,we discuss the challenges and limits when using deeplearning to analyze the fluorescence microscopic data,and suggest ways to improve the reliability and robustness of deep learning applications.

IRMIRS:Inception-ResNet-Based Network for MRI Image Super-Resolution

Medical image super-resolution is a fundamental challenge due to absorption and scattering in tissues.These challenges are increasing the interest in the quality of medical images.Recent research has proven that the rapid progress in convolutional neural networks(CNNs)has achieved superior performance in the area of medical image super-resolution.However,the traditional CNN approaches use interpolation techniques as a preprocessing stage to enlarge low-resolution magnetic resonance(MR)images,adding extra noise in the models and more memory consumption.Furthermore,conventional deep CNN approaches used layers in series-wise connection to create the deeper mode,because this later end layer cannot receive complete information and work as a dead layer.In this paper,we propose Inception-ResNet-based Network for MRI Image Super-Resolution known as IRMRIS.In our proposed approach,a bicubic interpolation is replaced with a deconvolution layer to learn the upsampling filters.Furthermore,a residual skip connection with the Inception block is used to reconstruct a high-resolution output image from a low-quality input image.Quantitative and qualitative evaluations of the proposed method are supported through extensive experiments in reconstructing sharper and clean texture details as compared to the state-of-the-art methods.