Image super‐resolution via dynamic network

Convolutional neural networks depend on deep network architectures to extract accurate information for image super‐resolution.However,obtained information of these con-volutional neural networks cannot completely express predicted high‐quality images for complex scenes.A dynamic network for image super‐resolution(DSRNet)is presented,which contains a residual enhancement block,wide enhancement block,feature refine-ment block and construction block.The residual enhancement block is composed of a residual enhanced architecture to facilitate hierarchical features for image super‐resolution.To enhance robustness of obtained super‐resolution model for complex scenes,a wide enhancement block achieves a dynamic architecture to learn more robust information to enhance applicability of an obtained super‐resolution model for varying scenes.To prevent interference of components in a wide enhancement block,a refine-ment block utilises a stacked architecture to accurately learn obtained features.Also,a residual learning operation is embedded in the refinement block to prevent long‐term dependency problem.Finally,a construction block is responsible for reconstructing high‐quality images.Designed heterogeneous architecture can not only facilitate richer structural information,but also be lightweight,which is suitable for mobile digital devices.Experimental results show that our method is more competitive in terms of performance,recovering time of image super‐resolution and complexity.The code of DSRNet can be obtained at https://github.com/hellloxiaotian/DSRNet.

A Unified Model Fusing Region of Interest Detection and Super Resolution for Video Compression

High-resolution video transmission requires a substantial amount of bandwidth.In this paper,we present a novel video processing methodology that innovatively integrates region of interest(ROI)identification and super-resolution enhancement.Our method commences with the accurate detection of ROIs within video sequences,followed by the application of advanced super-resolution techniques to these areas,thereby preserving visual quality while economizing on data transmission.To validate and benchmark our approach,we have curated a new gaming dataset tailored to evaluate the effectiveness of ROI-based super-resolution in practical applications.The proposed model architecture leverages the transformer network framework,guided by a carefully designed multi-task loss function,which facilitates concurrent learning and execution of both ROI identification and resolution enhancement tasks.This unified deep learning model exhibits remarkable performance in achieving super-resolution on our custom dataset.The implications of this research extend to optimizing low-bitrate video streaming scenarios.By selectively enhancing the resolution of critical regions in videos,our solution enables high-quality video delivery under constrained bandwidth conditions.Empirical results demonstrate a 15%reduction in transmission bandwidth compared to traditional super-resolution based compression methods,without any perceivable decline in visual quality.This work thus contributes to the advancement of video compression and enhancement technologies,offering an effective strategy for improving digital media delivery efficiency and user experience,especially in bandwidth-limited environments.The innovative integration of ROI identification and super-resolution presents promising avenues for future research and development in adaptive and intelligent video communication systems.

Numerical Simulation of Super-Resolution Structured Illumination Microscopy (SIM) Using Heintzmann-Cremer Algorithm with Non-Continuous Spatial Frequency Support

We report a comprehensive numerical study of super resolution (SR) structured illumination microscopy (SIM) utilizing the classic Heintzmann-Cremer SIM process and algorithm. In particular, we investigated the impact of the diffraction limit of the underlying imaging system on the optimal SIM grating frequency that can be used to obtain the highest SR enhancement with non-continuous spatial frequency support. Besides confirming the previous theoretical and experimental work that SR-SIM can achieve an enhancement close to 3 times the diffraction limit with grating pattern illuminations, we also observe and report a series of more subtle effects of SR-SIM with non-continuous spatial frequency support. Our simulations show that when the SIM grating frequency exceeds twice that of the diffraction limit, the higher SIM grating frequency can help achieve a higher SR enhancement for the underlying imaging systems whose diffraction limit is low, though this enhancement is obtained at the cost of losing resolution at some lower resolution targets. Our simulations also show that, for underlying imaging systems with high diffraction limits, however, SR-SIM grating frequencies above twice the diffraction limits tend to bring no significant extra enhancement. Furthermore, we observed that there exists a limit grating frequency above which the SR enhancement effect is lost, and the reconstructed images essentially have the same resolution as the one obtained directly from the underlying imaging system without using the SIM process.

Application of Vacuum Photoelectric Detection Technology in Super-Resolution System

Due to the wave characteristics of light, diffraction occurs when the light passes through the optical system, so that the resolution of the ordinary far-field optical system is limited by the size of the Airy disk diameter. There are various factors that cause image quality degradation during system detection and imaging, such as optical system aberrations, atmospheric inter-ference, defocusing, system noise and so on. Super-resolution optical imaging technology is the most innovative breakthrough in the optical imaging and detection field in this century. It goes beyond the resolution limit of ordinary optical systems or detectors, and can get more details and information of the structure, providing unprecedented tools for various fields. Compared with ordinary optical systems, super-resolution systems have very high requirements on the signals to be detected, which cannot be met by ordinary detection techniques. Vacuum photoelectric detection and imaging technology is equipped with the characteristics of high sensitivity and fast response. It is widely used in super-resolution systems and has played a great role in super-resolution systems. In this paper, the principles and structure of the image-converter streak camera super-resolution system, scanning electron microscopy super-resolution system and laser scanning confocal super-resolution system will be sorted out separately, and the essential role of the vacuum photoelectric detection technology in the ultra-microscopic sys-tem will be analyzed.

Meta-Learning Multi-Scale Radiology Medical Image Super-Resolution

High-resolution medical images have important medical value,but are difficult to obtain directly.Limited by hardware equipment and patient’s physical condition,the resolution of directly acquired medical images is often not high.Therefore,many researchers have thought of using super-resolution algorithms for secondary processing to obtain high-resolution medical images.However,current super-resolution algorithms only work on a single scale,and multiple networks need to be trained when super-resolution images of different scales are needed.This definitely raises the cost of acquiring high-resolution medical images.Thus,we propose a multi-scale superresolution algorithm using meta-learning.The algorithm combines a metalearning approach with an enhanced depth of residual super-resolution network to design a meta-upscale module.The meta-upscale module utilizes the weight prediction property of meta-learning and is able to perform the super-resolution task of medical images at any scale.Meanwhile,we design a non-integer mapping relation for super-resolution,which allows the network to be trained under non-integer magnification requirements.Compared to the state-of-the-art single-image super-resolution algorithm on computed tomography images of the pelvic region.The meta-learning multiscale superresolution algorithm obtained a surpassing of about 2%at a smaller model volume.Testing on different parts proves the high generalizability of our algorithm.Multi-scale super-resolution algorithms using meta-learning can compensate for hardware device defects and reduce secondary harm to patients while obtaining high-resolution medical images.It can be of great use in imaging related fields.

Deep Learned Singular Residual Network for Super Resolution Reconstruction

Single image super resolution(SISR)techniques produce images of high resolution(HR)as output from input images of low resolution(LR).Motivated by the effectiveness of deep learning methods,we provide a framework based on deep learning to achieve super resolution(SR)by utilizing deep singular-residual neural network(DSRNN)in training phase.Residuals are obtained from the difference between HR and LR images to generate LR-residual example pairs.Singular value decomposition(SVD)is applied to each LR-residual image pair to decompose into subbands of low and high frequency components.Later,DSRNN is trained on these subbands through input and output channels by optimizing the weights and biases of the network.With fewer layers in DSRNN,the influence of exploding gradients is reduced.This speeds up the learning process and also improves accuracy by using skip connections.The trained DSRNN parameters yield residuals to recover the HR subbands in the testing phase.Experimental analysis shows that the proposed method results in superior performance to existingmethods in terms of subjective quality.Extensive testing results on popular benchmark datasets such as set5,set14,and urban100 for a scaling factor of 4 show the effectiveness of the proposed method across different qualitative evaluation metrics.

Super-resolution fluorescence polarization microscopy

Fluorescence polarization is related to the dipole orientation of chromophores,making fuores-cence polarization microscopy possible to_reveal structures and functions of tagged cellularorganelles and biological macromolecules.Several recent super resolution techniques have beenapplied to fluorescence polarization microscopy,achieving dipole measurement at nanoscale.In this review,we summarize both difraction limited and super resolution fluorescence polari-zation microscopy techniques,as well as their applications in biological imaging.

Arbitrary Scale Super Resolution Network for Satellite Imagery

Recently,satellite imagery has been widely applied in many areas.However,due to the limitations of hardware equipment and transmission bandwidth,the images received on the ground have low resolution and weak texture.In addition,since ground terminals have various resolutions and real-time playing requirements,it is essential to achieve arbitrary scale super-resolution(SR)of satellite images.In this paper,we propose an arbitrary scale SR network for satellite image reconstruction.First,we propose an arbitrary upscale module for satellite imagery that can map low-resolution satellite image features to arbitrary scale enlarged SR outputs.Second,we design an edge reinforcement module to enhance the highfrequency details in satellite images through a twobranch network.Finally,extensive upsample experiments on WHU-RS19 and NWPU-RESISC45 datasets and subsequent image segmentation experiments both show the superiority of our method over the counterparts.

Data Matching of Solar Images Super-Resolution Based on Deep Learning

The images captured by different observation station have different resolutions.The Helioseismic and Magnetic Imager(HMI:a part of the NASA Solar Dynamics Observatory SDO)has low-precision but wide coverage.And the Goode Solar Telescope(GST,formerly known as the New Solar Telescope)at Big Bear Solar Observatory(BBSO)solar images has high precision but small coverage.The super-resolution can make the captured images become clearer,so it is wildly used in solar image processing.The traditional super-resolution methods,such as interpolation,often use single image’s feature to improve the image’s quality.The methods based on deep learning-based super-resolution image reconstruction algorithms have better quality,but small-scale features often become ambiguous.To solve this problem,a transitional amplification network structure is proposed.The network can use the two types images relationship to make the images clear.By adding a transition image with almost no difference between the source image and the target image,the transitional amplification training procedure includes three parts:transition image acquisition,transition network training with source images and transition images,and amplification network training with transition images and target images.In addition,the traditional evaluation indicators based on structural similarity(SSIM)and peak signal-to-noise ratio(PSNR)calculate the difference in pixel values and perform poorly in cross-type image reconstruction.The method based on feature matching can effectively evaluate the similarity and clarity of features.The experimental results show that the quality index of the reconstructed image is consistent with the visual effect.

A Regularized Super Resolution Algorithm for Generalized Gaussian Noise

In this paper,an iterative regularized super resolution (SR) algorithm considering non-Gaussian noise is proposed.Based on the assumption of a generalized Gaussian distribution for the contaminating noise,an lp norm is adopted to measure the data fidelity term in the cost function.In the meantime,a regularization functional defined in terms of the desired high resolution (HR) image is employed,which allows for the simultaneous determination of its value and the partly reconstructed image at each iteration step.The convergence is thoroughly studied.Simulation results show the effectiveness of the proposed algorithm as well as its superiority to conventional SR methods.

A SUPER-RESOLUTION APPROACH TO SAR PROCESSING

Compared with other methods, the chirp scaling (CS) algorithm is a novel one for compensating the range migration without any interpolation in SAR imaging. However, its resolution ability can't exceed that of Fourier transformation. To realize the super-resolution ability in the azimuth direction a chirp scaling Burg (CSB) algorithm is proposed in this paper, which can still reserve the advantage of avoiding any interpolation in the process of the two-dimensional space-variant correlation in the CS algorithm.

Super Resolution Perception for Improving Data Completeness in Smart Grid State Estimation

The smart grid is an evolving critical infrastructure,which combines renewable energy and the most advanced information and communication technologies to provide more economic and secure power supply services.To cope with the intermittency of ever-increasing renewable energy and ensure the security of the smart grid,state estimation,which serves as a basic tool for understanding the true states of a smart grid,should be performed with high frequency.More complete system state data are needed to support high-frequency state estimation.The data completeness problem for smart grid state estimation is therefore studied in this paper.The problem of improving data completeness by recovering highfrequency data from low-frequency data is formulated as a super resolution perception(SRP)problem in this paper.A novel machine-learning-based SRP approach is thereafter proposed.The proposed method,namely the Super Resolution Perception Net for State Estimation(SRPNSE),consists of three steps:feature extraction,information completion,and data reconstruction.Case studies have demonstrated the effectiveness and value of the proposed SRPNSE approach in recovering high-frequency data from low-frequency data for the state estimation.

OBJECT-BASED SUPER RESOLUTION FOR INTELLIGENT VISUAL SURVEILLANCE VIDEO

Construction of high resolution images from low resolution sequences is often im- portant in surveillance applications. In this letter, an affine based multi-scale block-matching image registration algorithm is first proposed. The images to be registered are divided into overlapped blocks of different size according to its motions. The Least Square (LS) image reg- istration algorithm is extended to match the blocks. Then an object based Super Resolution (SR) scheme is designed, the Maximum A Priori (MAP) super resolution algorithm is extended to enhance the resolution of the interest objects. Experimental results show that the proposed multi-scale registration method provides more accurate registration between frames. Further more, the object based super resolution scheme shows an enhanced performance compared with the traditional MAP method.

Super Resolution Sensing Technique for Distributed Resource Monitoring on Edge Clouds

With the vigorous development of mobile networks,the number of devices at the network edge is growing rapidly and the massive amount of data generated by the devices brings a huge challenge of response latency and communication burden.Existing resource monitoring systems are widely deployed in cloud data centers,but it is difficult for traditional resource monitoring solutions to handle the massive data generated by thousands of edge devices.To address these challenges,we propose a super resolution sensing(SRS)method for distributed resource monitoring,which can be used to recover reliable and accurate high‑frequency data from low‑frequency sampled resource monitoring data.Experiments based on the proposed SRS model are also conducted and the experimental results show that it can effectively reduce the errors generated when recovering low‑frequency monitoring data to high‑frequency data,and verify the effectiveness and practical value of applying SRS method for resource monitoring on edge clouds.

Fast image super-resolution algorithm based on multi-resolution dictionary learning and sparse representation

Sparse representation has attracted extensive attention and performed well on image super-resolution（SR） in the last decade. However, many current image SR methods face the contradiction of detail recovery and artifact suppression. We propose a multi-resolution dictionary learning（MRDL） model to solve this contradiction, and give a fast single image SR method based on the MRDL model. To obtain the MRDL model, we first extract multi-scale patches by using our proposed adaptive patch partition method（APPM）. The APPM divides images into patches of different sizes according to their detail richness. Then, the multiresolution dictionary pairs, which contain structural primitives of various resolutions, can be trained from these multi-scale patches.Owing to the MRDL strategy, our SR algorithm not only recovers details well, with less jag and noise, but also significantly improves the computational efficiency. Experimental results validate that our algorithm performs better than other SR methods in evaluation metrics and visual perception.

Super-resolution Restoration of Remote-sensing Images

A novel image restoration scheme, which is super-resolution image restoration algorithm Poisson-maximum-afterword-probability based on Markvo constraint (MPMAP) combined with evaluating image detail parameter D, has been proposed. The advantage of super-resolution algorithm MPMAP incorporated with parameter D lies in the fact that super-resolution algorithm MPMAP model is discrete, which is in accordance with remote-sensing imaging model, and the algorithm MPMAP is proved applicable to linear and non-linear imaging models with a unique solution when noise is not severe. According to simulation experiments for practical images, super-resolution algorithm MPMAP can retain image details better than most of traditional restoration methods; at the same time, the proposed parameter D can help to identify real point spread function (PSF) value of degradation process. Processing result of practical remote-sensing images by MPMAP combined with parameter D are given, it illustrates that MPMAP restoration scheme combined PSF estimation has a better restoration result than that of Photoshop processing, based on the same original images. It is proved that the proposed scheme is helpful to offset the lack of resolution of the original remote-sensing images and has its extensive application foreground.

A Fast Super-Resolution Reconstruction from Image Sequence

Based on the mechanism of imagery, a novel method called the delaminating combining template method, used for the problem of super-resolution reconstruction from image sequence, is described in this paper. The combining template method contains two steps： a delaminating strategy and a combining template algorithm. The delaminating strategy divides the original problem into several sub-problems; each of them is only eonnected to one degrading factor. The combining template algorithm is suggested to resolve each sub-problem. In addition, to verify the valid of the method, a new index called oriental entropy is presented. The results from the theoretical analysis and experiments illustrate that this method to be promising and efficient.

The Fabrication of Microstructure Surface of Superhydrophobic Coating by Surface Gelation Technology

The microstructured surface of materials were fabricated by a two-step acid-base catalyzed sol-gel process. In fluorinated polymer with PTFE doping, the well-proportioned composite sols were prepared using sol-gel processing under the hydrochloric acid and deficiency of water conditions. After the substrate was coated by composite sols, and the gelation treatment on the surface of composite coating, the micrometer-scale and nanometer-scale hierarchical structures were formed in surface layer of material. XPS and TEM technologies were employed to identify that the gelation occurs just on the surface of composite coating. The morphology of coating surface was observed by SEM and AFM technologies. The microstructured surface of material can be fabricated using this inexpensive and easily controlled method on low surface energy resin materials, the super-hydrophobic coatings materials can be prepared.

Face Super-resolution Reconstruction and Recognition Using Non-local Similarity Dictionary Learning Based Algorithm

One of the challenges of face recognition in surveillance is the low resolution of face region. Therefore many superresolution (SR) face reconstruction methods are proposed to produce a high-resolution face image from one or a set of low-resolution face images. However, existing dictionary learning based algorithms are sensitive to noise and very time-consuming. In this paper, we define and prove the multi-scale linear combination consistency. In order to improve the performance of SR, we propose a novel SR face reconstruction method based on nonlocal similarity and multi-scale linear combination consistency (NLS-MLC). We further proposed a new recognition approach for very low resolution face images based on resolution scale invariant feature (RSIF). A series of experiments are conducted on two public face image databases to test feasibility of our proposed methods. Experimental results show that the proposed SR method is more robust and computationally effective in face hallucination, and the recognition accuracy of RSIF is higher than some state-of-art algorithms. © 2014 Chinese Association of Automation.

Is the Genie of Artificial Intelligence Technology Out of the Bottle and Control?(A Short Review)

In recent years,AI(artificial intelligence)has made considerable strides,transforming a number of industries and facets of daily life.However,as AI develops more,worries about its potential dangers and unforeseen repercussions have surfaced.This article investigates the claim that AI technology has broken free from human control and is now unstoppable.We look at how AI is developing right now,what it means for society,and what steps are being taken to reduce the risks that come with it.We seek to highlight the need for responsible development and implementation of this game-changing technology by examining the opportunities and challenges that AI presents.