Image super‐resolution via dynamic network

Convolutional neural networks depend on deep network architectures to extract accurate information for image super‐resolution.However,obtained information of these con-volutional neural networks cannot completely express predicted high‐quality images for complex scenes.A dynamic network for image super‐resolution(DSRNet)is presented,which contains a residual enhancement block,wide enhancement block,feature refine-ment block and construction block.The residual enhancement block is composed of a residual enhanced architecture to facilitate hierarchical features for image super‐resolution.To enhance robustness of obtained super‐resolution model for complex scenes,a wide enhancement block achieves a dynamic architecture to learn more robust information to enhance applicability of an obtained super‐resolution model for varying scenes.To prevent interference of components in a wide enhancement block,a refine-ment block utilises a stacked architecture to accurately learn obtained features.Also,a residual learning operation is embedded in the refinement block to prevent long‐term dependency problem.Finally,a construction block is responsible for reconstructing high‐quality images.Designed heterogeneous architecture can not only facilitate richer structural information,but also be lightweight,which is suitable for mobile digital devices.Experimental results show that our method is more competitive in terms of performance,recovering time of image super‐resolution and complexity.The code of DSRNet can be obtained at https://github.com/hellloxiaotian/DSRNet.

RGB-guided hyperspectral image super-resolution with deep progressive learning

Due to hardware limitations,existing hyperspectral(HS)camera often suffer from low spatial/temporal resolution.Recently,it has been prevalent to super-resolve a low reso-lution(LR)HS image into a high resolution(HR)HS image with a HR RGB(or mul-tispectral)image guidance.Previous approaches for this guided super-resolution task often model the intrinsic characteristic of the desired HR HS image using hand-crafted priors.Recently,researchers pay more attention to deep learning methods with direct supervised or unsupervised learning,which exploit deep prior only from training dataset or testing data.In this article,an efficient convolutional neural network-based method is presented to progressively super-resolve HS image with RGB image guidance.Specif-ically,a progressive HS image super-resolution network is proposed,which progressively super-resolve the LR HS image with pixel shuffled HR RGB image guidance.Then,the super-resolution network is progressively trained with supervised pre-training and un-supervised adaption,where supervised pre-training learns the general prior on training data and unsupervised adaptation generalises the general prior to specific prior for variant testing scenes.The proposed method can effectively exploit prior from training dataset and testing HS and RGB images with spectral-spatial constraint.It has a good general-isation capability,especially for blind HS image super-resolution.Comprehensive experimental results show that the proposed deep progressive learning method out-performs the existing state-of-the-art methods for HS image super-resolution in non-blind and blind cases.

Three-dimensional time-of-flight magnetic resonance angiography combined with high resolution T2-weighted imaging in preoperative evaluation of microvascular decompression

BACKGROUND Neurovascular compression(NVC) is the main cause of primary trigeminal neuralgia(TN) and hemifacial spasm(HFS). Microvascular decompression(MVD) is an effective surgical method for the treatment of TN and HFS caused by NVC. The judgement of NVC is a critical step in the preoperative evaluation of MVD, which is related to the effect of MVD treatment. Magnetic resonance imaging(MRI) technology has been used to detect NVC prior to MVD for several years. Among many MRI sequences, three-dimensional time-of-flight magnetic resonance angiography(3D TOF MRA) is the most widely used. However, 3D TOF MRA has some shortcomings in detecting NVC. Therefore, 3D TOF MRA combined with high resolution T2-weighted imaging(HR T2WI) is considered to be a more effective method to detect NVC.AIM To determine the value of 3D TOF MRA combined with HR T2WI in the judgment of NVC, and thus to assess its value in the preoperative evaluation of MVD.METHODS Related studies published from inception to September 2022 based on PubMed, Embase, Web of Science, and the Cochrane Library were retrieved. Studies that investigated 3D TOF MRA combined with HR T2WI to judge NVC in patients with TN or HFS were included according to the inclusion criteria. Studies without complete data or not relevant to the research topics were excluded. The Quality Assessment of Diagnostic Accuracy Studies checklist was used to assess the quality of included studies. The publication bias of the included literature was examined by Deeks’ test. An exact binomial rendition of the bivariate mixed-effects regression model was used to synthesize data. Data analysis was performed using the MIDAS module of statistical software Stata 16.0. Two independent investigators extracted patient and study characteristics, and discrepancies were resolved by consensus. Individual and pooled sensitivities and specificities were calculated. The I_(2) statistic and Q test were used to test heterogeneity. The study was registered on the website of PROSERO(registration No. CRD42022357158).RESULTS Our search identified 595 articles, of which 12(including 855 patients) fulfilled the inclusion criteria. Bivariate analysis showed that the pooled sensitivity and specificity of 3D TOF MRA combined with HR T2WI for detecting NVC were 0.96 [95% confidence interval(CI): 0.92-0.98] and 0.92(95%CI: 0.74-0.98), respectively. The pooled positive likelihood ratio was 12.4(95%CI: 3.2-47.8), pooled negative likelihood ratio was 0.04(95%CI: 0.02-0.09), and pooled diagnostic odds ratio was 283(95%CI: 50-1620). The area under the receiver operating characteristic curve was 0.98(95%CI: 0.97-0.99). The studies showed no substantial heterogeneity(I2 = 0, Q = 0.001 P = 0.50).CONCLUSION Our results suggest that 3D TOF MRA combined with HR T2WI has excellent sensitivity and specificity for judging NVC in patients with TN or HFS. This method can be used as an effective tool for preoperative evaluation of MVD.

Correg-Yolov3:a Method for Dense Buildings Detection in High-resolution Remote Sensing Images

The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resolution remote sensing images,we present an effective YOLOv3 framework,corner regression-based YOLOv3(Correg-YOLOv3),to localize dense building accurately.This improved YOLOv3 algorithm establishes a vertex regression mechanism and an additional loss item about building vertex offsets relative to the center point of bounding box.By extending output dimensions,the trained model is able to output the rectangular bounding boxes and the building vertices meanwhile.Finally,we evaluate the performance of the Correg-YOLOv3 on our self-produced data set and provide a comparative analysis qualitatively and quantitatively.The experimental results achieve high performance in precision(96.45%),recall rate(95.75%),F1 score(96.10%)and average precision(98.05%),which were 2.73%,5.4%,4.1%and 4.73%higher than that of YOLOv3.Therefore,our proposed algorithm effectively tackles the problem of dense building detection in high resolution images.

Multiframe Blind Super Resolution Imaging Based on Blind Deconvolution

As an ill-posed problem, multiframe blind super resolution imaging recovers a high resolution image from a group of low resolution images with some degradations when the information of blur kernel is limited. Note that the quality of the recovered image is influenced more by the accuracy of blur estimation than an advanced regularization. We study the traditional model of the multiframe super resolution and modify it for blind deblurring. Based on the analysis, we proposed two algorithms. The first one is based on the total variation blind deconvolution algorithm and formulated as a functional for optimization with the regularization of blur. Based on the alternating minimization and the gradient descent algorithm, the high resolution image and the unknown blur kernel are estimated iteratively. By using the median shift and add operator, the second algorithm is more robust to the outlier influence. The MSAA initialization simplifies the interpolation process to reconstruct the blurred high resolution image for blind deblurring and improves the accuracy of blind super resolution imaging. The experimental results demonstrate the superiority and accuracy of our novel algorithms.

Influences of Atmospheric Turbulence on Image Resolution of Airborne and Space-Borne Optical Remote Sensing System

A new way is proposed to evaluate the influence of atmospheric turbulence on image resolution of airborne and space-borne optical remote sensing system, which is called as arrival angle-method. Applying this method, some engineering examples are selected to analyze the turbulence influences on image resolution based on three different atmospheric turbulence models quantificationally, for the airborne remote sensing system, the resolution errors caused by the atmospheric turbulence are less than 1 cm, and for the space-borne remote sensing system, the errors are around 1 cm. The results are similar to that obtained by the previous Friedmethod. Compared with the Fried-method, the arrival angle-method is rather simple and can be easily used in engineering fields.

Automatic Road Extraction Using Particle Filters from High Resolution Images

Road extraction plays an important role in many applications such as car navigation, but the manual extraction of roads is a laborious, tedious task. To speed the extraction of roads, an approach based on particle filtering to extract automatically roads from high resolution imagery is proposed. Particle filtering provides a statistical framework for propagating sample-based approximations of posterior distributions and has almost no restriction on the ingredients of the model. We integrate the similarity of grey value and the edge point distribution of roads into particle filtering to deal with complex scenes. To handle road appearance changes the tracking algorithm is allowed to update the road model during temporally stable image observations. A fully automatic initialization strategy is used. Experimental results show that the proposed approach is a promising and fully automatic method for extracting roads from images, even in the presence of occlusions.

HIGH RESOLUTION STUDY OF TWINS IN Al_(20)Cu_2Mn_3 PHASE

The dispersoid phase Al_(20)Cu_2Mn_3 in a 2024 Al alloy is commonly composed of twins,An ob- servation of corresponding high resolution image shows that the twin boundary plane is a glide plane other than mirror one.Two neighbouring components of twins are not symmetry of re- flection or rotation,but of glide reflection.The“diamond”glide plane is(101)and the glide vector is(1/4)(-).Components of twins in the phase take shape of prism with the longitudinal edge being parallel to[010]and side faces being{101}and{100}.

Inverse synthetic aperture radar imaging based on sparse signal processing

Based on the measurement model of inverse synthetic aperture radar (ISAR) within a small aspect sector,an imaging method was presented with the application of sparse signal processing.This method can form higher resolution inverse synthetic aperture radar images from compensating incomplete measured data,and improves the clarity of the images and makes the feature structure much more clear,which is helpful for target recognition.The simulation results indicate that this method can provide clear ISAR images with high contrast under complex motion case.

Integrating cross-sensor high spatial resolution satellite images to detect subtle forest vegetation change in the Purple Mountains,a national scenic spot in Nanjing,China

Accurate information on the location and magnitude of vegetation change in scenic areas can guide the configuration of tourism facilities and the formulation of vegetation protection measures.High spatial resolution remote sensing images can be used to detect subtle vegetation changes.The major objective of this study was to map and quantify forest vegetation changes in a national scenic location,the Purple Mountains of Nanjing,China,using multi-temporal cross-sensor high spatial resolution satellite images to identify the main drivers of the vegetation changes and provide a reference for sustainable management.We used Quickbird images acquired in 2004,IKONOS images acquired in 2009,and WorldView2 images acquired in 2015.Four pixel-based direct change detection methods including the normalized difference vegetation index difference method,multi-index integrated change analysis(MIICA),principal component analysis,and spectral gradient difference analysis were compared in terms of their change detection performances.Subsequently,the best pixel-based detection method in conjunction with object-oriented image analysis was used to extract subtle forest vegetation changes.An accuracy assessment using the stratified random sampling points was conducted to evaluate the performance of the change detection results.The results showed that the MIICA method was the best pixel-based change detection method.And the object-oriented MIICA with an overall accuracy of 0.907 and a kappa coefficient of 0.846 was superior to the pixel-based MIICA.From 2004 to 2009,areas of vegetation gain mainly occurred around the periphery of the study area,while areas of vegetation loss were observed in the interior and along the boundary of the study area due to construction activities,which contributed to 79%of the total area of vegetation loss.During 2009–2015,the greening initiatives around the construction areas increased the forest vegetation coverage,accounting for 84%of the total area of vegetation gain.In spite of this,vegetation loss occurred in the interior of the Purple Mountains due to infrastructure development that caused conversion from vegetation to impervious areas.We recommend that:(1)a local multi-agency team inspect and assess law enforcement regarding natural resource utilization;and(2)strengthen environmental awareness education.

Monitoring of Karst Rocky Desertification Control Projects Based on Remote Sensing Images with Medium and High Spatial Resolution——A Case Study of Disi River Basin in Puan County

[ Objective] The study aimed to improve methods of monitoring Karst Rocky Desertification （KRD） control projects and increase the working efficiency. [Method] Based on remote sensing images with medium and high spatial resolution, KRD control projects in Disi River basin in Puan County were monitored, that is, information of the project construction in the study area was extracted using supervised classification and hu- man-computer interactive interpretation, and the monitoring results were testified with the aid of GPS. [Result] It was feasible to monitor KRD con- trol projects in Disi River basin based on remote sensing images with medium and high resolution, and the monitoring accuracy was satisfactory, reaching above 80% or 90%, so the method is worthy of popularizing. [ Conclusion] Remote sensing images with medium and high resolution can be used to monitor other KRD control Droiects.

A Novel AlphaSRGAN for Underwater Image Super Resolution

Obtaining clear images of underwater scenes with descriptive details is an arduous task.Conventional imaging techniques fail to provide clear cut features and attributes that ultimately result in object recognition errors.Consequently,a need for a system that produces clear images for underwater image study has been necessitated.To overcome problems in resolution and to make better use of the Super-Resolution(SR)method,this paper introduces a novel method that has been derived from the Alpha Generative Adversarial Network(AlphaGAN)model,named Alpha Super Resolution Generative Adversarial Network(AlphaSRGAN).The model put forth in this paper helps in enhancing the quality of underwater imagery and yields images with greater resolution and more concise details.Images undergo pre-processing before they are fed into a generator network that optimizes and reforms the structure of the network while enhancing the stability of the network that acts as the generator.After the images are processed by the generator network,they are passed through an adversarial method for training models.The dataset used in this paper to learn Single Image Super Resolution(SISR)is the USR 248 dataset.Training supervision is performed by an unprejudiced function that simultaneously scrutinizes and improves the image quality.Appraisal of images is done with reference to factors like local style information,global content and color.The dataset USR 248 which has a huge collection of images has been used for the study is composed of three collections of images—high(640×480)and low(80×60,160×120,and 320×240).Paired instances of different sizes—2×,4×and 8×—are also present in the dataset.Parameters like Mean Opinion Score(MOS),Peak Signal-to-Noise Ratio(PSNR),Structural Similarity(SSIM)and Underwater Image Quality Measure(UIQM)scores have been compared to validate the improved efficiency of our model when compared to existing works.

A WAVELET TRANSFORM BASED POCS SUPERRESOLUTION ALGORITHM

Research interest in multi-frame Superresolution has risen substantially in recent years. This paper presents a modified Projection Onto Convex Set （POCS） superresolution method based on wavelet transform. The method analyzes the image formation model from wavelet multiresolution analysis point of view and defines an closed convex set and its corresponding projection based on wavelet transform. An iterative procedure is utilized to reduce the estimated errors of the result image, and this guarantees the estimated image to lay in the intersection of different convex sets, thus produces a high resolution image with a reduced error. The effectiveness of the algorithm is demonstrated bv experimental results.

Image enhancement and post-processing for low resolution compressed video

This research paper recommends the point spread function(PSF)forecasting technique based on the projection onto convex set(POCS)and regularization to acquire low resolution images.As the environment for the production of user created contents(UCC)videos(one of the contents on the Internet)becomes widespread,resolution reduction and image distortion occurs,failing to satisfy users who desire high quality images.Accordingly,this research neutralizes the coding artifact through POCS and regularization processes by:1)factoring the local characteristics of the image when it comes to the noise that results during the discrete cosine transform(DCT)and quantization process;and 2)removing the blocking and ring phenomena which are problems with the existing video compression.Moreover,this research forecasts the point spread function to obtain low resolution images using the above-mentioned methods.Thus,a method is suggested for minimizing the errors found among the forecasting interpolation pixels.Low-resolution image quality obtained through the experiment demonstrates that significant enhancement was made on the visual level compared to the original image.

A novel high resolution image denoising algorithm based on Calman filter and texture feature extraction

Calman filtering method based on wavelet transform has been successfully applied to signal denoising. According to the different application methods and the realization forms of Calman filter, combined with the structural analysis of wavelet decomposition, we present kinds of multi-scale filtering methods into the category of the three. The simulation results show that the multi-scale Calman filtering method based on system layer has better performance. Synthetic aperture radar （SAR） images have rich texture information, which can reflect the spatial structure of objects. The texture feature is widely used in SAR image classification and SAR image segmentation. Affected by imaging factors, the direct use of texture features extracted from SAR images is not good enough. In order to avoid the traditional method of filtering followed the texture feature extraction caused by the loss of texture and edge information, this paper presents a texture feature extraction of SAR image, then using Robust PCA method, finally using texture feature clustering method K-means test after treatment with RPCA expression.

A Two-Stage Algorithm of High Resolution Image Alignment for Mobile Applications

Global motion estimation (GME) algorithms are widely applied to computer vision and video processing. In the previous works, the image resolutions are usually low for the real-time requirement (e.g. video stabilization). However, in some mobile devices applications (e.g. image sequence panoramic stitching), the high resolution is necessary to obtain satisfactory quality of panoramic image. However, the computational cost will become too expensive to be suitable for the low power consumption requirement of mobile device. The full search algorithm can obtain the global minimum with extremely computational cost, while the typical fast algorithms may suffer from the local minimum problem. This paper proposed a fast algorithm to deal with 2560 × 1920 high-resolution (HR) image sequences. The proposed method estimates the motion vector by a two-level coarse-to-fine scheme which only exploits sparse reference blocks (25 blocks in this paper) in each level to determine the global motion vector, thus the computational costs are significantly decreased. In order to increase the effective search range and robustness, the predictive motion vector (PMV) technique is used in this work. By the comparisons of computational complexity, the proposed algorithm costs less addition operations than the typical Three-Step Search algorithm (TSS) for estimating the global motion of the HR images without the local minimum problem. The quantitative evaluations show that our method is comparable to the full search algorithm (FSA) which is considered to be the golden baseline.

Distribution patterns of fire regime in the Pendjari Biosphere Reserve, West Africa

Pendjari Biosphere Reserve(PBR),a primary component of the W-Arly-Pendjari transboundary biosphere reserve,represents the largest intact wild ecosystem and pristine biodiversity spot in West Africa.This savannah ecosystem has long been affected by fire,which is the main ecological driver for the annual rhythm of life in the reserve.Understanding the fire distribution patterns will help to improve its management plan in the region.This study explores the fire regime in the PRB during 2001–2021 in terms of burned area,seasonality,fire frequency,and mean fire return interval(MFRI)by analysing moderate resolution imaging spectroradiometer(MODIS)burned area product.Results indicated that the fire season in the PBR extends from October to May with a peak in early dry season(November–December).The last two fire seasons(2019–2020 and 2020–2021)recorded the highest areas burned in the PBR out of the twenty fire seasons studied.During the twenty years period,8.2%of the reserve burned every 10–11 months and 11.5%burned annually.The largest part of the reserve burned every one to two years(63.1%),while 8.3%burned every two to four years,5.8%burned every four to ten years,and 1.9%burned every ten to twenty years.Only 1.3%of the entire area did not fire during the whole study period.Fire returned to a particular site every 1.39 a and the annual percentage of area burned in the PBR was 71.9%.The MFRI(MFRI<2.00 a)was low in grasslands,shrub savannah,tree savannah,woodland savannah,and rock vegetation.Fire regime must be maintained to preserve the integrity of the PBR.In this context,we suggest applying early fire in tree and woodland savannahs to lower grass height,and late dry season fires every two to three years in shrub savannah to limit the expansion of shrubs and bushes.We propose a laissez-faire system in areas in woodland savannah where the fire frequency is sufficient to allow tree growth.Our findings highlight the utility of remote sensing in defining the geographical and temporal patterns of fire in the PBR and could help to manage this important fire prone area.

Numerical Simulation of Super-Resolution Structured Illumination Microscopy (SIM) Using Heintzmann-Cremer Algorithm with Non-Continuous Spatial Frequency Support

We report a comprehensive numerical study of super resolution (SR) structured illumination microscopy (SIM) utilizing the classic Heintzmann-Cremer SIM process and algorithm. In particular, we investigated the impact of the diffraction limit of the underlying imaging system on the optimal SIM grating frequency that can be used to obtain the highest SR enhancement with non-continuous spatial frequency support. Besides confirming the previous theoretical and experimental work that SR-SIM can achieve an enhancement close to 3 times the diffraction limit with grating pattern illuminations, we also observe and report a series of more subtle effects of SR-SIM with non-continuous spatial frequency support. Our simulations show that when the SIM grating frequency exceeds twice that of the diffraction limit, the higher SIM grating frequency can help achieve a higher SR enhancement for the underlying imaging systems whose diffraction limit is low, though this enhancement is obtained at the cost of losing resolution at some lower resolution targets. Our simulations also show that, for underlying imaging systems with high diffraction limits, however, SR-SIM grating frequencies above twice the diffraction limits tend to bring no significant extra enhancement. Furthermore, we observed that there exists a limit grating frequency above which the SR enhancement effect is lost, and the reconstructed images essentially have the same resolution as the one obtained directly from the underlying imaging system without using the SIM process.

Multiple Cropping Intensity in China Derived from Agro-meteorological Observations and MODIS Data

Double-and triple-cropping in a year have played a very important role in meeting the rising need for food in China.However,the intensified agricultural practices have significantly altered biogeochemical cycles and soil quality.Understanding and mapping cropping intensity in China′s agricultural systems are therefore necessary to better estimate carbon,nitrogen and water fluxes within agro-ecosystems on the national scale.In this study,we investigated the spatial pattern of crop calendar and multiple cropping rotations in China using phenological records from 394 agro-meteorological stations(AMSs)across China.The results from the analysis of in situ field observations were used to develop a new algorithm that identifies the spatial distribution of multiple cropping in China from moderate resolution imaging spectroradiometer(MODIS)time series data with a 500 m spatial resolution and an 8-day temporal resolution.According to the MODIS-derived multiple cropping distribution in 2002,the proportion of cropland cultivated with multiple crops reached 34%in China.Double-cropping accounted for approximately 94.6%and triple-cropping for 5.4%.The results demonstrat that MODIS EVI(Enhanced Vegetation Index)time series data have the capability and potential to delineate the dynamics of double-and triple-cropping practices.The resultant multiple cropping map could be used to evaluate the impacts of agricultural intensification on biogeochemical cycles.

Wall Imaging for Unilateral Intracranial Vertebral Artery Hypoplasia with Three-dimensional High-isotropic Resolution Magnetic Resonance Images

Background：There are few studies for evaluating wall characteristics of intracranial vertebral artery hypoplasia （VAH）.The aim of this study was to determine wall characteristics of VAH with three-dimensional volumetric isotropic turbo spin echo acquisition （3D VISTA） images and differentiate between acquired atherosclerotic stenosis and VAH.Methods：Thirty patients with suspicious VAH by luminograms were retrospectively enrolled between January 2014 and February 2015.The patients were classified as ＂acquired atherosclerotic stenosis＂ or ＂VAH＂ based on 3D VISTA images.The wall characteristics of VAH were assessed to determine the presence of atherosclerotic lesions,and the patients were classified into two subgroups （VAH with atherosclerosis and VAH with normal wall）.Wall characteristics of basilar arteries and vertebral arteries were also assessed.The clinical and wall characteristics were compared between the two groups.Results：Five of 30 patients with suspicious VAH were finally diagnosed as acquired atherosclerotic stenosis by 3D VISTA images.25 patients were finally diagnosed as VAH including 16 （64.00%） patients with atherosclerosis and 9 （36.00%） patients with normal wall.In the 16 patients with atherosclerosis,plaque was found in 9 patients,slight wall thickening in 6 patients,and thrombus and wall thickening in 1 patient.Compared with VAH patients with normal wall,VAH patients with atherosclerosis showed atherosclerotic basilar arteries and dominant vertebral arteries more frequently （P =0.000）.Conclusions：Three-dimensional VISTA images enable differentiation between the acquired atherosclerotic stenosis and VAH.VAH was also prone to atherosclerotic processes.