Single Image Super-Resolution(SISR)technology aims to reconstruct a clear,high-resolution image with more information from an input low-resolution image that is blurry and contains less information.This technology has...Single Image Super-Resolution(SISR)technology aims to reconstruct a clear,high-resolution image with more information from an input low-resolution image that is blurry and contains less information.This technology has significant research value and is widely used in fields such as medical imaging,satellite image processing,and security surveillance.Despite significant progress in existing research,challenges remain in reconstructing clear and complex texture details,with issues such as edge blurring and artifacts still present.The visual perception effect still needs further enhancement.Therefore,this study proposes a Pyramid Separable Channel Attention Network(PSCAN)for the SISR task.Thismethod designs a convolutional backbone network composed of Pyramid Separable Channel Attention blocks to effectively extract and fuse multi-scale features.This expands the model’s receptive field,reduces resolution loss,and enhances the model’s ability to reconstruct texture details.Additionally,an innovative artifact loss function is designed to better distinguish between artifacts and real edge details,reducing artifacts in the reconstructed images.We conducted comprehensive ablation and comparative experiments on the Arabidopsis root image dataset and several public datasets.The experimental results show that the proposed PSCAN method achieves the best-known performance in both subjective visual effects and objective evaluation metrics,with improvements of 0.84 in Peak Signal-to-Noise Ratio(PSNR)and 0.017 in Structural Similarity Index(SSIM).This demonstrates that the method can effectively preserve high-frequency texture details,reduce artifacts,and have good generalization performance.展开更多
The numerous photos captured by low-price Internet of Things(IoT)sensors are frequently affected by meteorological factors,especially rainfall.It causes varying sizes of white streaks on the image,destroying the image...The numerous photos captured by low-price Internet of Things(IoT)sensors are frequently affected by meteorological factors,especially rainfall.It causes varying sizes of white streaks on the image,destroying the image texture and ruining the performance of the outdoor computer vision system.Existing methods utilise training with pairs of images,which is difficult to cover all scenes and leads to domain gaps.In addition,the network structures adopt deep learning to map rain images to rain-free images,failing to use prior knowledge effectively.To solve these problems,we introduce a single image derain model in edge computing that combines prior knowledge of rain patterns with the learning capability of the neural network.Specifically,the algorithm first uses Residue Channel Prior to filter out the rainfall textural features then it uses the Feature Fusion Module to fuse the original image with the background feature information.This results in a pre-processed image which is fed into Half Instance Net(HINet)to recover a high-quality rain-free image with a clear and accurate structure,and the model does not rely on any rainfall assumptions.Experimental results on synthetic and real-world datasets show that the average peak signal-to-noise ratio of the model decreases by 0.37 dB on the synthetic dataset and increases by 0.43 dB on the real-world dataset,demonstrating that a combined model reduces the gap between synthetic data and natural rain scenes,improves the generalization ability of the derain network,and alleviates the overfitting problem.展开更多
The employment of deep convolutional neural networks has recently contributed to significant progress in single image super-resolution(SISR)research.However,the high computational demands of most SR techniques hinder ...The employment of deep convolutional neural networks has recently contributed to significant progress in single image super-resolution(SISR)research.However,the high computational demands of most SR techniques hinder their applicability to edge devices,despite their satisfactory reconstruction performance.These methods commonly use standard convolutions,which increase the convolutional operation cost of the model.In this paper,a lightweight Partial Separation and Multiscale Fusion Network(PSMFNet)is proposed to alleviate this problem.Specifically,this paper introduces partial convolution(PConv),which reduces the redundant convolution operations throughout the model by separating some of the features of an image while retaining features useful for image reconstruction.Additionally,it is worth noting that the existing methods have not fully utilized the rich feature information,leading to information loss,which reduces the ability to learn feature representations.Inspired by self-attention,this paper develops a multiscale feature fusion block(MFFB),which can better utilize the non-local features of an image.MFFB can learn long-range dependencies from the spatial dimension and extract features from the channel dimension,thereby obtaining more comprehensive and rich feature information.As the role of the MFFB is to capture rich global features,this paper further introduces an efficient inverted residual block(EIRB)to supplement the local feature extraction ability of PSMFNet.A comprehensive analysis of the experimental results shows that PSMFNet maintains a better performance with fewer parameters than the state-of-the-art models.展开更多
Due to the presence of turbid media, such as microdust and water vapor in the environment, outdoor pictures taken under hazy weather circumstances are typically degraded. To enhance the quality of such images, this wo...Due to the presence of turbid media, such as microdust and water vapor in the environment, outdoor pictures taken under hazy weather circumstances are typically degraded. To enhance the quality of such images, this work proposes a new hybrid λ2-λ0 penalty model for image dehazing. This model performs a weighted fusion of two distinct transmission maps, generated by imposing λ2 and λ0 norm penalties on the approximate regression coefficients of the transmission map. This approach effectively balances the sparsity and smoothness associated with the λ0 and λ2 norms, thereby optimizing the transmittance map. Specifically, when the λ2 norm is penalized in the model, an updated guided image is obtained after implementing λ0 penalty. The resulting optimization problem is effectively solved using the least square method and the alternating direction algorithm. The dehazing framework combines the advantages of λ2 and λ0 norms, enhancing sparse and smoothness, resulting in higher quality images with clearer details and preserved edges.展开更多
Low-dimensional halide perovskites have become the most promising candidates for X-ray imaging,yet the issues of the poor chemical stability of hybrid halide perovskite,the high poisonousness of lead halides and the r...Low-dimensional halide perovskites have become the most promising candidates for X-ray imaging,yet the issues of the poor chemical stability of hybrid halide perovskite,the high poisonousness of lead halides and the relatively low detectivity of the lead-free halide perovskites which seriously restrain its commercialization.Here,we developed a solution inverse temperature crystal growth(ITCG)method to bring-up high quality Cs_(3)Cu_(2)I_(5)crystals with large size of centimeter order,in which the oleic acid(OA)is introduced as an antioxidative ligand to inhibit the oxidation of cuprous ions effieiently,as well as to decelerate the crystallization rate remarkalby.Based on these fine crystals,the vapor deposition technique is empolyed to prepare high quality Cs_(3)Cu_(2)I_(5)films for efficient X-ray imaging.Smooth surface morphology,high light yields and short decay time endow the Cs_(3)Cu_(2)I_(5)films with strong radioluminescence,high resolution(12 lp/mm),low detection limits(53 nGyair/s)and desirable stability.Subsequently,the Cs_(3)Cu_(2)I_(5)films have been applied to the practical radiography which exhibit superior X-ray imaging performance.Our work provides a paradigm to fabricate nonpoisonous and chemically stable inorganic halide perovskite for X-ray imaging.展开更多
Multiple single nucleotide polymorphisms may contribute to cognitive decline in Parkinson’s disease. However, the mechanism by which these single nucleotide polymorphisms modify brain imaging phenotype remains unclea...Multiple single nucleotide polymorphisms may contribute to cognitive decline in Parkinson’s disease. However, the mechanism by which these single nucleotide polymorphisms modify brain imaging phenotype remains unclear. The aim of this study was to investigate the potential effects of multiple single nucleotide polymorphisms on brain imaging phenotype in Parkinson’s disease. Forty-eight Parkinson’s disease patients and 39 matched healthy controls underwent genotyping and 7 T magnetic resonance imaging. A cognitive-weighted polygenic risk score model was designed, in which the effect sizes were determined individually for 36 single nucleotide polymorphisms. The correlations between polygenic risk score, neuroimaging features, and clinical data were analyzed. Furthermore, individual single nucleotide polymorphism analysis was performed to explore the main effects of genotypes and their interactive effects with Parkinson’s disease diagnosis. We found that, in Parkinson’s disease, the polygenic risk score was correlated with the neural activity of the hippocampus, parahippocampus, and fusiform gyrus, and with hippocampal-prefrontal and fusiform-temporal connectivity, as well as with gray matter alterations in the orbitofrontal cortex. In addition, we found that single nucleotide polymorphisms in α-synuclein(SNCA) were associated with white matter microstructural changes in the superior corona radiata, corpus callosum, and external capsule. A single nucleotide polymorphism in catechol-O-methyltransferase was associated with the neural activities of the lingual, fusiform, and occipital gyri, which are involved in visual cognitive dysfunction. Furthermore, DRD3 was associated with frontal and temporal lobe function and structure. In conclusion, imaging genetics is useful for providing a better understanding of the genetic pathways involved in the pathophysiologic processes underlying Parkinson’s disease. This study provides evidence of an association between genetic factors, cognitive functions, and multi-modality neuroimaging biomarkers in Parkinson’s disease.展开更多
Cells are the basic unit of human organs that are not fully understood.The revolutionary advancements of optical imaging alowed us to observe single cells in whole organs,revealing the complicated composition of cells...Cells are the basic unit of human organs that are not fully understood.The revolutionary advancements of optical imaging alowed us to observe single cells in whole organs,revealing the complicated composition of cells with spatial information.Therefore,in this review,we revisit the principles of optical contrast related to those biomolecules and the optical techniques that transform optical contrast into detectable optical signals.Then,we describe optical imaging to achieve threedimensional spatial discrimination for biological tisutes.Due to the milky appearance of tissues,the spatial information burred deep in the whole organ.Fortunately,strategies developed in the last decade could circumvent this issue and lead us into a new era of investigation of the cells with their original spatial information.展开更多
Existing three-dimensional(3D) imaging technologies have issues such as requiring active illumination, multiple exposures, or coding modulation. We propose a passive single 3D imaging method based on an ordinary imagi...Existing three-dimensional(3D) imaging technologies have issues such as requiring active illumination, multiple exposures, or coding modulation. We propose a passive single 3D imaging method based on an ordinary imaging system.Using the point spread function of the imaging system to realize the non-coding measurement on the target, the full-focus images and depth information of the 3D target can be extracted from a single two-dimensional(2D) image through the compressed sensing algorithm. Simulation and experiments show that this approach can complete passive 3D imaging based on an ordinary imaging system without any coding operations. This method can achieve millimeter-level vertical resolution under single exposure conditions and has the potential for real-time dynamic 3D imaging. It improves the efficiency of 3D information detection, reduces the complexity of the imaging system, and may be of considerable value to the field of computer vision and other related applications.展开更多
In imaging on moving target, it is easy to get space- variant blurred image. In order to recover the image and gain recognizable target, an approach to recover the space-variant blurred image is presented based on ima...In imaging on moving target, it is easy to get space- variant blurred image. In order to recover the image and gain recognizable target, an approach to recover the space-variant blurred image is presented based on image segmentation. Be- cause of motion blur's convolution process, the pixels of observed image's target and background will be displaced and piled up to produce two superposition regions. As a result, the neighbor- ing pixels in the superposition regions will have similar grey level change. According to the pixel's motion-blur character, the target's blurred edge of superposition region could be detected. Canny operator can be recurred to detect the target edge which parallels the motion blur direction. Then in the segmentation process, the whole target image which has the character of integral convolution between motion blur and real target image can be obtained. At last, the target image is restored by deconvolution algorithms with adding zeros. The restoration result indicates that the approach can effectively solve the kind of problem of space-variant motion blurred image restoration.展开更多
Visual degradation of captured images caused by rainy streaks under rainy weather can adversely affect the performance of many open-air vision systems.Hence,it is necessary to address the problem of eliminating rain s...Visual degradation of captured images caused by rainy streaks under rainy weather can adversely affect the performance of many open-air vision systems.Hence,it is necessary to address the problem of eliminating rain streaks from the individual rainy image.In this work,a deep convolution neural network(CNN)based method is introduced,called Rain-Removal Net(R2N),to solve the single image de-raining issue.Firstly,we decomposed the rainy image into its high-frequency detail layer and lowfrequency base layer.Then,we used the high-frequency detail layer to input the carefully designed CNN architecture to learn the mapping between it and its corresponding derained high-frequency detail layer.The CNN architecture consists of four convolution layers and four deconvolution layers,as well as three skip connections.The experiments on synthetic and real-world rainy images show that the performance of our architecture outperforms the compared state-of-the-art de-raining models with respects to the quality of de-rained images and computing efficiency.展开更多
Outdoor haze has adverse impact on outdoor image quality,including contrast loss and poor visibility.In this paper,a novel dehazing algorithm based on the decomposition strategy is proposed.It combines the advantages ...Outdoor haze has adverse impact on outdoor image quality,including contrast loss and poor visibility.In this paper,a novel dehazing algorithm based on the decomposition strategy is proposed.It combines the advantages of the two-dimensional variational mode decomposition(2DVMD)algorithm and dark channel prior.The original hazy image is adaptively decom-posed into low-frequency and high-frequency images according to the image frequency band by using the 2DVMD algorithm.The low-frequency image is dehazed by using the improved dark channel prior,and then fused with the high-frequency image.Furthermore,we optimize the atmospheric light and transmit-tance estimation method to obtain a defogging effect with richer details and stronger contrast.The proposed algorithm is com-pared with the existing advanced algorithms.Experiment results show that the proposed algorithm has better performance in comparison with the state-of-the-art algorithms.展开更多
To implement restoration in a single motion blurred image,the PSF(Point Spread Function)is difficult to estimate and the image deconvolution is ill-posed as a result that a good recovery effect cannot be obtained.Cons...To implement restoration in a single motion blurred image,the PSF(Point Spread Function)is difficult to estimate and the image deconvolution is ill-posed as a result that a good recovery effect cannot be obtained.Considering that several different PSFs can get joint invertibility to make restoration wellposed,we proposed a motion-blurred image restoration method based on joint invertibility of PSFs by means of computational photography.Firstly,we designed a set of observation device which composed by multiple cameras with the same parameters to shoot the moving target in the same field of view continuously to obtain the target images with the same background.The target images have the same brightness,but different exposure time and different motion blur length.It is easy to estimate the blur PSFs of the target images make use of the sequence frames obtained by one camera.According to the motion blur superposition feature of the target and its background,the complete blurred target images can be extracted from the observed images respectively.Finally,for the same target images with different PSFs,the iterative restoration is solved by joint solution of multiple images in spatial domain.The experiments showed that the moving target observation device designed by this method had lower requirements on hardware conditions,and the observed images are more convenient to use joint-PSF solution for image restoration,and the restoration results maintained details well and had lower signal noise ratio(SNR).展开更多
Dissolution kinetics of sodium carbonate is investigated with the image analysis method at the approach of single particle.The dissolution experiments are carried out in an aqueous solution under a series of controlle...Dissolution kinetics of sodium carbonate is investigated with the image analysis method at the approach of single particle.The dissolution experiments are carried out in an aqueous solution under a series of controlled temperature and p H.The selected sodium carbonate particles are all spherical with the same mass and diameter.The dissolution process is quantified with the measurement of particle diameter from dissolution images.The concentration of dissolved sodium carbonate in solvent is calculated with the measured diameter of particle.Both surface reaction model and mass transport model are implemented to determine the dissolution mechanism and quantify the dissolution rate constant at each experimental condition.According to the fitting results with both two models,it is clarified that the dissolution process at the increasing temperature is controlled by the mass transport of dissolved sodium carbonate travelling from particle surface into solvent.The dissolution process at the increasing pH is controlled by the chemical reaction on particle surface.Furthermore,the dissolution rate constant for each single spherical sodium carbonate particle is quantified and the results show that the dissolution rate constant of single spherical sodium carbonate increases significantly with the rising of temperature,but decreases with the increasing of pH conversely.展开更多
In general, to reconstruct the accurate shape of buildings, we need at least one stereomodel (two photographs) for each building. In most cases, however, only a single non-metric photograph is available, which is us...In general, to reconstruct the accurate shape of buildings, we need at least one stereomodel (two photographs) for each building. In most cases, however, only a single non-metric photograph is available, which is usually obtained either by an amateur, such as a tourist, or from a newspaper or a post card. To evaluate the validity of 3D reconstruction from a single non-metric image, this study analyzes the effects of object depth on the accuracy of dimensional shape in X and Y directions using a single non-metric image by means of simulation technique, as this was considered to be, in most cases, a main source of data acquisition in recording and documenting buildings.展开更多
Cities are in constant change and city managers aim to keep an updated digital model of the city for city governance. There are a lot of images uploaded daily on image sharing platforms (as “Flickr”, “Twitter”, et...Cities are in constant change and city managers aim to keep an updated digital model of the city for city governance. There are a lot of images uploaded daily on image sharing platforms (as “Flickr”, “Twitter”, etc.). These images feature a rough localization and no orientation information. Nevertheless, they can help to populate an active collaborative database of street images usable to maintain a city 3D model, but their localization and orientation need to be known. Based on these images, we propose the Data Gathering system for image Pose Estimation (DGPE) that helps to find the pose (position and orientation) of the camera used to shoot them with better accuracy than the sole GPS localization that may be embedded in the image header. DGPE uses both visual and semantic information, existing in a single image processed by a fully automatic chain composed of three main layers: Data retrieval and preprocessing layer, Features extraction layer, Decision Making layer. In this article, we present the whole system details and compare its detection results with a state of the art method. Finally, we show the obtained localization, and often orientation results, combining both semantic and visual information processing on 47 images. Our multilayer system succeeds in 26% of our test cases in finding a better localization and orientation of the original photo. This is achieved by using only the image content and associated metadata. The use of semantic information found on social media such as comments, hash tags, etc. has doubled the success rate to 59%. It has reduced the search area and thus made the visual search more accurate.展开更多
Single image super-resolution(SISR)is a fundamentally challenging problem because a low-resolution(LR)image can correspond to a set of high-resolution(HR)images,while most are not expected.Recently,SISR can be achieve...Single image super-resolution(SISR)is a fundamentally challenging problem because a low-resolution(LR)image can correspond to a set of high-resolution(HR)images,while most are not expected.Recently,SISR can be achieved by a deep learning-based method.By constructing a very deep super-resolution convolutional neural network(VDSRCNN),the LR images can be improved to HR images.This study mainly achieves two objectives:image super-resolution(ISR)and deblurring the image from VDSRCNN.Firstly,by analyzing ISR,we modify different training parameters to test the performance of VDSRCNN.Secondly,we add the motion blurred images to the training set to optimize the performance of VDSRCNN.Finally,we use image quality indexes to evaluate the difference between the images from classical methods and VDSRCNN.The results indicate that the VDSRCNN performs better in generating HR images from LR images using the optimized VDSRCNN in a proper method.展开更多
In this paper, a new method of combination single layer wavelet transform and compressive sensing is proposed for image fusion. In which only measured the high-pass wavelet coefficients of the image but preserved the ...In this paper, a new method of combination single layer wavelet transform and compressive sensing is proposed for image fusion. In which only measured the high-pass wavelet coefficients of the image but preserved the low-pass wavelet coefficient. Then, fuse the low-pass wavelet coefficients and the measurements of high-pass wavelet coefficient with different schemes. For the reconstruction, by using the minimization of total variation algorithm (TV), high-pass wavelet coefficients could be recovered by the fused measurements. Finally, the fused image could be reconstructed by the inverse wavelet transform. The experiments show the proposed method provides promising fusion performance with a low computational complexity.展开更多
Deviation is essential to classic soft threshold denoising in wavelet domain. Texture features ofnoised image denoised by wavelet transform were weakened. Gibbs effect is distinct at edges of image.Image blurs compari...Deviation is essential to classic soft threshold denoising in wavelet domain. Texture features ofnoised image denoised by wavelet transform were weakened. Gibbs effect is distinct at edges of image.Image blurs comparing with original noised image. To solve the questions, a blind denoising method basedon single-wavelet transform and multiwavelets transform was proposed. The method doesn’t depend onsize of image and deviation to determine threshold of wavelet coefficients, which is different from classicalsoft-threshold denoising in wavelet domain. Moreover, the method is good for many types of noise. Gibbseffect disappeared with this method, edges of image are preserved well, and noise is smoothed andrestrained effectively.展开更多
In many ultrafast imaging applications, the reduced field-of-view(r FOV) technique is often used to enhance the spatial resolution and field inhomogeneity immunity of the images. The stationary-phase characteristic ...In many ultrafast imaging applications, the reduced field-of-view(r FOV) technique is often used to enhance the spatial resolution and field inhomogeneity immunity of the images. The stationary-phase characteristic of the spatiotemporallyencoded(SPEN) method offers an inherent applicability to r FOV imaging. In this study, a flexible r FOV imaging method is presented and the superiority of the SPEN approach in r FOV imaging is demonstrated. The proposed method is validated with phantom and in vivo rat experiments, including cardiac imaging and contrast-enhanced perfusion imaging. For comparison, the echo planar imaging(EPI) experiments with orthogonal RF excitation are also performed. The results show that the signal-to-noise ratios of the images acquired by the proposed method can be higher than those obtained with the r FOV EPI. Moreover, the proposed method shows better performance in the cardiac imaging and perfusion imaging of rat kidney, and it can scan one or more regions of interest(ROIs) with high spatial resolution in a single shot. It might be a favorable solution to ultrafast imaging applications in cases with severe susceptibility heterogeneities, such as cardiac imaging and perfusion imaging. Furthermore, it might be promising in applications with separate ROIs, such as mammary and limb imaging.展开更多
Single pixel imaging is a novel imaging technique,and it becomes a focus of research in recent years due to its advantages such as high lateral resolution and high robustness to noise.Imaging speed is one of the criti...Single pixel imaging is a novel imaging technique,and it becomes a focus of research in recent years due to its advantages such as high lateral resolution and high robustness to noise.Imaging speed is one of the critical shortcomings,which limits the further development and applications of this technique.In this paper,we focus on the issues of imaging efficiency of a single pixel imaging system.We propose semi-continuous wavelet transform(SCWT)protocol and introduce the protocol into the single pixel imaging system.The proposed protocol is something between continuous wavelet transform and discrete wavelet transform,which allows the usage of those smooth(usually non-orthogonal,and they have advantages in representing smooth signals compressively,which can improve the imaging speed of single pixel imaging)wavelets and with limited numbers of measurements.The proposed imaging scheme is studied,and verified by simulations and experiments.Furthermore,a comparison between our proposed scheme and existing imaging schemes are given.According to the results,the proposed SCWT scheme is proved to be effective in reconstructing a image compressively.展开更多
基金supported by Beijing Municipal Science and Technology Project(No.Z221100007122003).
文摘Single Image Super-Resolution(SISR)technology aims to reconstruct a clear,high-resolution image with more information from an input low-resolution image that is blurry and contains less information.This technology has significant research value and is widely used in fields such as medical imaging,satellite image processing,and security surveillance.Despite significant progress in existing research,challenges remain in reconstructing clear and complex texture details,with issues such as edge blurring and artifacts still present.The visual perception effect still needs further enhancement.Therefore,this study proposes a Pyramid Separable Channel Attention Network(PSCAN)for the SISR task.Thismethod designs a convolutional backbone network composed of Pyramid Separable Channel Attention blocks to effectively extract and fuse multi-scale features.This expands the model’s receptive field,reduces resolution loss,and enhances the model’s ability to reconstruct texture details.Additionally,an innovative artifact loss function is designed to better distinguish between artifacts and real edge details,reducing artifacts in the reconstructed images.We conducted comprehensive ablation and comparative experiments on the Arabidopsis root image dataset and several public datasets.The experimental results show that the proposed PSCAN method achieves the best-known performance in both subjective visual effects and objective evaluation metrics,with improvements of 0.84 in Peak Signal-to-Noise Ratio(PSNR)and 0.017 in Structural Similarity Index(SSIM).This demonstrates that the method can effectively preserve high-frequency texture details,reduce artifacts,and have good generalization performance.
基金supported by the National Natural Science Foundation of China under Grant no.41975183,and Grant no.41875184 and Supported by a grant from State Key Laboratory of Resources and Environmental Information System.
文摘The numerous photos captured by low-price Internet of Things(IoT)sensors are frequently affected by meteorological factors,especially rainfall.It causes varying sizes of white streaks on the image,destroying the image texture and ruining the performance of the outdoor computer vision system.Existing methods utilise training with pairs of images,which is difficult to cover all scenes and leads to domain gaps.In addition,the network structures adopt deep learning to map rain images to rain-free images,failing to use prior knowledge effectively.To solve these problems,we introduce a single image derain model in edge computing that combines prior knowledge of rain patterns with the learning capability of the neural network.Specifically,the algorithm first uses Residue Channel Prior to filter out the rainfall textural features then it uses the Feature Fusion Module to fuse the original image with the background feature information.This results in a pre-processed image which is fed into Half Instance Net(HINet)to recover a high-quality rain-free image with a clear and accurate structure,and the model does not rely on any rainfall assumptions.Experimental results on synthetic and real-world datasets show that the average peak signal-to-noise ratio of the model decreases by 0.37 dB on the synthetic dataset and increases by 0.43 dB on the real-world dataset,demonstrating that a combined model reduces the gap between synthetic data and natural rain scenes,improves the generalization ability of the derain network,and alleviates the overfitting problem.
基金Guangdong Science and Technology Program under Grant No.202206010052Foshan Province R&D Key Project under Grant No.2020001006827Guangdong Academy of Sciences Integrated Industry Technology Innovation Center Action Special Project under Grant No.2022GDASZH-2022010108.
文摘The employment of deep convolutional neural networks has recently contributed to significant progress in single image super-resolution(SISR)research.However,the high computational demands of most SR techniques hinder their applicability to edge devices,despite their satisfactory reconstruction performance.These methods commonly use standard convolutions,which increase the convolutional operation cost of the model.In this paper,a lightweight Partial Separation and Multiscale Fusion Network(PSMFNet)is proposed to alleviate this problem.Specifically,this paper introduces partial convolution(PConv),which reduces the redundant convolution operations throughout the model by separating some of the features of an image while retaining features useful for image reconstruction.Additionally,it is worth noting that the existing methods have not fully utilized the rich feature information,leading to information loss,which reduces the ability to learn feature representations.Inspired by self-attention,this paper develops a multiscale feature fusion block(MFFB),which can better utilize the non-local features of an image.MFFB can learn long-range dependencies from the spatial dimension and extract features from the channel dimension,thereby obtaining more comprehensive and rich feature information.As the role of the MFFB is to capture rich global features,this paper further introduces an efficient inverted residual block(EIRB)to supplement the local feature extraction ability of PSMFNet.A comprehensive analysis of the experimental results shows that PSMFNet maintains a better performance with fewer parameters than the state-of-the-art models.
文摘Due to the presence of turbid media, such as microdust and water vapor in the environment, outdoor pictures taken under hazy weather circumstances are typically degraded. To enhance the quality of such images, this work proposes a new hybrid λ2-λ0 penalty model for image dehazing. This model performs a weighted fusion of two distinct transmission maps, generated by imposing λ2 and λ0 norm penalties on the approximate regression coefficients of the transmission map. This approach effectively balances the sparsity and smoothness associated with the λ0 and λ2 norms, thereby optimizing the transmittance map. Specifically, when the λ2 norm is penalized in the model, an updated guided image is obtained after implementing λ0 penalty. The resulting optimization problem is effectively solved using the least square method and the alternating direction algorithm. The dehazing framework combines the advantages of λ2 and λ0 norms, enhancing sparse and smoothness, resulting in higher quality images with clearer details and preserved edges.
基金the financially support of the National Natural Science Foundation of China(12164051)the Joint Foundation of Provincial Science and Technology Department-Double First-class Construction of Yunnan University(2019FY003016)+4 种基金the Young Top Talent Project of Yunnan Province(YNWR-QNBJ-2018-229)the financially support by Yunnan Major Scientific and Technological Projects(202202AG050016)Advanced Analysis and Measurement Center of Yunnan University for the sample characterization service and the Postgraduate Research and Innovation Foundation of Yunnan University(2021Y036)the financially support of the National Natural Science Foundation of China(62064013)the Application Basic Research Project of Yunnan Province[2019FB130]。
文摘Low-dimensional halide perovskites have become the most promising candidates for X-ray imaging,yet the issues of the poor chemical stability of hybrid halide perovskite,the high poisonousness of lead halides and the relatively low detectivity of the lead-free halide perovskites which seriously restrain its commercialization.Here,we developed a solution inverse temperature crystal growth(ITCG)method to bring-up high quality Cs_(3)Cu_(2)I_(5)crystals with large size of centimeter order,in which the oleic acid(OA)is introduced as an antioxidative ligand to inhibit the oxidation of cuprous ions effieiently,as well as to decelerate the crystallization rate remarkalby.Based on these fine crystals,the vapor deposition technique is empolyed to prepare high quality Cs_(3)Cu_(2)I_(5)films for efficient X-ray imaging.Smooth surface morphology,high light yields and short decay time endow the Cs_(3)Cu_(2)I_(5)films with strong radioluminescence,high resolution(12 lp/mm),low detection limits(53 nGyair/s)and desirable stability.Subsequently,the Cs_(3)Cu_(2)I_(5)films have been applied to the practical radiography which exhibit superior X-ray imaging performance.Our work provides a paradigm to fabricate nonpoisonous and chemically stable inorganic halide perovskite for X-ray imaging.
基金supported by grants from the National Natural Science Foundation of China,Nos. 81771216 (to JLP), 81520108010 (to BRZ),and 82101323 (to TS)the National Key R&D Program of China,No. 2018YFA0701400 (to HYL)+3 种基金the Primary Research and Development Plan of Zhejiang Province,No. 2020C03020 (to BRZ)the Key Project of Zhejiang Laboratory,No. 2018EB0ZX01 (to HYL)the Fundamental Research Funds for the Central Universities,No. 2019XZZX001-01-21 (to HYL)Preferred Foundation of Zhejiang Postdoctors,No. ZJ2021152 (to TS)。
文摘Multiple single nucleotide polymorphisms may contribute to cognitive decline in Parkinson’s disease. However, the mechanism by which these single nucleotide polymorphisms modify brain imaging phenotype remains unclear. The aim of this study was to investigate the potential effects of multiple single nucleotide polymorphisms on brain imaging phenotype in Parkinson’s disease. Forty-eight Parkinson’s disease patients and 39 matched healthy controls underwent genotyping and 7 T magnetic resonance imaging. A cognitive-weighted polygenic risk score model was designed, in which the effect sizes were determined individually for 36 single nucleotide polymorphisms. The correlations between polygenic risk score, neuroimaging features, and clinical data were analyzed. Furthermore, individual single nucleotide polymorphism analysis was performed to explore the main effects of genotypes and their interactive effects with Parkinson’s disease diagnosis. We found that, in Parkinson’s disease, the polygenic risk score was correlated with the neural activity of the hippocampus, parahippocampus, and fusiform gyrus, and with hippocampal-prefrontal and fusiform-temporal connectivity, as well as with gray matter alterations in the orbitofrontal cortex. In addition, we found that single nucleotide polymorphisms in α-synuclein(SNCA) were associated with white matter microstructural changes in the superior corona radiata, corpus callosum, and external capsule. A single nucleotide polymorphism in catechol-O-methyltransferase was associated with the neural activities of the lingual, fusiform, and occipital gyri, which are involved in visual cognitive dysfunction. Furthermore, DRD3 was associated with frontal and temporal lobe function and structure. In conclusion, imaging genetics is useful for providing a better understanding of the genetic pathways involved in the pathophysiologic processes underlying Parkinson’s disease. This study provides evidence of an association between genetic factors, cognitive functions, and multi-modality neuroimaging biomarkers in Parkinson’s disease.
基金supported by the National Science and Technology Innovation 2030 Grant No. (2021ZD0200104)National Nature Science Foundation of China (81871082).
文摘Cells are the basic unit of human organs that are not fully understood.The revolutionary advancements of optical imaging alowed us to observe single cells in whole organs,revealing the complicated composition of cells with spatial information.Therefore,in this review,we revisit the principles of optical contrast related to those biomolecules and the optical techniques that transform optical contrast into detectable optical signals.Then,we describe optical imaging to achieve threedimensional spatial discrimination for biological tisutes.Due to the milky appearance of tissues,the spatial information burred deep in the whole organ.Fortunately,strategies developed in the last decade could circumvent this issue and lead us into a new era of investigation of the cells with their original spatial information.
基金Project supported by the National Key Research and Development Program of China (Grant No. 2018YFB0504302)Beijing Institute of Technology Research Fund Program for Young Scholars (Grant No. 202122012)。
文摘Existing three-dimensional(3D) imaging technologies have issues such as requiring active illumination, multiple exposures, or coding modulation. We propose a passive single 3D imaging method based on an ordinary imaging system.Using the point spread function of the imaging system to realize the non-coding measurement on the target, the full-focus images and depth information of the 3D target can be extracted from a single two-dimensional(2D) image through the compressed sensing algorithm. Simulation and experiments show that this approach can complete passive 3D imaging based on an ordinary imaging system without any coding operations. This method can achieve millimeter-level vertical resolution under single exposure conditions and has the potential for real-time dynamic 3D imaging. It improves the efficiency of 3D information detection, reduces the complexity of the imaging system, and may be of considerable value to the field of computer vision and other related applications.
文摘In imaging on moving target, it is easy to get space- variant blurred image. In order to recover the image and gain recognizable target, an approach to recover the space-variant blurred image is presented based on image segmentation. Be- cause of motion blur's convolution process, the pixels of observed image's target and background will be displaced and piled up to produce two superposition regions. As a result, the neighbor- ing pixels in the superposition regions will have similar grey level change. According to the pixel's motion-blur character, the target's blurred edge of superposition region could be detected. Canny operator can be recurred to detect the target edge which parallels the motion blur direction. Then in the segmentation process, the whole target image which has the character of integral convolution between motion blur and real target image can be obtained. At last, the target image is restored by deconvolution algorithms with adding zeros. The restoration result indicates that the approach can effectively solve the kind of problem of space-variant motion blurred image restoration.
基金This work was supported by the National Natural Science Foundation of China(Grant No.61673222)Jiangsu Universities Natural Science Research Project(Grant No.13KJA510001)Major Program of the National Social Science Fund of China(Grant No.17ZDA092).
文摘Visual degradation of captured images caused by rainy streaks under rainy weather can adversely affect the performance of many open-air vision systems.Hence,it is necessary to address the problem of eliminating rain streaks from the individual rainy image.In this work,a deep convolution neural network(CNN)based method is introduced,called Rain-Removal Net(R2N),to solve the single image de-raining issue.Firstly,we decomposed the rainy image into its high-frequency detail layer and lowfrequency base layer.Then,we used the high-frequency detail layer to input the carefully designed CNN architecture to learn the mapping between it and its corresponding derained high-frequency detail layer.The CNN architecture consists of four convolution layers and four deconvolution layers,as well as three skip connections.The experiments on synthetic and real-world rainy images show that the performance of our architecture outperforms the compared state-of-the-art de-raining models with respects to the quality of de-rained images and computing efficiency.
基金supported by the National Defense Technology Advance Research Project of China(004040204).
文摘Outdoor haze has adverse impact on outdoor image quality,including contrast loss and poor visibility.In this paper,a novel dehazing algorithm based on the decomposition strategy is proposed.It combines the advantages of the two-dimensional variational mode decomposition(2DVMD)algorithm and dark channel prior.The original hazy image is adaptively decom-posed into low-frequency and high-frequency images according to the image frequency band by using the 2DVMD algorithm.The low-frequency image is dehazed by using the improved dark channel prior,and then fused with the high-frequency image.Furthermore,we optimize the atmospheric light and transmit-tance estimation method to obtain a defogging effect with richer details and stronger contrast.The proposed algorithm is com-pared with the existing advanced algorithms.Experiment results show that the proposed algorithm has better performance in comparison with the state-of-the-art algorithms.
基金funding of Natural Science Foundation of Shandong Province(ZR2013F0025),www.sdnsf.gov.cn.
文摘To implement restoration in a single motion blurred image,the PSF(Point Spread Function)is difficult to estimate and the image deconvolution is ill-posed as a result that a good recovery effect cannot be obtained.Considering that several different PSFs can get joint invertibility to make restoration wellposed,we proposed a motion-blurred image restoration method based on joint invertibility of PSFs by means of computational photography.Firstly,we designed a set of observation device which composed by multiple cameras with the same parameters to shoot the moving target in the same field of view continuously to obtain the target images with the same background.The target images have the same brightness,but different exposure time and different motion blur length.It is easy to estimate the blur PSFs of the target images make use of the sequence frames obtained by one camera.According to the motion blur superposition feature of the target and its background,the complete blurred target images can be extracted from the observed images respectively.Finally,for the same target images with different PSFs,the iterative restoration is solved by joint solution of multiple images in spatial domain.The experiments showed that the moving target observation device designed by this method had lower requirements on hardware conditions,and the observed images are more convenient to use joint-PSF solution for image restoration,and the restoration results maintained details well and had lower signal noise ratio(SNR).
基金the Institute of Particle and Science Engineering,University of Leeds and Procter&Gamble Newcastle Innovation Centre(UK)for partially funding the project
文摘Dissolution kinetics of sodium carbonate is investigated with the image analysis method at the approach of single particle.The dissolution experiments are carried out in an aqueous solution under a series of controlled temperature and p H.The selected sodium carbonate particles are all spherical with the same mass and diameter.The dissolution process is quantified with the measurement of particle diameter from dissolution images.The concentration of dissolved sodium carbonate in solvent is calculated with the measured diameter of particle.Both surface reaction model and mass transport model are implemented to determine the dissolution mechanism and quantify the dissolution rate constant at each experimental condition.According to the fitting results with both two models,it is clarified that the dissolution process at the increasing temperature is controlled by the mass transport of dissolved sodium carbonate travelling from particle surface into solvent.The dissolution process at the increasing pH is controlled by the chemical reaction on particle surface.Furthermore,the dissolution rate constant for each single spherical sodium carbonate particle is quantified and the results show that the dissolution rate constant of single spherical sodium carbonate increases significantly with the rising of temperature,but decreases with the increasing of pH conversely.
文摘In general, to reconstruct the accurate shape of buildings, we need at least one stereomodel (two photographs) for each building. In most cases, however, only a single non-metric photograph is available, which is usually obtained either by an amateur, such as a tourist, or from a newspaper or a post card. To evaluate the validity of 3D reconstruction from a single non-metric image, this study analyzes the effects of object depth on the accuracy of dimensional shape in X and Y directions using a single non-metric image by means of simulation technique, as this was considered to be, in most cases, a main source of data acquisition in recording and documenting buildings.
文摘Cities are in constant change and city managers aim to keep an updated digital model of the city for city governance. There are a lot of images uploaded daily on image sharing platforms (as “Flickr”, “Twitter”, etc.). These images feature a rough localization and no orientation information. Nevertheless, they can help to populate an active collaborative database of street images usable to maintain a city 3D model, but their localization and orientation need to be known. Based on these images, we propose the Data Gathering system for image Pose Estimation (DGPE) that helps to find the pose (position and orientation) of the camera used to shoot them with better accuracy than the sole GPS localization that may be embedded in the image header. DGPE uses both visual and semantic information, existing in a single image processed by a fully automatic chain composed of three main layers: Data retrieval and preprocessing layer, Features extraction layer, Decision Making layer. In this article, we present the whole system details and compare its detection results with a state of the art method. Finally, we show the obtained localization, and often orientation results, combining both semantic and visual information processing on 47 images. Our multilayer system succeeds in 26% of our test cases in finding a better localization and orientation of the original photo. This is achieved by using only the image content and associated metadata. The use of semantic information found on social media such as comments, hash tags, etc. has doubled the success rate to 59%. It has reduced the search area and thus made the visual search more accurate.
文摘Single image super-resolution(SISR)is a fundamentally challenging problem because a low-resolution(LR)image can correspond to a set of high-resolution(HR)images,while most are not expected.Recently,SISR can be achieved by a deep learning-based method.By constructing a very deep super-resolution convolutional neural network(VDSRCNN),the LR images can be improved to HR images.This study mainly achieves two objectives:image super-resolution(ISR)and deblurring the image from VDSRCNN.Firstly,by analyzing ISR,we modify different training parameters to test the performance of VDSRCNN.Secondly,we add the motion blurred images to the training set to optimize the performance of VDSRCNN.Finally,we use image quality indexes to evaluate the difference between the images from classical methods and VDSRCNN.The results indicate that the VDSRCNN performs better in generating HR images from LR images using the optimized VDSRCNN in a proper method.
文摘In this paper, a new method of combination single layer wavelet transform and compressive sensing is proposed for image fusion. In which only measured the high-pass wavelet coefficients of the image but preserved the low-pass wavelet coefficient. Then, fuse the low-pass wavelet coefficients and the measurements of high-pass wavelet coefficient with different schemes. For the reconstruction, by using the minimization of total variation algorithm (TV), high-pass wavelet coefficients could be recovered by the fused measurements. Finally, the fused image could be reconstructed by the inverse wavelet transform. The experiments show the proposed method provides promising fusion performance with a low computational complexity.
文摘Deviation is essential to classic soft threshold denoising in wavelet domain. Texture features ofnoised image denoised by wavelet transform were weakened. Gibbs effect is distinct at edges of image.Image blurs comparing with original noised image. To solve the questions, a blind denoising method basedon single-wavelet transform and multiwavelets transform was proposed. The method doesn’t depend onsize of image and deviation to determine threshold of wavelet coefficients, which is different from classicalsoft-threshold denoising in wavelet domain. Moreover, the method is good for many types of noise. Gibbseffect disappeared with this method, edges of image are preserved well, and noise is smoothed andrestrained effectively.
基金Project supported by the National Natural Science Foundation of China(Grant Nos.11474236,81171331,and U1232212)
文摘In many ultrafast imaging applications, the reduced field-of-view(r FOV) technique is often used to enhance the spatial resolution and field inhomogeneity immunity of the images. The stationary-phase characteristic of the spatiotemporallyencoded(SPEN) method offers an inherent applicability to r FOV imaging. In this study, a flexible r FOV imaging method is presented and the superiority of the SPEN approach in r FOV imaging is demonstrated. The proposed method is validated with phantom and in vivo rat experiments, including cardiac imaging and contrast-enhanced perfusion imaging. For comparison, the echo planar imaging(EPI) experiments with orthogonal RF excitation are also performed. The results show that the signal-to-noise ratios of the images acquired by the proposed method can be higher than those obtained with the r FOV EPI. Moreover, the proposed method shows better performance in the cardiac imaging and perfusion imaging of rat kidney, and it can scan one or more regions of interest(ROIs) with high spatial resolution in a single shot. It might be a favorable solution to ultrafast imaging applications in cases with severe susceptibility heterogeneities, such as cardiac imaging and perfusion imaging. Furthermore, it might be promising in applications with separate ROIs, such as mammary and limb imaging.
基金the Natural Science Foundation of Jilin Province,China(Grand No.YDZJ202101ZYTS030)。
文摘Single pixel imaging is a novel imaging technique,and it becomes a focus of research in recent years due to its advantages such as high lateral resolution and high robustness to noise.Imaging speed is one of the critical shortcomings,which limits the further development and applications of this technique.In this paper,we focus on the issues of imaging efficiency of a single pixel imaging system.We propose semi-continuous wavelet transform(SCWT)protocol and introduce the protocol into the single pixel imaging system.The proposed protocol is something between continuous wavelet transform and discrete wavelet transform,which allows the usage of those smooth(usually non-orthogonal,and they have advantages in representing smooth signals compressively,which can improve the imaging speed of single pixel imaging)wavelets and with limited numbers of measurements.The proposed imaging scheme is studied,and verified by simulations and experiments.Furthermore,a comparison between our proposed scheme and existing imaging schemes are given.According to the results,the proposed SCWT scheme is proved to be effective in reconstructing a image compressively.