According to the remote sensing image characteristics, a set oi optimized compression quahty assessment methods is proposed on the basis of generating simulative images. Firstly, a means is put forward that generates ...According to the remote sensing image characteristics, a set oi optimized compression quahty assessment methods is proposed on the basis of generating simulative images. Firstly, a means is put forward that generates simulative images by scanning aerial films taking into account the space-borne remote sensing camera characteristics (including pixel resolution, histogram dynamic range and quantization). In the course of compression quality assessment, the objective assessment considers images texture changes and mutual relationship between simulative images and decompressed ima- ges, while the synthesized estimation factor (SEF) is brought out innovatively for the first time. Subjective assessment adopts a display setup -- 0.5mrn/pixel, which considers human visual char- acteristic and mainstream monitor. The set of methods are applied in compression plan design of panchromatic camera loaded on ZY-1-02C satellite. Through systematic and comprehensive assess- ment, simulation results show that image compression quality with the compression ratio of d:l can meet the remote sensing application requirements.展开更多
Image enhancement is a popular technique,which is widely used to improve the visual quality of images.While image enhancement has been extensively investigated,the relevant quality assessment of enhanced images remain...Image enhancement is a popular technique,which is widely used to improve the visual quality of images.While image enhancement has been extensively investigated,the relevant quality assessment of enhanced images remains an open problem,which may hinder further development of enhancement techniques.In this paper,a no-reference quality metric for digitally enhanced images is proposed.Three kinds of features are extracted for characterizing the quality of enhanced images,including non-structural information,sharpness and naturalness.Specifically,a total of 42 perceptual features are extracted and used to train a support vector regression(SVR) model.Finally,the trained SVR model is used for predicting the quality of enhanced images.The performance of the proposed method is evaluated on several enhancement-related databases,including a new enhanced image database built by the authors.The experimental results demonstrate the efficiency and advantage of the proposed metric.展开更多
Recent studies on no-reference image quality assessment (NR-IQA) methods usually learn to evaluate the image quality by regressing from human subjective scores of the training samples. This study presented an NR-IQA m...Recent studies on no-reference image quality assessment (NR-IQA) methods usually learn to evaluate the image quality by regressing from human subjective scores of the training samples. This study presented an NR-IQA method based on the basic image visual parameters without using human scored image databases in learning. We demonstrated that these features comprised the most basic characteristics for constructing an image and influencing the visual quality of an image. In this paper, the definitions, computational method, and relationships among these visual metrics were described. We subsequently proposed a no-reference assessment function, which was referred to as a visual parameter measurement index (VPMI), based on the integration of these visual metrics to assess image quality. It is established that the maximum of VPMI corresponds to the best quality of the color image. We verified this method using the popular assessment database—image quality assessment database (LIVE), and the results indicated that the proposed method matched better with the subjective assessment of human vision. Compared with other image quality assessment models, it is highly competitive. VPMI has low computational complexity, which makes it promising to implement in real-time image assessment systems.展开更多
In order to apply the deep learning to the stereo image quality evaluation,two problems need to be solved:The first one is that we have a bit of training samples,another is how to input the dimensional image’s left v...In order to apply the deep learning to the stereo image quality evaluation,two problems need to be solved:The first one is that we have a bit of training samples,another is how to input the dimensional image’s left view or right view.In this paper,we transfer the 2D image quality evaluation model to the stereo image quality evaluation,and this method solves the first problem;use the method of principal component analysis is used to fuse the left and right views into an input image in order to solve the second problem.At the same time,the input image is preprocessed by phase congruency transformation,which further improves the performance of the algorithm.The structure of the deep convolution neural network consists of four convolution layers and three maximum pooling layers and two fully connected layers.The experimental results on LIVE3D image database show that the prediction quality score of the model is in good agreement with the subjective evaluation value.展开更多
The Aral Sea Basin in Central Asia is an important geographical environment unit in the center of Eurasia.It is of great significance to the ecological protection and sustainable development of Central Asia to carry o...The Aral Sea Basin in Central Asia is an important geographical environment unit in the center of Eurasia.It is of great significance to the ecological protection and sustainable development of Central Asia to carry out dynamic monitoring and effective evaluation of the eco-environmental quality of the Aral Sea Basin.In this study,the arid remote sensing ecological index(ARSEI)for large-scale arid areas was developed,which coupled the information of the greenness index,the salinity index,the humidity index,the heat index,and the land degradation index of arid areas.The ARSEI was used to monitor and evaluate the eco-environmental quality of the Aral Sea Basin from 2000 to 2019.The results show that the greenness index,the humidity index and the land degradation index had a positive impact on the quality of the ecological environment in the Aral Sea Basin,while the salinity index and the heat index exerted a negative impact on the quality of the ecological environment.The eco-environmental quality of the Aral Sea Basin demonstrated a trend of initial improvement,followed by deterioration,and finally further improvement.The spatial variation of these changes was significant.From 2000 to 2019,grassland and wasteland(saline alkali land and sandy land)in the central and western parts of the basin had the worst ecological environment quality.The areas with poor ecological environment quality are mainly distributed in rivers,wetlands,and cultivated land around lakes.During the period from 2000 to 2019,except for the surrounding areas of the Aral Sea,the ecological environment quality in other areas of the Aral Sea Basin has been improved in general.The correlation coefficients between the change in the eco-environmental quality and the heat index and between the change in the eco-environmental quality and the humidity index were–0.593 and 0.524,respectively.Climate conditions and human activities have led to different combinations of heat and humidity changes in the eco-environmental quality of the Aral Sea Basin.However,human activities had a greater impact.The ARSEI can quantitatively and intuitively reflect the scale and causes of large-scale and long-time period changes of the eco-environmental quality in arid areas;it is very suitable for the study of the eco-environmental quality in arid areas.展开更多
Efficient and accurate access to coastal land cover information is of great significance for marine disaster prevention and mitigation.Although the popular and common sensors of land resource satellites provide free a...Efficient and accurate access to coastal land cover information is of great significance for marine disaster prevention and mitigation.Although the popular and common sensors of land resource satellites provide free and valuable images to map the land cover,coastal areas often encounter significant cloud cover,especially in tropical areas,which makes the classification in those areas non-ideal.To solve this problem,we proposed a framework of combining medium-resolution optical images and synthetic aperture radar(SAR)data with the recently popular object-based image analysis(OBIA)method and used the Landsat Operational Land Imager(OLI)and Phased Array type L-band Synthetic Aperture Radar(PALSAR)images acquired in Singapore in 2017 as a case study.We designed experiments to confirm two critical factors of this framework:one is the segmentation scale that determines the average object size,and the other is the classification feature.Accuracy assessments of the land cover indicated that the optimal segmentation scale was between 40 and 80,and the features of the combination of OLI and SAR resulted in higher accuracy than any individual features,especially in areas with cloud cover.Based on the land cover generated by this framework,we assessed the vulnerability of the marine disasters of Singapore in 2008 and 2017 and found that the high-vulnerability areas mainly located in the southeast and increased by 118.97 km2 over the past decade.To clarify the disaster response plan for different geographical environments,we classified risk based on altitude and distance from shore.The newly increased high-vulnerability regions within 4 km offshore and below 30 m above sea level are at high risk;these regions may need to focus on strengthening disaster prevention construction.This study serves as a typical example of using remote sensing techniques for the vulnerability assessment of marine disasters,especially those in cloudy coastal areas.展开更多
To evaluate the quality of blurred images effectively,this study proposes a no-reference blur assessment method based on gradient distortion measurement and salient region maps.First,a Gaussian low-pass filter is used...To evaluate the quality of blurred images effectively,this study proposes a no-reference blur assessment method based on gradient distortion measurement and salient region maps.First,a Gaussian low-pass filter is used to construct a reference image by blurring a given image.Gradient similarity is included to obtain the gradient distortion measurement map,which can finely reflect the smallest possible changes in textures and details.Second,a saliency model is utilized to calculate image saliency.Specifically,an adaptive method is used to calculate the specific salient threshold of the blurred image,and the blurred image is binarized to yield the salient region map.Block-wise visual saliency serves as the weight to obtain the final image quality.Experimental results based on the image and video engineering database,categorial image quality database,and camera image database demonstrate that the proposed method correlates well with human judgment.Its computational complexity is also relatively low.展开更多
Traditional image quality assessment methods use the hand-crafted features to predict the image quality score,which cannot perform well in many scenes.Since deep learning promotes the development of many computer visi...Traditional image quality assessment methods use the hand-crafted features to predict the image quality score,which cannot perform well in many scenes.Since deep learning promotes the development of many computer vision tasks,many IQA methods start to utilize the deep convolutional neural networks(CNN)for IQA task.In this paper,a CNN-based multi-scale blind image quality predictor is proposed to extract more effectivity multi-scale distortion features through the pyramidal convolution,which consists of two tasks:A distortion recognition task and a quality regression task.For the first task,image distortion type is obtained by the fully connected layer.For the second task,the image quality score is predicted during the distortion recognition progress.Experimental results on three famous IQA datasets show that the proposed method has better performance than the previous traditional algorithms for quality prediction and distortion recognition.展开更多
Objective image quality assessment(IQA)plays an important role in various visual communication systems,which can automatically and efficiently predict the perceived quality of images.The human eye is the ultimate eval...Objective image quality assessment(IQA)plays an important role in various visual communication systems,which can automatically and efficiently predict the perceived quality of images.The human eye is the ultimate evaluator for visual experience,thus the modeling of human visual system(HVS)is a core issue for objective IQA and visual experience optimization.The traditional model based on black box fitting has low interpretability and it is difficult to guide the experience optimization effectively,while the model based on physiological simulation is hard to integrate into practical visual communication services due to its high computational complexity.For bridging the gap between signal distortion and visual experience,in this paper,we propose a novel perceptual no-reference(NR)IQA algorithm based on structural computational modeling of HVS.According to the mechanism of the human brain,we divide the visual signal processing into a low-level visual layer,a middle-level visual layer and a high-level visual layer,which conduct pixel information processing,primitive information processing and global image information processing,respectively.The natural scene statistics(NSS)based features,deep features and free-energy based features are extracted from these three layers.The support vector regression(SVR)is employed to aggregate features to the final quality prediction.Extensive experimental comparisons on three widely used benchmark IQA databases(LIVE,CSIQ and TID2013)demonstrate that our proposed metric is highly competitive with or outperforms the state-of-the-art NR IQA measures.展开更多
Remote sensing image fusion has come a long way from research experiments to an operational image processing technology.Having established a framework for image fusion at the end of the 90s,we now provide an overview ...Remote sensing image fusion has come a long way from research experiments to an operational image processing technology.Having established a framework for image fusion at the end of the 90s,we now provide an overview on the advances in image fusion during the past 15 years.Assembling information about new remote sensing image fusion techniques,recent technical developments and their influence on image fusion,international societies and working groups,and new journals and publications,we provide insight into new trends.It becomes clear that image fusion facilitates remote sensing image exploitation.It aims at achieving better and more reliable information to better understand complex Earth systems.The numerous publications during the last decade show that remote sensing image fusion is a well-established research field.The experiences gained foster other technological developments in terms of sensor configuration and data exploitation.Multi-modal data usage enables the implementation of the concept of Digital Earth.In order to advance in this respect,we recommend that updated guidelines and a set of commonly accepted quality assessment criteria are needed in image fusion.展开更多
This study compares three types of classifications of satellite data to identify the most suitable for making city maps in a semi-arid region. The source of our data was GeoEye 1 satellite. To classify this data, two ...This study compares three types of classifications of satellite data to identify the most suitable for making city maps in a semi-arid region. The source of our data was GeoEye 1 satellite. To classify this data, two pro-grammes were used: an Object-Based Classification and a Pixel-Based Classification. The second classification programme was further subdi-vided into two groups. The first group included classes (buildings, streets, vacant land, vegetations) which were treated simultaneously and on a single image basis. The second, however, was where each class was identified individually, and the results of each class produced a single image and were later enhanced. The classification results were then as-sessed and compared before and after enhancement using visual then automatic assessment. The results of the evaluation showed that the pix-el-based individual classification of each class was rated the highest after enhancement, increasing the Overall Classification Accuracy by 2%, from 89% to 91.00%. The results of this classification type were adopted for mapping Jeddah’s buildings, roads, and vegetations.展开更多
Technological advancements continue to expand the communications industry’s potential.Images,which are an important component in strengthening communication,are widely available.Therefore,image quality assessment(IQA...Technological advancements continue to expand the communications industry’s potential.Images,which are an important component in strengthening communication,are widely available.Therefore,image quality assessment(IQA)is critical in improving content delivered to end users.Convolutional neural networks(CNNs)used in IQA face two common challenges.One issue is that these methods fail to provide the best representation of the image.The other issue is that the models have a large number of parameters,which easily leads to overfitting.To address these issues,the dense convolution network(DSC-Net),a deep learning model with fewer parameters,is proposed for no-reference image quality assessment(NR-IQA).Moreover,it is obvious that the use of multimodal data for deep learning has improved the performance of applications.As a result,multimodal dense convolution network(MDSC-Net)fuses the texture features extracted using the gray-level co-occurrence matrix(GLCM)method and spatial features extracted using DSC-Net and predicts the image quality.The performance of the proposed framework on the benchmark synthetic datasets LIVE,TID2013,and KADID-10k demonstrates that the MDSC-Net approach achieves good performance over state-of-the-art methods for the NR-IQA task.展开更多
本研究基于水稻孕穗期、抽穗期、灌浆期和成熟期4个生育期的Sentinel-2遥感数据,分析各生育期内卫星遥感光谱参数与稻米品质指标的关系,建立基于各生育期卫星光谱信息的水稻品质指标预测模型。将5种稻米品质指标分别与4个生育期内的光...本研究基于水稻孕穗期、抽穗期、灌浆期和成熟期4个生育期的Sentinel-2遥感数据,分析各生育期内卫星遥感光谱参数与稻米品质指标的关系,建立基于各生育期卫星光谱信息的水稻品质指标预测模型。将5种稻米品质指标分别与4个生育期内的光谱参数进行皮尔逊相关性分析,结果表明,5项品质指标在4个生育期内均与光谱参数有不同程度相关性。然后筛选出相关性效果显著的光谱参数,用于建立各品质指标的预测方程,建模结果表明,基于卫星遥感光谱信息解释率由大到小的稻米品质指标依次是精米率>长宽比>蛋白质含量>直链淀粉含量>糙米率;卫星遥感光谱反演稻米各品质指标所在的最佳生育期不同,糙米率和精米率的最佳生育期为抽穗期,其建模决定系数(Coefficient of Determination,R^(2))分别为0.461和0.893;长宽比的最佳生育期为成熟期,R^(2)为0.878;直链淀粉含量和蛋白质含量的最佳生育期为灌浆期,R^(2)分别为0.646和0.647;基于卫星遥感光谱信息的稻米品质模型验证效果较好,解释率为51%~74%。可见,利用卫星遥感技术能够实现大范围水稻品质指标定量监测与评估。展开更多
针对TDI推扫型光学遥感载荷在轨工作时可能出现的垂轨或沿轨方向图像质量下降现象,提出一种基于在轨MTF测试的单方向可定量图像质量提升方法。首先,采用刃边法测试得到沿轨和垂轨两个方向的MTF曲线,选取从零频到奈奎斯特频率范围内的n...针对TDI推扫型光学遥感载荷在轨工作时可能出现的垂轨或沿轨方向图像质量下降现象,提出一种基于在轨MTF测试的单方向可定量图像质量提升方法。首先,采用刃边法测试得到沿轨和垂轨两个方向的MTF曲线,选取从零频到奈奎斯特频率范围内的n个不同频率点,根据MTF目标值与实测值的比值确定各选定频率点的MTF提升倍数,依据频域响应特性并以提升倍数作为频域响应幅值构建空域卷积函数,同时结合在轨实测信噪比(Signal to Noise Ratio,SNR)构建抑噪函数,在确保SNR的前提下实现的MTF的定量提升。根据在轨试验验证结果表明,按照所提方法进行图像质量提升,在噪声抑制阈值0.5 dB范围内,垂轨方向MTF基本不变,沿轨方向奈奎斯特频率点的MTF提升2.51倍,获取的图像清晰度提升8.33%,证明该方法可有效实现定量图像质量提升。展开更多
基金Supported by the Civil Aerospace"The 12~(th) Five-year Plan"Advanced Research Project(No.D040103)
文摘According to the remote sensing image characteristics, a set oi optimized compression quahty assessment methods is proposed on the basis of generating simulative images. Firstly, a means is put forward that generates simulative images by scanning aerial films taking into account the space-borne remote sensing camera characteristics (including pixel resolution, histogram dynamic range and quantization). In the course of compression quality assessment, the objective assessment considers images texture changes and mutual relationship between simulative images and decompressed ima- ges, while the synthesized estimation factor (SEF) is brought out innovatively for the first time. Subjective assessment adopts a display setup -- 0.5mrn/pixel, which considers human visual char- acteristic and mainstream monitor. The set of methods are applied in compression plan design of panchromatic camera loaded on ZY-1-02C satellite. Through systematic and comprehensive assess- ment, simulation results show that image compression quality with the compression ratio of d:l can meet the remote sensing application requirements.
基金supported in part by the National Natural Science Foundation of China under Grant 61379143in part by the Fundamental Research Funds for the Central Universities under Grant 2015QNA66in part by the Qing Lan Project of Jiangsu Province
文摘Image enhancement is a popular technique,which is widely used to improve the visual quality of images.While image enhancement has been extensively investigated,the relevant quality assessment of enhanced images remains an open problem,which may hinder further development of enhancement techniques.In this paper,a no-reference quality metric for digitally enhanced images is proposed.Three kinds of features are extracted for characterizing the quality of enhanced images,including non-structural information,sharpness and naturalness.Specifically,a total of 42 perceptual features are extracted and used to train a support vector regression(SVR) model.Finally,the trained SVR model is used for predicting the quality of enhanced images.The performance of the proposed method is evaluated on several enhancement-related databases,including a new enhanced image database built by the authors.The experimental results demonstrate the efficiency and advantage of the proposed metric.
基金supported by the National Natural Science Foundation of China under Grants No.61773094,No.61573080,No.91420105,and No.61375115National Program on Key Basic Research Project(973 Program)under Grant No.2013CB329401+1 种基金National High-Tech R&D Program of China(863 Program)under Grant No.2015AA020505Sichuan Province Science and Technology Project under Grants No.2015SZ0141 and No.2018ZA0138
文摘Recent studies on no-reference image quality assessment (NR-IQA) methods usually learn to evaluate the image quality by regressing from human subjective scores of the training samples. This study presented an NR-IQA method based on the basic image visual parameters without using human scored image databases in learning. We demonstrated that these features comprised the most basic characteristics for constructing an image and influencing the visual quality of an image. In this paper, the definitions, computational method, and relationships among these visual metrics were described. We subsequently proposed a no-reference assessment function, which was referred to as a visual parameter measurement index (VPMI), based on the integration of these visual metrics to assess image quality. It is established that the maximum of VPMI corresponds to the best quality of the color image. We verified this method using the popular assessment database—image quality assessment database (LIVE), and the results indicated that the proposed method matched better with the subjective assessment of human vision. Compared with other image quality assessment models, it is highly competitive. VPMI has low computational complexity, which makes it promising to implement in real-time image assessment systems.
文摘In order to apply the deep learning to the stereo image quality evaluation,two problems need to be solved:The first one is that we have a bit of training samples,another is how to input the dimensional image’s left view or right view.In this paper,we transfer the 2D image quality evaluation model to the stereo image quality evaluation,and this method solves the first problem;use the method of principal component analysis is used to fuse the left and right views into an input image in order to solve the second problem.At the same time,the input image is preprocessed by phase congruency transformation,which further improves the performance of the algorithm.The structure of the deep convolution neural network consists of four convolution layers and three maximum pooling layers and two fully connected layers.The experimental results on LIVE3D image database show that the prediction quality score of the model is in good agreement with the subjective evaluation value.
基金This work was funded by the National Natural Science Foundation of China(U1603242)the Major Science and Technology Projects in Inner Mongolia,China(ZDZX2018054).
文摘The Aral Sea Basin in Central Asia is an important geographical environment unit in the center of Eurasia.It is of great significance to the ecological protection and sustainable development of Central Asia to carry out dynamic monitoring and effective evaluation of the eco-environmental quality of the Aral Sea Basin.In this study,the arid remote sensing ecological index(ARSEI)for large-scale arid areas was developed,which coupled the information of the greenness index,the salinity index,the humidity index,the heat index,and the land degradation index of arid areas.The ARSEI was used to monitor and evaluate the eco-environmental quality of the Aral Sea Basin from 2000 to 2019.The results show that the greenness index,the humidity index and the land degradation index had a positive impact on the quality of the ecological environment in the Aral Sea Basin,while the salinity index and the heat index exerted a negative impact on the quality of the ecological environment.The eco-environmental quality of the Aral Sea Basin demonstrated a trend of initial improvement,followed by deterioration,and finally further improvement.The spatial variation of these changes was significant.From 2000 to 2019,grassland and wasteland(saline alkali land and sandy land)in the central and western parts of the basin had the worst ecological environment quality.The areas with poor ecological environment quality are mainly distributed in rivers,wetlands,and cultivated land around lakes.During the period from 2000 to 2019,except for the surrounding areas of the Aral Sea,the ecological environment quality in other areas of the Aral Sea Basin has been improved in general.The correlation coefficients between the change in the eco-environmental quality and the heat index and between the change in the eco-environmental quality and the humidity index were–0.593 and 0.524,respectively.Climate conditions and human activities have led to different combinations of heat and humidity changes in the eco-environmental quality of the Aral Sea Basin.However,human activities had a greater impact.The ARSEI can quantitatively and intuitively reflect the scale and causes of large-scale and long-time period changes of the eco-environmental quality in arid areas;it is very suitable for the study of the eco-environmental quality in arid areas.
基金Supported by the National Key Research and Development Program of China(No.2016YFC1402003)the CAS Earth Big Data Science Project(No.XDA19060303)the Innovation Project of the State Key Laboratory of Resources and Environmental Information System(No.O88RAA01YA)
文摘Efficient and accurate access to coastal land cover information is of great significance for marine disaster prevention and mitigation.Although the popular and common sensors of land resource satellites provide free and valuable images to map the land cover,coastal areas often encounter significant cloud cover,especially in tropical areas,which makes the classification in those areas non-ideal.To solve this problem,we proposed a framework of combining medium-resolution optical images and synthetic aperture radar(SAR)data with the recently popular object-based image analysis(OBIA)method and used the Landsat Operational Land Imager(OLI)and Phased Array type L-band Synthetic Aperture Radar(PALSAR)images acquired in Singapore in 2017 as a case study.We designed experiments to confirm two critical factors of this framework:one is the segmentation scale that determines the average object size,and the other is the classification feature.Accuracy assessments of the land cover indicated that the optimal segmentation scale was between 40 and 80,and the features of the combination of OLI and SAR resulted in higher accuracy than any individual features,especially in areas with cloud cover.Based on the land cover generated by this framework,we assessed the vulnerability of the marine disasters of Singapore in 2008 and 2017 and found that the high-vulnerability areas mainly located in the southeast and increased by 118.97 km2 over the past decade.To clarify the disaster response plan for different geographical environments,we classified risk based on altitude and distance from shore.The newly increased high-vulnerability regions within 4 km offshore and below 30 m above sea level are at high risk;these regions may need to focus on strengthening disaster prevention construction.This study serves as a typical example of using remote sensing techniques for the vulnerability assessment of marine disasters,especially those in cloudy coastal areas.
基金The National Natural Science Foundation of China(No.61762004,61762005)the National Key Research and Development Program(No.2018YFB1702700)+1 种基金the Science and Technology Project Founded by the Education Department of Jiangxi Province,China(No.GJJ200702,GJJ200746)the Open Fund Project of Jiangxi Engineering Laboratory on Radioactive Geoscience and Big Data Technology(No.JETRCNGDSS201901,JELRGBDT202001,JELRGBDT202003).
文摘To evaluate the quality of blurred images effectively,this study proposes a no-reference blur assessment method based on gradient distortion measurement and salient region maps.First,a Gaussian low-pass filter is used to construct a reference image by blurring a given image.Gradient similarity is included to obtain the gradient distortion measurement map,which can finely reflect the smallest possible changes in textures and details.Second,a saliency model is utilized to calculate image saliency.Specifically,an adaptive method is used to calculate the specific salient threshold of the blurred image,and the blurred image is binarized to yield the salient region map.Block-wise visual saliency serves as the weight to obtain the final image quality.Experimental results based on the image and video engineering database,categorial image quality database,and camera image database demonstrate that the proposed method correlates well with human judgment.Its computational complexity is also relatively low.
文摘Traditional image quality assessment methods use the hand-crafted features to predict the image quality score,which cannot perform well in many scenes.Since deep learning promotes the development of many computer vision tasks,many IQA methods start to utilize the deep convolutional neural networks(CNN)for IQA task.In this paper,a CNN-based multi-scale blind image quality predictor is proposed to extract more effectivity multi-scale distortion features through the pyramidal convolution,which consists of two tasks:A distortion recognition task and a quality regression task.For the first task,image distortion type is obtained by the fully connected layer.For the second task,the image quality score is predicted during the distortion recognition progress.Experimental results on three famous IQA datasets show that the proposed method has better performance than the previous traditional algorithms for quality prediction and distortion recognition.
基金This work was supported by National Natural Science Foundation of China(Nos.61831015 and 61901260)Key Research and Development Program of China(No.2019YFB1405902).
文摘Objective image quality assessment(IQA)plays an important role in various visual communication systems,which can automatically and efficiently predict the perceived quality of images.The human eye is the ultimate evaluator for visual experience,thus the modeling of human visual system(HVS)is a core issue for objective IQA and visual experience optimization.The traditional model based on black box fitting has low interpretability and it is difficult to guide the experience optimization effectively,while the model based on physiological simulation is hard to integrate into practical visual communication services due to its high computational complexity.For bridging the gap between signal distortion and visual experience,in this paper,we propose a novel perceptual no-reference(NR)IQA algorithm based on structural computational modeling of HVS.According to the mechanism of the human brain,we divide the visual signal processing into a low-level visual layer,a middle-level visual layer and a high-level visual layer,which conduct pixel information processing,primitive information processing and global image information processing,respectively.The natural scene statistics(NSS)based features,deep features and free-energy based features are extracted from these three layers.The support vector regression(SVR)is employed to aggregate features to the final quality prediction.Extensive experimental comparisons on three widely used benchmark IQA databases(LIVE,CSIQ and TID2013)demonstrate that our proposed metric is highly competitive with or outperforms the state-of-the-art NR IQA measures.
文摘Remote sensing image fusion has come a long way from research experiments to an operational image processing technology.Having established a framework for image fusion at the end of the 90s,we now provide an overview on the advances in image fusion during the past 15 years.Assembling information about new remote sensing image fusion techniques,recent technical developments and their influence on image fusion,international societies and working groups,and new journals and publications,we provide insight into new trends.It becomes clear that image fusion facilitates remote sensing image exploitation.It aims at achieving better and more reliable information to better understand complex Earth systems.The numerous publications during the last decade show that remote sensing image fusion is a well-established research field.The experiences gained foster other technological developments in terms of sensor configuration and data exploitation.Multi-modal data usage enables the implementation of the concept of Digital Earth.In order to advance in this respect,we recommend that updated guidelines and a set of commonly accepted quality assessment criteria are needed in image fusion.
文摘This study compares three types of classifications of satellite data to identify the most suitable for making city maps in a semi-arid region. The source of our data was GeoEye 1 satellite. To classify this data, two pro-grammes were used: an Object-Based Classification and a Pixel-Based Classification. The second classification programme was further subdi-vided into two groups. The first group included classes (buildings, streets, vacant land, vegetations) which were treated simultaneously and on a single image basis. The second, however, was where each class was identified individually, and the results of each class produced a single image and were later enhanced. The classification results were then as-sessed and compared before and after enhancement using visual then automatic assessment. The results of the evaluation showed that the pix-el-based individual classification of each class was rated the highest after enhancement, increasing the Overall Classification Accuracy by 2%, from 89% to 91.00%. The results of this classification type were adopted for mapping Jeddah’s buildings, roads, and vegetations.
文摘Technological advancements continue to expand the communications industry’s potential.Images,which are an important component in strengthening communication,are widely available.Therefore,image quality assessment(IQA)is critical in improving content delivered to end users.Convolutional neural networks(CNNs)used in IQA face two common challenges.One issue is that these methods fail to provide the best representation of the image.The other issue is that the models have a large number of parameters,which easily leads to overfitting.To address these issues,the dense convolution network(DSC-Net),a deep learning model with fewer parameters,is proposed for no-reference image quality assessment(NR-IQA).Moreover,it is obvious that the use of multimodal data for deep learning has improved the performance of applications.As a result,multimodal dense convolution network(MDSC-Net)fuses the texture features extracted using the gray-level co-occurrence matrix(GLCM)method and spatial features extracted using DSC-Net and predicts the image quality.The performance of the proposed framework on the benchmark synthetic datasets LIVE,TID2013,and KADID-10k demonstrates that the MDSC-Net approach achieves good performance over state-of-the-art methods for the NR-IQA task.
文摘本研究基于水稻孕穗期、抽穗期、灌浆期和成熟期4个生育期的Sentinel-2遥感数据,分析各生育期内卫星遥感光谱参数与稻米品质指标的关系,建立基于各生育期卫星光谱信息的水稻品质指标预测模型。将5种稻米品质指标分别与4个生育期内的光谱参数进行皮尔逊相关性分析,结果表明,5项品质指标在4个生育期内均与光谱参数有不同程度相关性。然后筛选出相关性效果显著的光谱参数,用于建立各品质指标的预测方程,建模结果表明,基于卫星遥感光谱信息解释率由大到小的稻米品质指标依次是精米率>长宽比>蛋白质含量>直链淀粉含量>糙米率;卫星遥感光谱反演稻米各品质指标所在的最佳生育期不同,糙米率和精米率的最佳生育期为抽穗期,其建模决定系数(Coefficient of Determination,R^(2))分别为0.461和0.893;长宽比的最佳生育期为成熟期,R^(2)为0.878;直链淀粉含量和蛋白质含量的最佳生育期为灌浆期,R^(2)分别为0.646和0.647;基于卫星遥感光谱信息的稻米品质模型验证效果较好,解释率为51%~74%。可见,利用卫星遥感技术能够实现大范围水稻品质指标定量监测与评估。
文摘针对TDI推扫型光学遥感载荷在轨工作时可能出现的垂轨或沿轨方向图像质量下降现象,提出一种基于在轨MTF测试的单方向可定量图像质量提升方法。首先,采用刃边法测试得到沿轨和垂轨两个方向的MTF曲线,选取从零频到奈奎斯特频率范围内的n个不同频率点,根据MTF目标值与实测值的比值确定各选定频率点的MTF提升倍数,依据频域响应特性并以提升倍数作为频域响应幅值构建空域卷积函数,同时结合在轨实测信噪比(Signal to Noise Ratio,SNR)构建抑噪函数,在确保SNR的前提下实现的MTF的定量提升。根据在轨试验验证结果表明,按照所提方法进行图像质量提升,在噪声抑制阈值0.5 dB范围内,垂轨方向MTF基本不变,沿轨方向奈奎斯特频率点的MTF提升2.51倍,获取的图像清晰度提升8.33%,证明该方法可有效实现定量图像质量提升。