MODIS (Moderate Resolution Imaging Spectroradiometer) is a key instrument aboard the Terra (EOS AM) and Aqua (EOS PM) satellites. Linear spectral mixture models are applied to MOIDS data for the sub-pixel classi...MODIS (Moderate Resolution Imaging Spectroradiometer) is a key instrument aboard the Terra (EOS AM) and Aqua (EOS PM) satellites. Linear spectral mixture models are applied to MOIDS data for the sub-pixel classification of land covers. Shaoxing county of Zhejiang Province in China was chosen to be the study site and early rice was selected as the study crop. The derived proportions of land covers from MODIS pixel using linear spectral mixture models were compared with unsupervised classification derived from TM data acquired on the same day, which implies that MODIS data could be used as satellite data source for rice cultivation area estimation, possibly rice growth monitoring and yield forecasting on the regional scale.展开更多
Coded apertures with random patterns are extensively used in compressive spectral imagers to sample the incident scene in the image plane.Random samplings,however,are inadequate to capture the structural characteristi...Coded apertures with random patterns are extensively used in compressive spectral imagers to sample the incident scene in the image plane.Random samplings,however,are inadequate to capture the structural characteristics of the underlying signal due to the sparsity and structure nature of sensing matrices in spectral imagers.This paper proposes a new approach for super-resolution compressive spectral imaging via adaptive coding.In this method,coded apertures are optimally designed based on a two-tone adaptive compressive sensing(CS)framework to improve the reconstruction resolution and accuracy of the hyperspectral imager.A liquid crystal tunable filter(LCTF)is used to scan the incident scene in the spectral domain to successively select different spectral channels.The output of the LCTF is modulated by the adaptive coded aperture patterns and then projected onto a lowresolution detector array.The coded aperture patterns are implemented by a digital micromirror device(DMD)with higher resolution than that of the detector.Due to the strong correlation across the spectra,the recovered images from previous spectral channels can be used as a priori information to design the adaptive coded apertures for sensing subsequent spectral channels.In particular,the coded apertures are constructed from the a priori spectral images via a two-tone hard thresholding operation that respectively extracts the structural characteristics of bright and dark regions in the underlying scenes.Super-resolution image reconstruction within a spectral channel can be recovered from a few snapshots of low-resolution measurements.Since no additional side information of the spectral scene is needed,the proposed method does not increase the system complexity.Based on the mutual-coherence criterion,the proposed adaptive CS framework is proved theoretically to promote the sensing efficiency of the spectral images.Simulations and experiments are provided to demonstrate and assess the proposed adaptive coding method.Finally,the underlying concepts are extended to a multi-channel method to compress the hyperspectral data cube in the spatial and spectral domains simultaneously.展开更多
Vegetation is crucial for wetland ecosystems.Human activities and climate changes are increasingly threatening wetland ecosystems.Combining satellite images and deep learning for classifying marsh vegetation communiti...Vegetation is crucial for wetland ecosystems.Human activities and climate changes are increasingly threatening wetland ecosystems.Combining satellite images and deep learning for classifying marsh vegetation communities has faced great challenges because of its coarse spatial resolution and limited spectral bands.This study aimed to propose a method to classify marsh vegetation using multi-resolution multispectral and hyperspectral images,combining super-resolution techniques and a novel self-constructing graph attention neural network(SGA-Net)algorithm.The SGA-Net algorithm includes a decoding layer(SCE-Net)to preciselyfine marsh vegetation classification in Honghe National Nature Reserve,Northeast China.The results indicated that the hyperspectral reconstruction images based on the super-resolution convolutional neural network(SRCNN)obtained higher accuracy with a peak signal-to-noise ratio(PSNR)of 28.87 and structural similarity(SSIM)of 0.76 in spatial quality and root mean squared error(RMSE)of 0.11 and R^(2) of 0.63 in spectral quality.The improvement of classification accuracy(MIoU)by enhanced super-resolution generative adversarial network(ESRGAN)(6.19%)was greater than that of SRCNN(4.33%)and super-resolution generative adversarial network(SRGAN)(3.64%).In most classification schemes,the SGA-Net outperformed DeepLabV3+and SegFormer algorithms for marsh vegetation and achieved the highest F1-score(78.47%).This study demonstrated that collaborative use of super-resolution reconstruction and deep learning is an effective approach for marsh vegetation mapping.展开更多
In recent decades,materials science has experienced rapid development and posed increasingly high requirements for the characterizations of structures,properties,and performances.Herein,we report on our recent establi...In recent decades,materials science has experienced rapid development and posed increasingly high requirements for the characterizations of structures,properties,and performances.Herein,we report on our recent establishment of a multi-domain(energy,space,time)highresolution platform for integrated spectroscopy and microscopy characterizations,offering an unprecedented way to analyze materials in terms of spectral(energy)and spatial mapping as well as temporal evolution.We present several proof-of-principle results collected on this platform,including in-situ Raman imaging(high-resolution Raman,polarization Raman,low-wavenumber Raman),time-resolved photoluminescence imaging,and photoelectrical performance imaging.It can be envisioned that our newly established platform would be very powerful and effective in the multi-domain high-resolution characterizations of various materials of photoelectrochemical importance in the near future.展开更多
This paper designs a 3 mm radiometer and validate with experiments based on the principle of passive millimeter wave (PMMW) imaging. The poor spatial resolution, which is limited by antenna size, should be improved ...This paper designs a 3 mm radiometer and validate with experiments based on the principle of passive millimeter wave (PMMW) imaging. The poor spatial resolution, which is limited by antenna size, should be improved by post data processing. A conjugate-gradient (CG) algorithm is adopted to circumvent this drawback. Simulation and real data collected in laboratory environment are given, and the results show that the CG algorithm improves the spatial resolution and convergent rate. Further, it can reduce the ringing effects which are caused by regularizing the image restoration. Thus, the CG algorithm is easily implemented for PMMW imaging.展开更多
Passive millimeter wave (PMMW) images inherently have the problem of poor resolution owing to limited aperture dimension. Thus, efficient post-processing is necessary to achieve resolution improvement. An adaptive p...Passive millimeter wave (PMMW) images inherently have the problem of poor resolution owing to limited aperture dimension. Thus, efficient post-processing is necessary to achieve resolution improvement. An adaptive projected Landweber (APL) super-resolution algorithm using a spectral correction procedure, which attempts to combine the strong points of all of the projected Landweber (PL) iteration and the adaptive relaxation parameter adjustment and the spectral correction method, is proposed. In the algorithm, the PL iterations are implemented as the main image restoration scheme and a spectral correction method is included in which the calculated spectrum within the passband is replaced by the known low frequency component. Then, the algorithm updates the relaxation parameter adaptively at each iteration. A qualitative evaluation of this algorithm is performed with simulated data as well as actual radiometer image captured by 91.5 GHz mechanically scanned radiometer. From experiments, it is found that the super-resolution algorithm obtains better results and enhances the resolution and has lower mean square error (MSE). These constraints and adaptive character and spectral correction procedures speed up the convergence of the Landweber algorithm and reduce the ringing effects that are caused by regularizing the image restoration problem.展开更多
A new method based on resolution degradation model is proposed to improve both spatial and spectral quality of the synthetic images. Some ETM+ panchromatic and multispectral images are used to assess the new method. I...A new method based on resolution degradation model is proposed to improve both spatial and spectral quality of the synthetic images. Some ETM+ panchromatic and multispectral images are used to assess the new method. Its spatial and spectral effects are evaluated by qualitative and quantitative measures and the results are compared with those of IHS, PCA, Brovey, OWT(Orthogonal Wavelet Transform) and RWT(Redundant Wavelet Transform). The results show that the new method can keep almost the same spatial resolution as the panchromatic images, and the spectral effect of the new method is as good as those of wavelet-based methods.展开更多
High Spatial and Spectral Resolution(HSSR)remote-sensing images can provide rich spectral bands and detailed ground information,but there is a relative lack of research on this new type of remote-sensing data.Although...High Spatial and Spectral Resolution(HSSR)remote-sensing images can provide rich spectral bands and detailed ground information,but there is a relative lack of research on this new type of remote-sensing data.Although there are already some HSSR datasets for deep learning model training and testing,the data volume of these datasets is small,resulting in low classification accuracy and weak generalization ability of the trained models.In this paper,an HSSR dataset Luojia-HSSR is constructed based on aerial hyperspectral imagery of southern Shenyang City of Liaoning Province in China.To our knowledge,it is the largest HSSR dataset to date,with 6438 pairs of 256×256 sized samples(including 3480 pairs in the training set,2209 pairs in the test set,and 749 pairs in the validation set),covering area of 161 km2 with spatial resolution 0.75 m,249 Visible and Near-Infrared(VNIR)spectral bands,and corresponding to 23 classes of field-validated ground coverage.It is an ideal experimental data for spatial-spectral feature extraction.Furthermore,a new deep learning model 3D-HRNet for interpreting HSSR images is proposed.The conv-neck in HRNet is modified to better mine the spatial information of the images.Then,a 3D convolution module with attention mechanism is designed to capture the global-local fine spectral information simultaneously.Subsequently,the 3D convolution is inserted into the HRNet to optimize the performance.The experiments show that the 3D-HRNet model has good interpreting ability for the Luojia-HSSR dataset with the Frequency Weighted Intersection over Union(FWIoU)reaching 80.54%,indicating that the Luojia-HSSR dataset constructed in this paper and the proposed 3D-HRnet model have good applicable prospects for processing HSSR remote sensing images.展开更多
文摘MODIS (Moderate Resolution Imaging Spectroradiometer) is a key instrument aboard the Terra (EOS AM) and Aqua (EOS PM) satellites. Linear spectral mixture models are applied to MOIDS data for the sub-pixel classification of land covers. Shaoxing county of Zhejiang Province in China was chosen to be the study site and early rice was selected as the study crop. The derived proportions of land covers from MODIS pixel using linear spectral mixture models were compared with unsupervised classification derived from TM data acquired on the same day, which implies that MODIS data could be used as satellite data source for rice cultivation area estimation, possibly rice growth monitoring and yield forecasting on the regional scale.
基金National Natural Science Foundation of China(61371132,61471043,61527802)International S&T Cooperation Program of China(2014DFR10960)。
文摘Coded apertures with random patterns are extensively used in compressive spectral imagers to sample the incident scene in the image plane.Random samplings,however,are inadequate to capture the structural characteristics of the underlying signal due to the sparsity and structure nature of sensing matrices in spectral imagers.This paper proposes a new approach for super-resolution compressive spectral imaging via adaptive coding.In this method,coded apertures are optimally designed based on a two-tone adaptive compressive sensing(CS)framework to improve the reconstruction resolution and accuracy of the hyperspectral imager.A liquid crystal tunable filter(LCTF)is used to scan the incident scene in the spectral domain to successively select different spectral channels.The output of the LCTF is modulated by the adaptive coded aperture patterns and then projected onto a lowresolution detector array.The coded aperture patterns are implemented by a digital micromirror device(DMD)with higher resolution than that of the detector.Due to the strong correlation across the spectra,the recovered images from previous spectral channels can be used as a priori information to design the adaptive coded apertures for sensing subsequent spectral channels.In particular,the coded apertures are constructed from the a priori spectral images via a two-tone hard thresholding operation that respectively extracts the structural characteristics of bright and dark regions in the underlying scenes.Super-resolution image reconstruction within a spectral channel can be recovered from a few snapshots of low-resolution measurements.Since no additional side information of the spectral scene is needed,the proposed method does not increase the system complexity.Based on the mutual-coherence criterion,the proposed adaptive CS framework is proved theoretically to promote the sensing efficiency of the spectral images.Simulations and experiments are provided to demonstrate and assess the proposed adaptive coding method.Finally,the underlying concepts are extended to a multi-channel method to compress the hyperspectral data cube in the spatial and spectral domains simultaneously.
基金supported by National Natural Science Foundation of China:[Grant Number 21976043,42122009]Guangxi Science&Technology Program:[Grant Number GuikeAD20159037]+1 种基金‘Ba Gui Scholars’program of the provincial government of Guangxi,and the Guilin University of Technology Foundation:[Grant Number GUTQDJJ2017096]Innovation Project of Guangxi Graduate Education:[Grant Number YCSW2022328].
文摘Vegetation is crucial for wetland ecosystems.Human activities and climate changes are increasingly threatening wetland ecosystems.Combining satellite images and deep learning for classifying marsh vegetation communities has faced great challenges because of its coarse spatial resolution and limited spectral bands.This study aimed to propose a method to classify marsh vegetation using multi-resolution multispectral and hyperspectral images,combining super-resolution techniques and a novel self-constructing graph attention neural network(SGA-Net)algorithm.The SGA-Net algorithm includes a decoding layer(SCE-Net)to preciselyfine marsh vegetation classification in Honghe National Nature Reserve,Northeast China.The results indicated that the hyperspectral reconstruction images based on the super-resolution convolutional neural network(SRCNN)obtained higher accuracy with a peak signal-to-noise ratio(PSNR)of 28.87 and structural similarity(SSIM)of 0.76 in spatial quality and root mean squared error(RMSE)of 0.11 and R^(2) of 0.63 in spectral quality.The improvement of classification accuracy(MIoU)by enhanced super-resolution generative adversarial network(ESRGAN)(6.19%)was greater than that of SRCNN(4.33%)and super-resolution generative adversarial network(SRGAN)(3.64%).In most classification schemes,the SGA-Net outperformed DeepLabV3+and SegFormer algorithms for marsh vegetation and achieved the highest F1-score(78.47%).This study demonstrated that collaborative use of super-resolution reconstruction and deep learning is an effective approach for marsh vegetation mapping.
基金supported by the National Key Research and Development Program of China(No.2016YFA0200602,No.2017YFA0303500,and No.2018YFA0208702)the National Natural Science Foundation of China(No.21573211,No.21633007,No.21803067,and No.91950207)+1 种基金the Anhui Initiative in Quantum Information Technologies(AHY090200)the USTC-NSRL Joint Funds(UN2018LHJJ).
文摘In recent decades,materials science has experienced rapid development and posed increasingly high requirements for the characterizations of structures,properties,and performances.Herein,we report on our recent establishment of a multi-domain(energy,space,time)highresolution platform for integrated spectroscopy and microscopy characterizations,offering an unprecedented way to analyze materials in terms of spectral(energy)and spatial mapping as well as temporal evolution.We present several proof-of-principle results collected on this platform,including in-situ Raman imaging(high-resolution Raman,polarization Raman,low-wavenumber Raman),time-resolved photoluminescence imaging,and photoelectrical performance imaging.It can be envisioned that our newly established platform would be very powerful and effective in the multi-domain high-resolution characterizations of various materials of photoelectrochemical importance in the near future.
基金supported partly by the State Key Program of National Natural Science Foundation of China(60632020)the Youth Science Foundation of University of Electronic Science and Technology of China(JX0823).
文摘This paper designs a 3 mm radiometer and validate with experiments based on the principle of passive millimeter wave (PMMW) imaging. The poor spatial resolution, which is limited by antenna size, should be improved by post data processing. A conjugate-gradient (CG) algorithm is adopted to circumvent this drawback. Simulation and real data collected in laboratory environment are given, and the results show that the CG algorithm improves the spatial resolution and convergent rate. Further, it can reduce the ringing effects which are caused by regularizing the image restoration. Thus, the CG algorithm is easily implemented for PMMW imaging.
基金the National Natural Science Foundation of China (60632020).
文摘Passive millimeter wave (PMMW) images inherently have the problem of poor resolution owing to limited aperture dimension. Thus, efficient post-processing is necessary to achieve resolution improvement. An adaptive projected Landweber (APL) super-resolution algorithm using a spectral correction procedure, which attempts to combine the strong points of all of the projected Landweber (PL) iteration and the adaptive relaxation parameter adjustment and the spectral correction method, is proposed. In the algorithm, the PL iterations are implemented as the main image restoration scheme and a spectral correction method is included in which the calculated spectrum within the passband is replaced by the known low frequency component. Then, the algorithm updates the relaxation parameter adaptively at each iteration. A qualitative evaluation of this algorithm is performed with simulated data as well as actual radiometer image captured by 91.5 GHz mechanically scanned radiometer. From experiments, it is found that the super-resolution algorithm obtains better results and enhances the resolution and has lower mean square error (MSE). These constraints and adaptive character and spectral correction procedures speed up the convergence of the Landweber algorithm and reduce the ringing effects that are caused by regularizing the image restoration problem.
文摘A new method based on resolution degradation model is proposed to improve both spatial and spectral quality of the synthetic images. Some ETM+ panchromatic and multispectral images are used to assess the new method. Its spatial and spectral effects are evaluated by qualitative and quantitative measures and the results are compared with those of IHS, PCA, Brovey, OWT(Orthogonal Wavelet Transform) and RWT(Redundant Wavelet Transform). The results show that the new method can keep almost the same spatial resolution as the panchromatic images, and the spectral effect of the new method is as good as those of wavelet-based methods.
基金Supported by the Foundation of Anhui Province Key Laboratory of Physical Geographic Environment(2022PGE010)The Fundamental Research Funds for the Central Universities,CHD(300102353508)+5 种基金the Key Laboratory of Southeast Coast Marine Information Intelligent Perception and Application,MNR(22101)National Natural Science Foundation of China(61801211)Natural Science Foundation of Jiangsu Province(BK20221478)Hong Kong Scholars Program(XJ2022043)S&T Program of Hebei(21567624H)Open Project Program of Key Laboratory of Meteorology and Ecological Environment of Hebei Province(Z202102YH)。
基金supported by the Major Program of the National Natural Science Foundation of China[grant number 92038301]The research was also supported by the National Natural Science Foundation of China[grant number 41971295]+1 种基金the Foundation for Innovative Research Groups of the Natural Science Foundation of Hubei Province[grant number 2020CFA003]the Special Fund of Hubei Luojia Laboratory.
文摘High Spatial and Spectral Resolution(HSSR)remote-sensing images can provide rich spectral bands and detailed ground information,but there is a relative lack of research on this new type of remote-sensing data.Although there are already some HSSR datasets for deep learning model training and testing,the data volume of these datasets is small,resulting in low classification accuracy and weak generalization ability of the trained models.In this paper,an HSSR dataset Luojia-HSSR is constructed based on aerial hyperspectral imagery of southern Shenyang City of Liaoning Province in China.To our knowledge,it is the largest HSSR dataset to date,with 6438 pairs of 256×256 sized samples(including 3480 pairs in the training set,2209 pairs in the test set,and 749 pairs in the validation set),covering area of 161 km2 with spatial resolution 0.75 m,249 Visible and Near-Infrared(VNIR)spectral bands,and corresponding to 23 classes of field-validated ground coverage.It is an ideal experimental data for spatial-spectral feature extraction.Furthermore,a new deep learning model 3D-HRNet for interpreting HSSR images is proposed.The conv-neck in HRNet is modified to better mine the spatial information of the images.Then,a 3D convolution module with attention mechanism is designed to capture the global-local fine spectral information simultaneously.Subsequently,the 3D convolution is inserted into the HRNet to optimize the performance.The experiments show that the 3D-HRNet model has good interpreting ability for the Luojia-HSSR dataset with the Frequency Weighted Intersection over Union(FWIoU)reaching 80.54%,indicating that the Luojia-HSSR dataset constructed in this paper and the proposed 3D-HRnet model have good applicable prospects for processing HSSR remote sensing images.
基金supported by the National Defense Science and Technology Foundation Strengthening Program(No.2021-JCJQ-JJ-0834)the Fundamental Research Funds for the Central Universities(Nos.NJ2022025,NP2022450)。