Facing the very high-resolution( VHR) image classification problem,a feature extraction and fusion framework is presented for VHR panchromatic and multispectral image classification based on deep learning techniques. ...Facing the very high-resolution( VHR) image classification problem,a feature extraction and fusion framework is presented for VHR panchromatic and multispectral image classification based on deep learning techniques. The proposed approach combines spectral and spatial information based on the fusion of features extracted from panchromatic( PAN) and multispectral( MS) images using sparse autoencoder and its deep version. There are three steps in the proposed method,the first one is to extract spatial information of PAN image,and the second one is to describe spectral information of MS image. Finally,in the third step,the features obtained from PAN and MS images are concatenated directly as a simple fusion feature. The classification is performed using the support vector machine( SVM) and the experiments carried out on two datasets with very high spatial resolution. MS and PAN images from WorldView-2 satellite indicate that the classifier provides an efficient solution and demonstrate that the fusion of the features extracted by deep learning techniques from PAN and MS images performs better than that when these techniques are used separately. In addition,this framework shows that deep learning models can extract and fuse spatial and spectral information greatly,and have huge potential to achieve higher accuracy for classification of multispectral and panchromatic images.展开更多
A novel fusion method of multispectral image and panchromatic image based on nonsubsampled contourlet transform(NSCT) and non-negative matrix factorization(NMF) is presented,the aim of which is to preserve both spectr...A novel fusion method of multispectral image and panchromatic image based on nonsubsampled contourlet transform(NSCT) and non-negative matrix factorization(NMF) is presented,the aim of which is to preserve both spectral and spatial information simultaneously in fused image.NMF is a matrix factorization method,which can extract the local feature by choosing suitable dimension of the feature subspace.Firstly the multispectral image was represented in intensity hue saturation(IHS) system.Then the I component and panchromatic image were decomposed by NSCT.Next we used NMF to learn the feature of both multispectral and panchromatic images' low-frequency subbands,and the selection principle of the other coefficients was absolute maximum criterion.Finally the new coefficients were reconstructed to get the fused image.Experiments are carried out and the results are compared with some other methods,which show that the new method performs better in improving the spatial resolution and preserving the feature information than the other existing relative methods.展开更多
The practice of integrating images from two or more sensors collected from the same area or object is known as image fusion.The goal is to extract more spatial and spectral information from the resulting fused image t...The practice of integrating images from two or more sensors collected from the same area or object is known as image fusion.The goal is to extract more spatial and spectral information from the resulting fused image than from the component images.The images must be fused to improve the spatial and spectral quality of both panchromatic and multispectral images.This study provides a novel picture fusion technique that employs L0 smoothening Filter,Non-subsampled Contour let Transform(NSCT)and Sparse Representation(SR)followed by the Max absolute rule(MAR).The fusion approach is as follows:first,the multispectral and panchromatic images are divided into lower and higher frequency components using the L0 smoothing filter.Then comes the fusion process,which uses an approach that combines NSCT and SR to fuse low frequency components.Similarly,the Max-absolute fusion rule is used to merge high frequency components.Finally,the final image is obtained through the disintegration of fused low and high frequency data.In terms of correlation coefficient,Entropy,spatial frequency,and fusion mutual information,our method outperforms other methods in terms of image quality enhancement and visual evaluation.展开更多
A pan-sharpen technique artificially produces a high-resolution image by image fusion techniques using high-resolution panchromatic and low-resolution multispectral images. Thus, the appearance of the color image can ...A pan-sharpen technique artificially produces a high-resolution image by image fusion techniques using high-resolution panchromatic and low-resolution multispectral images. Thus, the appearance of the color image can improve. In this paper, the effectiveness of three pan-sharpening methods based on the HSI transform approach is investigated. Three models are the hexcone, double hexcones, and Haydn’s approach. Furthermore, the effect of smoothing the low-resolution multispectral image is also investigated. The smoothing techniques are the Gaussian filter and the bilateral filter. The experimental results show that Haydn’s model is superior to others. The effectiveness of smoothing the low-resolution multispectral image is also shown.展开更多
Remote Sensing image fusion is an effective way to use the large volume of data from multi-source images.This paper introduces a new method of remote sensing image fusion based on support vector machine(SVM),using hig...Remote Sensing image fusion is an effective way to use the large volume of data from multi-source images.This paper introduces a new method of remote sensing image fusion based on support vector machine(SVM),using high spatial resolution data SPIN-2and multi-spectral remote sensing data S POT-4.Firstly,the new method is established by building a model of remote sensing im age fusion based on SVM.Then by using SPIN-2data and SPOT-4data,image classifi-cation fusion is tested.Finally,an evaluation of the fusion result is ma de in two ways.1)From subjectivity assessment,the spatial resolution of the fused i mage is improved compared to the SPOT-4.And it is clearly that the texture of the fused image is distinctive.2)From quantitative analysis,the effect of classification fusion is bett er.As a whole,the re-sult shows that the accuracy of image fusion based on SVMis high and the SVM algorithm can be recommended for app lica-tion in remote sensing image fusion p rocesses.展开更多
Pancreatic endocrine tumors are rare but are among the most common neuroendocrine neoplasms of the abdomen.At diagnosis many of them are already advanced and diff icult to treat.We report on an initially inoperable ma...Pancreatic endocrine tumors are rare but are among the most common neuroendocrine neoplasms of the abdomen.At diagnosis many of them are already advanced and diff icult to treat.We report on an initially inoperable malignant pancreatic endocrine tumor in a 33-year-old woman,who received neoadjuvant peptide receptor radionuclide therapy(PRRT)as firstline treatment.This resulted in a signif icant downstaging of the tumor and allowed its subsequent complete surgical removal.Follow-up for eighteen months revealed a complete remission.This is the first report on neoadjuvant PRRT in a neuroendocrine neoplasm with subsequent successful complete resection.展开更多
Pan-sharpening is a process of obtaining a high spatial and spectral multispectral image(HMS)by combining a low-resolution multispectral image(LMS)with a high-resolution panchromatic image(PAN).In this paper,a pan-sha...Pan-sharpening is a process of obtaining a high spatial and spectral multispectral image(HMS)by combining a low-resolution multispectral image(LMS)with a high-resolution panchromatic image(PAN).In this paper,a pan-sharpening method called PAIHS is proposed,which is based on adaptive intensity-hue-saturation(AIHS)transformation,variational pan-sharpening framework and the two fidelity hypotheses.The suitable objective function is established and optimized by adopting particle swarm optimization(PSO)to obtain the optimal control parameters and minimum value.This value corresponds to the best pan-sharpening quality.The experimental results show that the proposed method has high efficiency and reliability,and the obtained performance index is superior to the four mainstream pan-sharpening methods.展开更多
基金Supported by the National Natural Science Foundation of China(No.61472103,61772158,U.1711265)
文摘Facing the very high-resolution( VHR) image classification problem,a feature extraction and fusion framework is presented for VHR panchromatic and multispectral image classification based on deep learning techniques. The proposed approach combines spectral and spatial information based on the fusion of features extracted from panchromatic( PAN) and multispectral( MS) images using sparse autoencoder and its deep version. There are three steps in the proposed method,the first one is to extract spatial information of PAN image,and the second one is to describe spectral information of MS image. Finally,in the third step,the features obtained from PAN and MS images are concatenated directly as a simple fusion feature. The classification is performed using the support vector machine( SVM) and the experiments carried out on two datasets with very high spatial resolution. MS and PAN images from WorldView-2 satellite indicate that the classifier provides an efficient solution and demonstrate that the fusion of the features extracted by deep learning techniques from PAN and MS images performs better than that when these techniques are used separately. In addition,this framework shows that deep learning models can extract and fuse spatial and spectral information greatly,and have huge potential to achieve higher accuracy for classification of multispectral and panchromatic images.
基金Supported by the National Natural Science Foundation of China(60872065)
文摘A novel fusion method of multispectral image and panchromatic image based on nonsubsampled contourlet transform(NSCT) and non-negative matrix factorization(NMF) is presented,the aim of which is to preserve both spectral and spatial information simultaneously in fused image.NMF is a matrix factorization method,which can extract the local feature by choosing suitable dimension of the feature subspace.Firstly the multispectral image was represented in intensity hue saturation(IHS) system.Then the I component and panchromatic image were decomposed by NSCT.Next we used NMF to learn the feature of both multispectral and panchromatic images' low-frequency subbands,and the selection principle of the other coefficients was absolute maximum criterion.Finally the new coefficients were reconstructed to get the fused image.Experiments are carried out and the results are compared with some other methods,which show that the new method performs better in improving the spatial resolution and preserving the feature information than the other existing relative methods.
文摘The practice of integrating images from two or more sensors collected from the same area or object is known as image fusion.The goal is to extract more spatial and spectral information from the resulting fused image than from the component images.The images must be fused to improve the spatial and spectral quality of both panchromatic and multispectral images.This study provides a novel picture fusion technique that employs L0 smoothening Filter,Non-subsampled Contour let Transform(NSCT)and Sparse Representation(SR)followed by the Max absolute rule(MAR).The fusion approach is as follows:first,the multispectral and panchromatic images are divided into lower and higher frequency components using the L0 smoothing filter.Then comes the fusion process,which uses an approach that combines NSCT and SR to fuse low frequency components.Similarly,the Max-absolute fusion rule is used to merge high frequency components.Finally,the final image is obtained through the disintegration of fused low and high frequency data.In terms of correlation coefficient,Entropy,spatial frequency,and fusion mutual information,our method outperforms other methods in terms of image quality enhancement and visual evaluation.
文摘A pan-sharpen technique artificially produces a high-resolution image by image fusion techniques using high-resolution panchromatic and low-resolution multispectral images. Thus, the appearance of the color image can improve. In this paper, the effectiveness of three pan-sharpening methods based on the HSI transform approach is investigated. Three models are the hexcone, double hexcones, and Haydn’s approach. Furthermore, the effect of smoothing the low-resolution multispectral image is also investigated. The smoothing techniques are the Gaussian filter and the bilateral filter. The experimental results show that Haydn’s model is superior to others. The effectiveness of smoothing the low-resolution multispectral image is also shown.
文摘Remote Sensing image fusion is an effective way to use the large volume of data from multi-source images.This paper introduces a new method of remote sensing image fusion based on support vector machine(SVM),using high spatial resolution data SPIN-2and multi-spectral remote sensing data S POT-4.Firstly,the new method is established by building a model of remote sensing im age fusion based on SVM.Then by using SPIN-2data and SPOT-4data,image classifi-cation fusion is tested.Finally,an evaluation of the fusion result is ma de in two ways.1)From subjectivity assessment,the spatial resolution of the fused i mage is improved compared to the SPOT-4.And it is clearly that the texture of the fused image is distinctive.2)From quantitative analysis,the effect of classification fusion is bett er.As a whole,the re-sult shows that the accuracy of image fusion based on SVMis high and the SVM algorithm can be recommended for app lica-tion in remote sensing image fusion p rocesses.
文摘Pancreatic endocrine tumors are rare but are among the most common neuroendocrine neoplasms of the abdomen.At diagnosis many of them are already advanced and diff icult to treat.We report on an initially inoperable malignant pancreatic endocrine tumor in a 33-year-old woman,who received neoadjuvant peptide receptor radionuclide therapy(PRRT)as firstline treatment.This resulted in a signif icant downstaging of the tumor and allowed its subsequent complete surgical removal.Follow-up for eighteen months revealed a complete remission.This is the first report on neoadjuvant PRRT in a neuroendocrine neoplasm with subsequent successful complete resection.
基金National Natural Science Foundation of China(No.61703278)。
文摘Pan-sharpening is a process of obtaining a high spatial and spectral multispectral image(HMS)by combining a low-resolution multispectral image(LMS)with a high-resolution panchromatic image(PAN).In this paper,a pan-sharpening method called PAIHS is proposed,which is based on adaptive intensity-hue-saturation(AIHS)transformation,variational pan-sharpening framework and the two fidelity hypotheses.The suitable objective function is established and optimized by adopting particle swarm optimization(PSO)to obtain the optimal control parameters and minimum value.This value corresponds to the best pan-sharpening quality.The experimental results show that the proposed method has high efficiency and reliability,and the obtained performance index is superior to the four mainstream pan-sharpening methods.
