摘要
目的近年来,深度网络成功应用于高光谱图像分类。然而,难以获取充足的标记数据大大限制了深度网络的充分训练,进而导致网络对高光谱图像的分类能力下降。为解决以上困难,提出一种关联子域对齐网络的高光谱图像迁移分类方法。方法基于深度迁移学习方法,通过对两域分布进行多角度、全面领域适应的同时将两域分类器进行差异适配。一方面,利用关联对齐从整体上对齐了两域的二阶统计量信息,适配了两域的全局分布;另一方面,利用局部最大均值差异对齐了相关子域的一阶统计量信息,适配了两域的局部分布。另外,构造一种分类器适配模块并将其加入所提网络中,通过对两域分类器差异进行适配,进一步增强网络的领域适应效果。结果从4组真实高光谱数据集上的实验结果可看出:在分别采集于不同区域的高光谱图像数据对上,所提方法的精度比排名第2的分类方法高出1.01%、0.42%、0.73%和0.64%。本文方法的Kappa系数也取得最优结果。结论与现有主流算法相比较,所提网络能够在整体和局部、一阶和二阶统计量上分别对两域进行有效对齐,进而充分利用在源域上训练好的分类器完成对目标域高光谱数据的跨域分类。
Objective Hyperspectral image(HSI)classification method is focused on spectral and spatial information to recognize the category of each ground object pixel.Due to the large number of spectral bands and redundant information between spectral bands in hyperspectral data,it is challenged to extract the identifiable features.Deep learning technique has been widely used in HSI classification because of its potential feature extraction and generalization abilities.However,the classification performance of it often based on much more labeled training samples.Due to the relative high sensor and labor costs generated from collection to calibration of HSI,deep learning techniques are challenged for sufficient labeled his normally.It is feasible to classify a HSI(target domain)using another similar but not identical HSI(source domain)with rich labeling information to some extent.To complete the target-domain HSI classification,transfer learning technique can be used to transfer the domain-invariant knowledge learned from the labeled source domain to the target domain with a similar but different distribution.However,due to the lighting and sensor-derived constraints,the collected cross-domain HSIs have a large distribution difference frequently,and their distributions are challenged to be fully adapted.In addition,most transfer learning methods are rarely melted into in related to two-domain classifiers-between mismatched problems.Therefore,we develop a simple and effective deep transfer HSI classification method,called correlation subdomain align⁃ment network(CSADN),which can be focused on distribution and classifier adaptations and the labeled source-domain knowledge can be transferred to an unlabeled target domain.The proposed method can use the labeled source-domain samples to complete the target domain HSI classification further.Method The CSADN is mainly composed of four aspects as mentioned below:1)Data preprocessing:band selection is used to lower the dimension of the original HSIs.2)Depth network-based feature learning:deep neural network is developed and used for feature learning.3)Feature distribution adaptation:a covariance adaptation term is added to the loss function through minimizing the two-domain covariance to complete the global distribution adaptation.4)Subdomain adaptation:a subdomain adaptation term is added to the loss function further,and the local features are aligned via minimizing the subdomain difference.5)Classifier adaptation:the classifier difference is captured based on the classifier adaptation module,and the low-density separation criterion is uti⁃lized to yield the source-domain classifier to adapt the target-domain data better.To improve the classification accuracy of CSADN for the target-domain data further,joint domain adaptation is carried out between the feature level and classifier level.Result The classification performance and domain adaptation ability of CSADN are evaluated in experiments.For classification,ten sorts of cross-domain classification methods are selected for comparative experiments in the context of tra⁃ditional transfer learning methods and deep transfer learning methods.For CSADN validation,four sets of real HSI data pairs are selected,including Botswana5-6(BOT5-6),BOT6-7,BOT7-5,and Houston bright-shallow.It demonstrates that each of the accuracy of CSADN is optimized by 1.01%,0.42%,0.73%,and 0.64%for BOT5-6,BOT6-7,BOT7-5,and Houston bright-shallow data pairs.The Kappa coefficient of CSADN has its potentials apparently.For domain adapta⁃tion ability,the t-distributed stochastic neighbor embedding can be used to verify the effectiveness of CSADN via highdimensional data visualization as well.The original features of HSIs and the domain adaptation after features of CSADN are visualized on four experimental data sets.Compared with the original features of HSIs,the CSADN-extracted features have their higher inter-class difference and lower intra-class difference simultaneously.Moreover,the feature distributionsbetween covariance differences can be reduced via the domain adaptation.It illustrates that the proposed method has its potential domain adaptation ability to a certain extent.Conclusion The proposed CSADN is feasible to integrate the feature distribution adaptation and classifier adaptation into transfer knowledge from the source domain to the target domain.It can classify unlabeled samples in the target domain using labeled samples in the source domain only.Specifically,a domain adaptation layer is designed and embedded into as well.To complete the feature distribution adaptation,the difference between the first-order and second-order statistics of both domains is adapted through aligning the relevant subdomains and covariance.The classifier adaptation module is constructed and added to CSADN.The domain adaptation ability can be enhanced in terms of adapting the difference between classifiers,and the classification accuracy of the target domain data can be improved further.The target-domain pseudo label is used in CSADN,and the quality of the pseudo label can affect the domain adaptation effect of CSADN.To get better performance in cross-domain HSI classification tasks,future research direction is predicted that the pseudo label optimization technology can be introduced into CSADN further.
作者
王浩宇
程玉虎
王雪松
Wang Haoyu;Cheng Yuhu;Wang Xuesong(School of Information and Control Engineering,China University of Mining and Technology,Xuzhou 221116,China)
出处
《中国图象图形学报》
CSCD
北大核心
2023年第10期3255-3266,共12页
Journal of Image and Graphics
基金
国家自然科学基金项目(61976215,62176259)
江苏省自然科学基金项目(BK20221116)
江苏省卓越博士后计划项目(2022ZB530)。
关键词
高光谱图像(HSI)
分类
迁移学习
深度学习
跨域
hyperspectral image(HSI)
classification
transfer learning
deep learning
cross-domain