NSST域下SPCNN与SR结合的多源图像融合

Multi-source image fusion with SPCNN and SR based on image features

为了凸显不同源图像的不同特征,提出了基于图像特征的参数自动设定的SPCNN模型。结合稀疏表示,提出了一种适合多源图像融合的方法。首先源图像经NSST变换分解为高频系数和低频系数。对高频系数利用图像固有特征自动设置参数的SPCNN模型实现点火,并依据点火总次数和加权融合规则完成融合。对低频系数采用稀疏表示实现融合。最后,通过逆NSST变换重构图像。实验结果表明,本文所提融合方法优于其他5种经典方法,融合图像符合人眼视觉感知系统,结构清晰,细节明显。

In order to highlight the different features of different input images,a SPCNN model with automatic-setting parameter based on features is proposed,which is combined with sparse representation to fuse the multi-source images.The fusion process has four steps.Firstly,the source images are decomposed into high frequency coefficients and low frequency coefficient by NSST.Each high frequency coefficient is fired by the SPCNN model with automatic-set parameters based on the inherent characteristics,and the fused image is completed according to the total number of firing and the weighted fusion strategy.The low frequency coefficients are fused by a sparse representation.Finally,the fused image is reconstructed by inverse NSST.The experimental results show that the proposed method is superior to the other five classical methods and the fused image conforms to the human visual perception system,with clear structure and obvious details.