融合去卷积与跳跃嵌套结构的显著性区域检测

Saliency Region Detection Based on Deconvolutional and Skip Nested Module

针对深度学习的显著性区域检测方法大多存在的显著性图边界信息丢失、轮廓模糊等问题,提出将全局嵌套边缘检测(HED)模型迁移至显著性区域检测任务以增强边界检测,在其基础网络结构之上融入去卷积模块与跳跃嵌套结构,构建了面向显著性区域检测的HED-DSN模型.首先利用去卷积模块以乘积的方式结合底层与高层信息,然后利用跳跃嵌套结构以通道连接的方式将不同层次的特征进行融合,最后用全连接条件随机场对预测得到的显著性图进行优化.在MSRA-B, ECSSD, HKU-IS, SOD和DUT-OMRON共5个数据集上进行实验及模型评价,结果表明,HED-DSN模型在各数据集上均表现良好,不仅能准确地定位出显著性区域,且检测出的区域完整、边界清晰;在客观指标上,该模型的总体性能优于目前最好的DSS模型,且在SOD数据集上提高了近0.7%.

The end to end saliency region detection algorithms based on deep learning always had boundary information loss and contour blurring problems.Addressing these problems,this paper proposes to adopt HED model,which performs well on edge detection tasks to improve edge detection for saliency region.To detect saliency region with distinct areas and sharp edges,this paper proposes to integrate deconvolution module and skip nested architecture on the basis of HED model to construct an advanced model HED-DSN.Firstly,a deconvolution module is introduced to combine the underlying layer information with that of upper layer through multiplying pixel by pixel.Then,a skip nested architecture is employed to combine features from different levels through channel connection way.Finally,the predicted saliency map is optimized with the fully connected conditional random field.Subjective experiments are performed on the 5 most common saliency datasets,including MSRA-B,ECSSD,HKU-IS,SOD,and DUT-OMRON.The results show that the HED-DSN model performs well.Not only it can detect the salient region accurately,but also the detected region is more complete and clear.Objective qualities experiments show that the HED-DSN model is slightly higher than DSS model,one of the best model for saliency region detection,especially is nearly 0.7%higher on the SOD dataset.