基于2D循环卷积和难度敏感轮廓交并比损失的Deep Snake

Deep Snake with 2D-Circular Convolution and Difficulty Sensitive Contour-IoU Loss

Deep Snake端到端地变形初始目标框到目标轮廓,能提升实例分割的性能,但存在对初始目标框敏感和轮廓参数独立回归的问题.因此文中提出基于2D循环卷积和难度敏感轮廓交并比损失的Deep Snake.首先,基于轮廓的空间上下文信息设计2D循环卷积,解决对初始目标框敏感的问题.然后,基于定积分的几何意义与样本难易度提出难度敏感轮廓交并比损失函数,将轮廓参数进行整体回归.最后,利用2D循环卷积和难度敏感轮廓交并比损失函数完成实例分割.在Cityscapes、Kins、Sbd数据集上的实验证明文中方法的实例分割精度较优.

The initial bounding box is deformed to the object contour end-to-end by Deep Snake,and the performance of instance segmentation is significantly improved.However,the problems of sensitivity to the initial bounding box and independent regression of contour parameters emerge.To address these issues,Deep Snake with 2D-circular convolution and difficulty sensitive intersection over union(contour-IoU)loss is proposed.Firstly,2D-circular convolution is designed based on the spatial context information of the contour to solve the problem of sensitivity to the initial bounding box.Secondly,difficulty sensitive contour-IoU loss function is proposed according to the geometric meaning of the definite integral and the difficulty of the sample to regress the contour parameters as a whole unit.Finally,instance segmentation is accomplished by the proposed 2D-circular convolution and difficulty sensitive contour-IoU loss function.Experiments on Cityscapes,Kins and Sbd datasets show that the proposed method achieves better segmentation accuracy.