摘要
提出一种基于注意力和中间融合表示的三维重建模型,旨在重建具有精细化结构的三维模型。该方法利用轴向空间注意力机制学习不同方向的信息,将其嵌入编码器中以捕获局部结构特征;并基于双流网络推测深度图和三维平均形状以设计中间融合表示模块,该模块能够有效地融合可见表面细节信息,从而更好地描绘对象的三维空间结构。实验结果表明:所提出的轴向空间注意力机制和中间融合表示模块增强了特征提取的能力,IoU和F-score比PixVox++分别提升了1.3%和0.4%,三维重建效果更优。
A 3D reconstruction model based on attention and intermediate fusion representation is proposed,aiming to reconstruct a 3D model with refined structure.This method used the axial spatial attention mechanism to learn information in different directions,and embeded it in the encoder to capture local structural features.Then,based on the two-stream network,the depth map and 3D average shape could be inferred to design an intermediate fusion representation module which could effectively fuse visible surface details to better describe the 3D spatial structure of the objects.The experimental results show that the axial spatial attention mechanism and the intermediate fusion representation module proposed in this paper enhance the ability of feature extraction.The IoU and F-score are 1.3%and 0.4%higher than PixVox++,respectively,proving that the 3D reconstruction effect is better.
作者
周敏
张俊然
李南欣
ZHOU Min;ZHANG Junran;LI Nanxin(College of Electrical Engineering,Sichuan University,Chengdu 610065,CHN)
出处
《半导体光电》
CAS
北大核心
2023年第1期122-127,共6页
Semiconductor Optoelectronics
基金
德阳科技(揭榜)项目(2021JBJZ007)
成都市科技项目重点研发支撑计划(技术创新研发项目:2021-YF05-00916-SN)
华西医院135交叉学科创新项目(ZYJC21041)
四川大学“医学+信息”中心融合创新项目(YGJC012)
关键词
深度学习
三维重建
轴向空间注意力
深度图
中间融合表示
deep learning
3D reconstruction
axial spatial attention
depth map
intermediate fusion representation