摘要
为提高视觉同时定位与地图构建(SLAM)技术的环境适应性和语义信息理解能力,该文提出一种可以在动态场景下实现多层次语义地图构建的视觉SLAM方案。首先利用被迫移动物体与动态目标间的空间位置关系,并结合目标检测网络和光流约束判断真正的动态目标,从而剔除动态特征点;其次提出一种基于超体素的快速点云分割方案,将基于静态区域构建的3维地图进行优化,构建了物体级的点云语义地图;同时构建的语义地图可以提供更高精度的训练数据样本,进一步用来提升目标检测网络性能。在TUM和ICL-NUIM数据集上的实验结果表明,该方法在定位精度上远优于目前主流的动态场景下的视觉SLAM方案,证明了该方法在高动态场景中具有较好的稳定性和鲁棒性;在建图精度和质量上,经过将重建的不同种类地图与各个现有方法进行比较,验证了提出的多层次语义地图构建的方法在静态和高动态场景中的有效性与适用性。
To cope with the moving objects in dynamic environments and make the robots truly understand the surroundings,a visual Simultaneous Localization And Mapping(SLAM)system is proposed to estimate simultaneously trajectory and object-level dense 3D semantic maps in dynamic environments.Object detection and optical flow results are leveraged to identify those actually moving objects.To improve semantic mapping accuracy,an unsupervised algorithm is employed to segment 3D point cloud into meaningful clusters with semantic cues.The semantic maps are further used to improve object detection model,by fine-tuning with hard examples coming from semantic maps in challenging conditions.Extensive qualitative and quantitative experiments which compare the proposed method to comparable state-of-the-art approaches show that the proposed method achieves improved accuracy and robustness in dynamic scenes.
作者
梅天灿
秦宇晟
杨宏
高智
李皓冉
MEI Tiancan;QIN Yusheng;YANG Hong;GAO Zhi;LI Haoran(School of Electronic Information,Wuhan University,Wuhan 430072,China;Aerospace Information Research Institute,Chinese Academy of Science,Beijing 100190,China;School of Remote Sensing and Information Engineering,Wuhan University,Wuhan 430079,China)
出处
《电子与信息学报》
EI
CSCD
北大核心
2023年第5期1737-1746,共10页
Journal of Electronics & Information Technology
基金
湖北省自然科学基金(2021CFA088)。
关键词
视觉同时定位与地图构建技术
语义建图
动态场景
点云分割
目标检测
Visual Simultaneous Localization And Mapping(SLAM)
Semantic mapping
Dynamic environment
Point cloud segmentation
Object detection