期刊文献+

Multi-task learning andjoint refinement between camera localizationand objecttdetection

原文传递
导出
摘要 Visual localization and object detection both play important roles in various tasks.In many indoor application scenarios where some detected objects have fixed positions,the two techniques work closely together.However,few researchers consider these two tasks simultaneously,because of a lack of datasets and the little attention paid to such environments.In this paper,we explore multi-task network design and joint refinement of detection and localization.To address the dataset problem,we construct a medium indoor scene of an aviation exhibition hall through a semi-automatic process.The dataset provides localization and detection information,and is publicly available at https://drive.google.com/drive/folders/1U28zk0N4_I0db zkqyIAK1A15k9oUKOjI?usp=sharing for benchmarking localization and object detection tasks.Targeting this dataset,we have designed a multi-task network,JLDNet,based on YOLO v3,that outputs a target point cloud and object bounding boxes.For dynamic environments,the detection branch also promotes the perception of dynamics.JLDNet includes image feature learning,point feature learning,feature fusion,detection construction,and point cloud regression.Moreover,object-level bundle adjustment is used to further improve localization and detection accuracy.To test JLDNet and compare it to other methods,we have conducted experiments on 7 static scenes,our constructed dataset,and the dynamic TUM RGB-D and Bonn datasets.Our results show state-of-the-art accuracy for both tasks,and the benefit of jointly working on both tasks is demonstrated.
出处 《Computational Visual Media》 SCIE EI CSCD 2024年第5期993-1011,共19页 计算可视媒体(英文版)
基金 supported by the National Natural Science Foundation of China(No.62072020) Key-Area Research and the Leading Talents in Innovation and Entrepreneurship of Qingdao(No.19-3-2-21-zhc).
  • 相关文献

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部