基于改进YOLOv5s和传感器融合的目标检测定位

Target detection and localization based on improved YOLOv5s and sensor fusion

针对无人车环境感知过程中相机无法提供道路目标的位置信息,激光雷达点云稀疏以致检测方面难以达到很好效果的问题,提出一种通过融合两者信息进行目标检测和定位的方法。采用深度学习中YOLOv5s算法进行目标检测,通过联合标定进行相机与激光雷达外参的获取以转换传感器之间的坐标,使雷达点云数据能投影到相机图像数据中,得到检测目标的位置信息,最后进行实车验证。结果表明,所提算法能在搭载TX2嵌入式计算平台的无人车自动驾驶平台上拥有27.2 Hz的检测速度,并且在一段时间的检测环境中保持12.50%的漏检率和35.32 m的最远识别距离以及0.18 m的平均定位精度。将激光雷达和相机融合,可实现嵌入式系统下的道路目标检测定位,为嵌入式平台下环境感知系统的搭建提供了参考。

As two important sensors in the process of unmanned vehicle environment perception,the camera cannot provide the position information of the road target,and the LiDAR point cloud is sparse,which makes it difficult to achieve good results in detection,so that a method was proposed which fuses the information of the two sensors for target detection and localization.YOLOv5s algorithm in deep learning was adopted for target detection,and the external parameters of camera and LIDAR were acquired through joint calibration to convert the coordinates between the sensors,so that the radar point cloud data can be projected into the camera image data,and finally the position information of the detected target was obtained.The real vehicle experiments were conducted.The results show that the algorithm can achieve a detection speed of 27.2 Hz on the unmanned vehicle autopilot platform equipped with TX2 embedded computing platform,and maintain a leakage rate of 12.50%,a maximum recognition distance of 35.32 m,and an average localization accuracy of 0.18 m over a period of time in the detection environment.The fusion of LiDAR and camera can achieve road target detection and localization in embedded system,providing a reference for the construction of environment perception systems on embedded platforms.