基于神经网络和深度相机的工件检测与定位系统

Workpiece detection and localization system based on neural network and depth camera

针对工业生产线上环境复杂、干扰多的问题,提出了基于深度学习技术和双目IR结构光深度相机相结合的方法,实现了基于SSD-Mobilenet网络和Intel Realsense D435i相机的工件检测和定位系统,可以对目标工件进行实时类别检测和三维坐标获取。通过一系列实验表明:该系统具有抗干扰能力强、检测帧率快、准确率高、定位精度高等优点,可以快速准确引导机械手工作,具有很大的应用意义和价值。

Aiming at the problem that environment is complicated and interference of the workpiece on industrial production line,a method for workpiece’s detection and positioning based on deep learning technology and binocular IR structured light depth camera is proposed,which can realize real-time category detection and 3 D coordinate acquisition of target workpiece. Through a series of experiments,it shows that the system has the advantages of strong anti-interference ability,fast detection frame rate,high accuracy and high positioning precision,and can guide manipulator to work quickly and accurately. It has great application significance and value.