基于机器视觉的多机械臂煤矸石分拣机器人系统研究

Research on multi-manipulator coal and gangue sorting robot system based on machine vision

现有煤矸石分拣方法主要是根据煤和岩石的纹理特征值,利用图像处理和模式识别技术对煤矸石进行识别分选,分选的煤矸石粒度为25~150mm,而对于150mm以上的煤矸石仍依靠人工进行分选。为了对大粒度煤矸石进行分拣,设计了一种基于机器视觉的多机械臂煤矸石分拣机器人系统。该系统采用机器视觉采集煤矸石信息,应用深度学习方法实现煤矸石识别和抓取特征提取;在获取煤矸石序列信息后,根据煤矸石位置进行排序工作,并通过多目标任务分配策略将抓取任务下达给相应机械臂控制器;机械臂获取任务后,根据获得的任务对目标进行动态监测,当目标进入机械臂工作空间后由视觉伺服系统驱动机械臂完成煤矸石分拣。试验结果表明,该系统可对粒度为50~260mm的煤矸石进行高效、快速分拣,所采用的煤矸石识别方法和分拣策略在不同带速下具有良好的稳定性和准确性,煤矸识别与定位的综合准确率可达93%,验证了该系统的可行性。

Existing coal and gangue sorting methods mainly use image processing and pattern recognition technology to identify and sort coal and gangue according to texture characteristic values of coal and rock. The grain size of coal and gangue is 25-150 mm, while the coal and gangue above 150 mm still relies on manual sorting. In order to sort coal and gangue with large grain size, a multi-manipulator coal and gangue sorting robot system based on machine vision was proposed.The system uses machine vision to collect coal and gangue information and applies deep learning method to realize coal and gangue identification and grab feature extraction. After obtaining the sequence information of coal and gangue, the sorting work is carried out according to the position of coal and gangue, and the grasping task is assigned to the corresponding manipulator controller by multi-objective task assignment strategy. After the manipulator obtains the task, the target is dynamically monitored according to the acquired task. When the target enters the working space of the manipulator, the visual servo system drives the manipulator to complete the coal and gangue sorting. The test results show that the system can efficiently and quickly sort coal and gangue with grain size of 50-260 mm, and the adopted coal and gangue identification method and sorting strategy have good stability and accuracy under different belt speeds, and the comprehensive accuracy of coal and gangue identification and positioning can reach 93%, which verifies the feasibility of the system.