To realize the robotic harvesting of Hangzhou White Chrysanthemums,the quick recognition and 3D vision localization system for target Chrysanthemums was investigated in this study.The system was comprised of three mai...To realize the robotic harvesting of Hangzhou White Chrysanthemums,the quick recognition and 3D vision localization system for target Chrysanthemums was investigated in this study.The system was comprised of three main stages.Firstly,an end-effector and a simple freedom manipulator with three degrees were designed to meet the quality requirements of harvesting Hangzhou White Chrysanthemums.Secondly,a segmentation based on HSV color space was performed.A fast Fuzzy C-means(FCM)algorithm based on S component was proposed to extract the target image from irrelevant background.Thirdly,binocular stereo vision was used to acquire the target spatial information.According to the shape of Hangzhou White Chrysanthemums,the centroids of stamens were selected as feature points to match in the right and left images.The experimental results showed that the proposed method was able to recognize Hangzhou White Chrysanthemums with the accuracy of 85%.When the distance between target and baseline was 150-450 mm,the errors between the calculated and measured distance were less than 14 mm,which could meet the requirements of the localization accuracy of the harvesting robot.展开更多
In order to realize the visual positioning for Hangzhou white chrysanthemums harvesting robot in natural environment,a color image segmentation method for Hangzhou white chrysanthemum based on least squares support ve...In order to realize the visual positioning for Hangzhou white chrysanthemums harvesting robot in natural environment,a color image segmentation method for Hangzhou white chrysanthemum based on least squares support vector machine(LS-SVM)was proposed.Firstly,bilateral filter was used to filter the RGB channels image respectively to eliminate noise.Then the pixel-level color feature and texture feature of the image,which was used as input of LS-SVM model(classifier)and SVM model(classifier),were extracted via RGB value of image and gray level co-occurrence matrix.Finally,the color image was segmented with the trained LS-SVM model(classifier)and SVM model(classifier)separately.The experimental results showed that the trained LS-SVM model and SVM model could effectively segment the images of the Hangzhou white chrysanthemums from complicated background taken under three illumination conditions such as front-lighting,back-lighting and overshadow,with the accuracy of above 90%.When segmenting an image,the SVM algorithm required 1.3 s,while the LS-SVM algorithm proposed in this paper just needed 0.7 s,which was better than the SVM algorithm obviously.The picking experiment was carried out and the results showed that the implementation of the proposed segmentation algorithm on the picking robot could achieve 81%picking success rate.展开更多
基金This work was financially supported by the project of National Science and Technology Supporting Plan(2015BAF01B02)the Open Foundation of Intelligent Robots and Systems at the University of Beijing Institute of Technology,High-tech Innovation Center(2016IRS03).
文摘To realize the robotic harvesting of Hangzhou White Chrysanthemums,the quick recognition and 3D vision localization system for target Chrysanthemums was investigated in this study.The system was comprised of three main stages.Firstly,an end-effector and a simple freedom manipulator with three degrees were designed to meet the quality requirements of harvesting Hangzhou White Chrysanthemums.Secondly,a segmentation based on HSV color space was performed.A fast Fuzzy C-means(FCM)algorithm based on S component was proposed to extract the target image from irrelevant background.Thirdly,binocular stereo vision was used to acquire the target spatial information.According to the shape of Hangzhou White Chrysanthemums,the centroids of stamens were selected as feature points to match in the right and left images.The experimental results showed that the proposed method was able to recognize Hangzhou White Chrysanthemums with the accuracy of 85%.When the distance between target and baseline was 150-450 mm,the errors between the calculated and measured distance were less than 14 mm,which could meet the requirements of the localization accuracy of the harvesting robot.
基金This work was financially supported by the project of National Science and Technology Supporting Plan(2015BAF01B02)the Open Foundation of Intelligent Robots and Systems at the University of Beijing Institute of Technology,High-tech Innovation Center(2016IRS03).
文摘In order to realize the visual positioning for Hangzhou white chrysanthemums harvesting robot in natural environment,a color image segmentation method for Hangzhou white chrysanthemum based on least squares support vector machine(LS-SVM)was proposed.Firstly,bilateral filter was used to filter the RGB channels image respectively to eliminate noise.Then the pixel-level color feature and texture feature of the image,which was used as input of LS-SVM model(classifier)and SVM model(classifier),were extracted via RGB value of image and gray level co-occurrence matrix.Finally,the color image was segmented with the trained LS-SVM model(classifier)and SVM model(classifier)separately.The experimental results showed that the trained LS-SVM model and SVM model could effectively segment the images of the Hangzhou white chrysanthemums from complicated background taken under three illumination conditions such as front-lighting,back-lighting and overshadow,with the accuracy of above 90%.When segmenting an image,the SVM algorithm required 1.3 s,while the LS-SVM algorithm proposed in this paper just needed 0.7 s,which was better than the SVM algorithm obviously.The picking experiment was carried out and the results showed that the implementation of the proposed segmentation algorithm on the picking robot could achieve 81%picking success rate.
