In a controlled indoor environment,line tracking has become the most practical and reliable navigation strategy for autonomous mobile robots.A line tracking robot is a self-mobile machine that can recognize and track ...In a controlled indoor environment,line tracking has become the most practical and reliable navigation strategy for autonomous mobile robots.A line tracking robot is a self-mobile machine that can recognize and track a painted line on thefloor.In general,the path is set and can be visible,such as a black line on a white surface with high contrasting colors.The robot’s path is marked by a distinct line or track,which the robot follows to move.Several scientific contributions from the disciplines of vision and control have been made to mobile robot vision-based navigation.Localization,automated map generation,autonomous navigation and path tracking is all becoming more frequent in vision applications.A visual navigation line tracking robot should detect the line with a camera using an image processing technique.The paper focuses on combining computer vision techniques with a proportional-integral-derivative(PID)control-ler for automatic steering and speed control.A prototype line tracking robot is used to evaluate the proposed control strategy.展开更多
A dead reckoning system and a vision navigation system are proposed for use in a new integrated system for robot navigation. Since the dead reckoning system uses a recurrence algorithm to determine the position, the p...A dead reckoning system and a vision navigation system are proposed for use in a new integrated system for robot navigation. Since the dead reckoning system uses a recurrence algorithm to determine the position, the position will be divergent in two horizontal directions with time increasing. In order to overcome this defect, a vision navigation system is used to periodically correct the dead reckoning system, and a kalman filter is used to estimate the errors of navigation and the unknown biases of sensors, and precise position and heading estimations are obtained by updating navigation errors and sensors’ biases. It is concluded from the simulation results that all the navigation parameters can be obtained through kalman filtering, and the integrated navigation system proposed for robot navigation can be used in an actual robot working in a laboratory. The measurement noise analysis shows that with the distance between beacon and robot increasing, the measurement noise will increase, and in order to achieve a proper estimation accuracy, the distance should not be too great.展开更多
For the autonomous guided vehicle (AGV) used mainly in unfixed work fields, a machine vision method was proposed for the navigation system, in which a series of navigation-signs are placed along the travel route. The ...For the autonomous guided vehicle (AGV) used mainly in unfixed work fields, a machine vision method was proposed for the navigation system, in which a series of navigation-signs are placed along the travel route. The navigation system detects and recognizes these signs, and accordingly informs the travel control system. In order for the navigation to have balanced ability of 1) covering a large area and 2) recognizing details of the sign, the proposed vision method was designed to be a hybrid one, using both the stereo vision and the traditional 2D template matching. The former implemented a coarse recognition function for above 1), and the later implemented a fine recognition function for above 2). The results from the coarse recognition were used in the fine recognition for the gaze control to input suitable 2D image of the signs. Experiments on a prototype system show the feasibility of the proposed hybrid method in achieving the objective specifications for a typical AGV.展开更多
BACKGROUND Medical robot is a promising surgical tool,but no specific one has been designed for interventional treatment of chronic pain.We developed a computed tomography-image based navigation robot using a new regi...BACKGROUND Medical robot is a promising surgical tool,but no specific one has been designed for interventional treatment of chronic pain.We developed a computed tomography-image based navigation robot using a new registration method with binocular vision.This kind of robot is appropriate for minimal invasive interventional procedures and easy to operate.The feasibility,accuracy and stability of this new robot need to be tested.AIM To assess quantitatively the feasibility,accuracy and stability of the binocularstereo-vision-based navigation robot for minimally invasive interventional procedures.METHODS A box model was designed for assessing the accuracy for targets at different distances.Nine(three sets)lead spheres were embedded in the model as puncture goals.The entry-to-target distances were set 50 mm(short-distance),100 mm(medium-distance)and 150 mm(long-distance).Puncture procedure was repeated three times for each goal.The Euclidian error of each puncture was calculated and statistically analyzed.Three head phantoms were used to explore the clinical feasibility and stability.Three independent operators conducted foramen ovale placement on head phantoms(both sides)by freehand or under the guidance of robot(18 punctures with each method).The operation time,adjustment time and one-time success rate were recorded,and the two guidancemethods were compared.RESULTS On the box model,the mean puncture errors of navigation robot were 1.7±0.9 mm for the short-distance target,2.4±1.0 mm for the moderate target and 4.4±1.4 mm for the long-distance target.On the head phantom,no obvious differences in operation time and adjustment time were found among the three performers(P>0.05).The median adjustment time was significantly less under the guidance of the robot than under free hand.The one-time success rate was significantly higher with the robot(P<0.05).There was no obvious difference in operation time between the two methods(P>0.05).CONCLUSION In the laboratory environment,accuracy of binocular-stereo-vision-based navigation robot is acceptable for target at 100 mm depth or less.Compared with freehand,foramen ovale placement accuracy can be improved with robot guidance.展开更多
A system for mobile robot localization and navigation was presented.With the proposed system,the robot can be located and navigated by a single landmark in a single image.And the navigation mode may be following-track...A system for mobile robot localization and navigation was presented.With the proposed system,the robot can be located and navigated by a single landmark in a single image.And the navigation mode may be following-track,teaching and playback,or programming.The basic idea is that the system computes the differences between the expected and the recognized position at each time and then controls the robot in a direction to reduce those differences.To minimize the robot sensor equipment,only one omnidirectional camera was used.Experiments in disturbing environments show that the presented algorithm is robust and easy to implement,without camera rectification.The rootmean-square error(RMSE) of localization is 1.4,cm,and the navigation error in teaching and playback is within 10,cm.展开更多
Autonomous relative navigation is the key technology in mining or rescuing. On the basis of mine requirement and the theories of machine vision, an autonomous relative navigation algorithm for mine agent based on quat...Autonomous relative navigation is the key technology in mining or rescuing. On the basis of mine requirement and the theories of machine vision, an autonomous relative navigation algorithm for mine agent based on quaternion was proposed. In rotation transformation, this algorithm was represented by using quaternion. Because the Jacobi matrix of this method is lower than that of Hall algorithm, the calculation efficiency is improved by using this algorithm. The results of these experiments show that the computation burden of this algorithm based on quaternion is about half that of Hall algorithm. This algorithm based on quaternion is improved as a valid way to solve the problem of mine real-time navigation.展开更多
A second-order divided difference filter (SDDF) is derived for integrating line of sight measurement from vision sensor with acceleration and angular rate measurements of the follower to estimate the precise relative ...A second-order divided difference filter (SDDF) is derived for integrating line of sight measurement from vision sensor with acceleration and angular rate measurements of the follower to estimate the precise relative position,velocity and attitude of two unmanned aerial vehicles (UAVs).The second-order divided difference filter which makes use of multidimensional interpolation formulations to approximate the nonlinear transformations could achieve more accurate estimation and faster convergence from inaccurate initial conditions than standard extended Kalman filter.The filter formulation is based on relative motion equations.The global attitude parameterization is given by quarternion,while a generalized three-dimensional attitude representation is used to define the local attitude error.Simulation results are shown to compare the performance of the second-order divided difference filter with a standard extended Kalman filter approach.展开更多
Some agriculture machinery like the transplanter,needs to operate by following the crop-free ridges.In order to improve working efficiency and quality,some autonomous navigation systems were developed and applied to r...Some agriculture machinery like the transplanter,needs to operate by following the crop-free ridges.In order to improve working efficiency and quality,some autonomous navigation systems were developed and applied to ridge-following machinery.At present,agricultural navigation systems are mainly the satellite navigation system and the machine vision system.The satellite navigation system is difficult to apply to the machinery that needs to work by following the ridge because it cannot distinguish the shape of the navigated ridge and guide the machinery working along the ridge.In this study,697 cloudy ridge images and 235 sunny ridge images were taken in the field,and these images were used as the dataset.Moreover,a machine vision navigation method based on the color of ridges was proposed.Firstly,the regions of interest(ROI)in the ridge image were extracted according to the reaction time and the forward speed of the machine.Then,a gray reconstruction method was used to enlarge the color difference between the ridge and the furrow.The optimal threshold for the gray image segmenting was calculated real-timely by using the threshold segmentation method.Then,based on the contour detection method,the ridge contour which was not surrounded by holes was extracted.Finally,the approximate quadrilateral method was proposed to recognize the ridge center line as the navigation line.The method proposed in this study was verified by four types of ridges with different colors and textures.The experimental results showed that the recognition success rates of the light ridge,the dark ridge,the film-covered ridge,and the sunny ridge were 100%,97.5%,100%,and 98.7%,respectively.The recognition success rate of the proposed method was at least 8%higher than that of the existing ridge-furrow recognition methods.The results indicate that this method can effectively realize navigation line recognition.This method can provide technical support for the autonomous navigation of agricultural machinery,such as transplanters,seeders,etc.,operating on the ridge without crops.展开更多
For the improvement of accuracy and better fault-tolerant performance, a global position system (GPS)/vision navigation (VISNAV) integrated relative navigation and attitude determination approach is presented for ...For the improvement of accuracy and better fault-tolerant performance, a global position system (GPS)/vision navigation (VISNAV) integrated relative navigation and attitude determination approach is presented for ultra-close spacecraft formation flying. Onboard GPS and VISNAV system are adopted and a federal Kalman filter architecture is used for the total navigation system design. Simulation results indicate that the integrated system can provide a total improvement of relative navigation and attitude estimation performance in accuracy and fault-tolerance.展开更多
This article presents a good robust and real-time system scheme of the mobile robot obstacle detection and navigation, which principle of work is based on the feature descriptor SURF. In this scheme, firstly, the imag...This article presents a good robust and real-time system scheme of the mobile robot obstacle detection and navigation, which principle of work is based on the feature descriptor SURF. In this scheme, firstly, the image information of the mobile robot path was captured by the binocular camera; then the feature points were extracted and corresponding matched using SURF to the binocular images as the undetected obstacles; finally fixed the position of the objective by the parallax between the matching points combining with the binocular vision calibration model. Theoretical derivation and experimental results show that this scheme is more accurate for the detection and navigation of the interest points. It has fast matching speed and high accuracy and low error. So, it has certain practical effect and popularizing value for the mobile robot real-time obstacle avoidance and navigation.展开更多
Purpose: Professional high speed sea navigational procedures are based on turn points, courses, dangers and steering cues in the environment. Since navigational aids have become less expensive and due to the fact that...Purpose: Professional high speed sea navigational procedures are based on turn points, courses, dangers and steering cues in the environment. Since navigational aids have become less expensive and due to the fact that electronic sea charts can be integrated with both radar and transponder information, it may be assumed that traditional navigation by using paper based charts and radar will play a less significant role in the future, especially among less experienced navigators. Possible navigational differences between experienced and non-experienced boat drivers is thus of interest with regards to their use of navigational aids. It may be assumed that less experienced navigators rely too much on the information given by the electronic sea chart, despite the fact that it is based on GPS information that can be questioned, especially in littoral waters close to land. Method: This eye tracking study investigates gaze behaviour from 16 ex perienced and novice boat drivers during high speed navigation at sea. Results: The results show that the novice drivers look at objects that are close to themselves, like instrumentation, while the experienced look more at objects far away from the boat. This is in accordance with previous research on car drivers. Further, novice boat drivers used the electronic navigational aids to a larger extent than the experienced, especially during high speed conditions. The experienced drivers focused much of their attention on objects outside the boat. Conclusions: The findings verify that novice boat drivers tend to rely on electronic navigational aids. Experienced drivers presumably use the navigational aids to verify what they have observed in the surrounding environment and further use the paper based sea chart to a larger extent than the novice drivers.展开更多
基金funding from the researchers supporting project number(RSP2022R474)King Saud University,Riyadh,Saudi Arabia.
文摘In a controlled indoor environment,line tracking has become the most practical and reliable navigation strategy for autonomous mobile robots.A line tracking robot is a self-mobile machine that can recognize and track a painted line on thefloor.In general,the path is set and can be visible,such as a black line on a white surface with high contrasting colors.The robot’s path is marked by a distinct line or track,which the robot follows to move.Several scientific contributions from the disciplines of vision and control have been made to mobile robot vision-based navigation.Localization,automated map generation,autonomous navigation and path tracking is all becoming more frequent in vision applications.A visual navigation line tracking robot should detect the line with a camera using an image processing technique.The paper focuses on combining computer vision techniques with a proportional-integral-derivative(PID)control-ler for automatic steering and speed control.A prototype line tracking robot is used to evaluate the proposed control strategy.
文摘A dead reckoning system and a vision navigation system are proposed for use in a new integrated system for robot navigation. Since the dead reckoning system uses a recurrence algorithm to determine the position, the position will be divergent in two horizontal directions with time increasing. In order to overcome this defect, a vision navigation system is used to periodically correct the dead reckoning system, and a kalman filter is used to estimate the errors of navigation and the unknown biases of sensors, and precise position and heading estimations are obtained by updating navigation errors and sensors’ biases. It is concluded from the simulation results that all the navigation parameters can be obtained through kalman filtering, and the integrated navigation system proposed for robot navigation can be used in an actual robot working in a laboratory. The measurement noise analysis shows that with the distance between beacon and robot increasing, the measurement noise will increase, and in order to achieve a proper estimation accuracy, the distance should not be too great.
文摘For the autonomous guided vehicle (AGV) used mainly in unfixed work fields, a machine vision method was proposed for the navigation system, in which a series of navigation-signs are placed along the travel route. The navigation system detects and recognizes these signs, and accordingly informs the travel control system. In order for the navigation to have balanced ability of 1) covering a large area and 2) recognizing details of the sign, the proposed vision method was designed to be a hybrid one, using both the stereo vision and the traditional 2D template matching. The former implemented a coarse recognition function for above 1), and the later implemented a fine recognition function for above 2). The results from the coarse recognition were used in the fine recognition for the gaze control to input suitable 2D image of the signs. Experiments on a prototype system show the feasibility of the proposed hybrid method in achieving the objective specifications for a typical AGV.
基金Supported by Jiangsu Provincial Department of Science and Technology,No.BE2017603 and No.BE2017675。
文摘BACKGROUND Medical robot is a promising surgical tool,but no specific one has been designed for interventional treatment of chronic pain.We developed a computed tomography-image based navigation robot using a new registration method with binocular vision.This kind of robot is appropriate for minimal invasive interventional procedures and easy to operate.The feasibility,accuracy and stability of this new robot need to be tested.AIM To assess quantitatively the feasibility,accuracy and stability of the binocularstereo-vision-based navigation robot for minimally invasive interventional procedures.METHODS A box model was designed for assessing the accuracy for targets at different distances.Nine(three sets)lead spheres were embedded in the model as puncture goals.The entry-to-target distances were set 50 mm(short-distance),100 mm(medium-distance)and 150 mm(long-distance).Puncture procedure was repeated three times for each goal.The Euclidian error of each puncture was calculated and statistically analyzed.Three head phantoms were used to explore the clinical feasibility and stability.Three independent operators conducted foramen ovale placement on head phantoms(both sides)by freehand or under the guidance of robot(18 punctures with each method).The operation time,adjustment time and one-time success rate were recorded,and the two guidancemethods were compared.RESULTS On the box model,the mean puncture errors of navigation robot were 1.7±0.9 mm for the short-distance target,2.4±1.0 mm for the moderate target and 4.4±1.4 mm for the long-distance target.On the head phantom,no obvious differences in operation time and adjustment time were found among the three performers(P>0.05).The median adjustment time was significantly less under the guidance of the robot than under free hand.The one-time success rate was significantly higher with the robot(P<0.05).There was no obvious difference in operation time between the two methods(P>0.05).CONCLUSION In the laboratory environment,accuracy of binocular-stereo-vision-based navigation robot is acceptable for target at 100 mm depth or less.Compared with freehand,foramen ovale placement accuracy can be improved with robot guidance.
基金Supported by National Natural Science Foundation of China (No. 31000422 and No. 61201081)Tianjin Municipal Education Commission(No.20110829)Tianjin Science and Technology Committee(No. 10JCZDJC22800)
文摘A system for mobile robot localization and navigation was presented.With the proposed system,the robot can be located and navigated by a single landmark in a single image.And the navigation mode may be following-track,teaching and playback,or programming.The basic idea is that the system computes the differences between the expected and the recognized position at each time and then controls the robot in a direction to reduce those differences.To minimize the robot sensor equipment,only one omnidirectional camera was used.Experiments in disturbing environments show that the presented algorithm is robust and easy to implement,without camera rectification.The rootmean-square error(RMSE) of localization is 1.4,cm,and the navigation error in teaching and playback is within 10,cm.
基金Projects(41072266,50525414)supported by the National Science Foundation of ChinaProject(648296)supported by Doctor Foundation of Henan Polytechnic University,China
文摘Autonomous relative navigation is the key technology in mining or rescuing. On the basis of mine requirement and the theories of machine vision, an autonomous relative navigation algorithm for mine agent based on quaternion was proposed. In rotation transformation, this algorithm was represented by using quaternion. Because the Jacobi matrix of this method is lower than that of Hall algorithm, the calculation efficiency is improved by using this algorithm. The results of these experiments show that the computation burden of this algorithm based on quaternion is about half that of Hall algorithm. This algorithm based on quaternion is improved as a valid way to solve the problem of mine real-time navigation.
基金Sponsored by the Aerospace Technology Innovation Funding(Grant No. CASC0209)
文摘A second-order divided difference filter (SDDF) is derived for integrating line of sight measurement from vision sensor with acceleration and angular rate measurements of the follower to estimate the precise relative position,velocity and attitude of two unmanned aerial vehicles (UAVs).The second-order divided difference filter which makes use of multidimensional interpolation formulations to approximate the nonlinear transformations could achieve more accurate estimation and faster convergence from inaccurate initial conditions than standard extended Kalman filter.The filter formulation is based on relative motion equations.The global attitude parameterization is given by quarternion,while a generalized three-dimensional attitude representation is used to define the local attitude error.Simulation results are shown to compare the performance of the second-order divided difference filter with a standard extended Kalman filter approach.
基金financially supported by the Construction of Technical System of Green Leafy Vegetable Industry in Shanghai-Development and application of key technologies for high-density transplanting of green leafy vegetables[Shanghai Agricultural Science and Production(2023)No.2]the Jiangsu Provincial Key Research and Development Program(Grant No.BE2021342)A Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions(No.PAPD-2023-87).
文摘Some agriculture machinery like the transplanter,needs to operate by following the crop-free ridges.In order to improve working efficiency and quality,some autonomous navigation systems were developed and applied to ridge-following machinery.At present,agricultural navigation systems are mainly the satellite navigation system and the machine vision system.The satellite navigation system is difficult to apply to the machinery that needs to work by following the ridge because it cannot distinguish the shape of the navigated ridge and guide the machinery working along the ridge.In this study,697 cloudy ridge images and 235 sunny ridge images were taken in the field,and these images were used as the dataset.Moreover,a machine vision navigation method based on the color of ridges was proposed.Firstly,the regions of interest(ROI)in the ridge image were extracted according to the reaction time and the forward speed of the machine.Then,a gray reconstruction method was used to enlarge the color difference between the ridge and the furrow.The optimal threshold for the gray image segmenting was calculated real-timely by using the threshold segmentation method.Then,based on the contour detection method,the ridge contour which was not surrounded by holes was extracted.Finally,the approximate quadrilateral method was proposed to recognize the ridge center line as the navigation line.The method proposed in this study was verified by four types of ridges with different colors and textures.The experimental results showed that the recognition success rates of the light ridge,the dark ridge,the film-covered ridge,and the sunny ridge were 100%,97.5%,100%,and 98.7%,respectively.The recognition success rate of the proposed method was at least 8%higher than that of the existing ridge-furrow recognition methods.The results indicate that this method can effectively realize navigation line recognition.This method can provide technical support for the autonomous navigation of agricultural machinery,such as transplanters,seeders,etc.,operating on the ridge without crops.
文摘For the improvement of accuracy and better fault-tolerant performance, a global position system (GPS)/vision navigation (VISNAV) integrated relative navigation and attitude determination approach is presented for ultra-close spacecraft formation flying. Onboard GPS and VISNAV system are adopted and a federal Kalman filter architecture is used for the total navigation system design. Simulation results indicate that the integrated system can provide a total improvement of relative navigation and attitude estimation performance in accuracy and fault-tolerance.
文摘This article presents a good robust and real-time system scheme of the mobile robot obstacle detection and navigation, which principle of work is based on the feature descriptor SURF. In this scheme, firstly, the image information of the mobile robot path was captured by the binocular camera; then the feature points were extracted and corresponding matched using SURF to the binocular images as the undetected obstacles; finally fixed the position of the objective by the parallax between the matching points combining with the binocular vision calibration model. Theoretical derivation and experimental results show that this scheme is more accurate for the detection and navigation of the interest points. It has fast matching speed and high accuracy and low error. So, it has certain practical effect and popularizing value for the mobile robot real-time obstacle avoidance and navigation.
文摘Purpose: Professional high speed sea navigational procedures are based on turn points, courses, dangers and steering cues in the environment. Since navigational aids have become less expensive and due to the fact that electronic sea charts can be integrated with both radar and transponder information, it may be assumed that traditional navigation by using paper based charts and radar will play a less significant role in the future, especially among less experienced navigators. Possible navigational differences between experienced and non-experienced boat drivers is thus of interest with regards to their use of navigational aids. It may be assumed that less experienced navigators rely too much on the information given by the electronic sea chart, despite the fact that it is based on GPS information that can be questioned, especially in littoral waters close to land. Method: This eye tracking study investigates gaze behaviour from 16 ex perienced and novice boat drivers during high speed navigation at sea. Results: The results show that the novice drivers look at objects that are close to themselves, like instrumentation, while the experienced look more at objects far away from the boat. This is in accordance with previous research on car drivers. Further, novice boat drivers used the electronic navigational aids to a larger extent than the experienced, especially during high speed conditions. The experienced drivers focused much of their attention on objects outside the boat. Conclusions: The findings verify that novice boat drivers tend to rely on electronic navigational aids. Experienced drivers presumably use the navigational aids to verify what they have observed in the surrounding environment and further use the paper based sea chart to a larger extent than the novice drivers.