A new visual servo control scheme for a robotic manipulator is presented in this paper, where a back propagation (BP) neural network is used to make a direct transition from image feature to joint angles without req...A new visual servo control scheme for a robotic manipulator is presented in this paper, where a back propagation (BP) neural network is used to make a direct transition from image feature to joint angles without requiring robot kinematics and camera calibration. To speed up the convergence and avoid local minimum of the neural network, this paper uses a genetic algorithm to find the optimal initial weights and thresholds and then uses the BP Mgorithm to train the neural network according to the data given. The proposed method can effectively combine the good global searching ability of genetic algorithms with the accurate local searching feature of BP neural network. The Simulink model for PUMA560 robot visual servo system based on the improved BP neural network is built with the Robotics Toolbox of Matlab. The simulation results indicate that the proposed method can accelerate convergence of the image errors and provide a simple and effective way of robot control.展开更多
A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of ...A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of the robot are derived and learned by a neural network. Secondly, a learning controller based on the neural network is designed for the robot to trace the object. Thirdly, a discrete time impedance control law is obtained for the force servoing of the robot, the on-line learning algorithms for three neural networks are developed to adjust the impedance parameters of the robot in the unknown environment. Lastly, wiping experiments are carried out by using a 6 DOF industrial robot with a CCD camera and a force/torque sensor in its end effector, and the experimental results confirm the effecti veness of the approach.展开更多
The tele-operation robotic system which consists of an excavator as the construction robot, and two joysticks for operating the robot from a safe place are useful for performing restoration in damaged areas. In order ...The tele-operation robotic system which consists of an excavator as the construction robot, and two joysticks for operating the robot from a safe place are useful for performing restoration in damaged areas. In order to accomplish a precise task, the operator needs to feel a realistic sense of task force brought about from a feedback force between the fork glove of slave robot and unfamiliar environment. A novel force feedback model is proposed based on velocity control of cylinder to determine environment force acting on fork glove. Namely, the feedback force is formed by the error of displacement of joystick with velocity and driving force of piston, and the gain is calculated by the driving force and threshold of driving force of hydraulic cylinder. Moreover, the variable gain improved algorithm is developed to overcome the defect for grasping soft object. Experimental results for fork glove freedom of robotic system are provided to demonstrate the developed algorithm is available for grasping soft object.展开更多
In order to ensure that the off-line arm of a two-arm-wheel combined inspection robot can reliably grasp the line in case of autonomous obstacle crossing,a control method is proposed for line grasping based on hand-ey...In order to ensure that the off-line arm of a two-arm-wheel combined inspection robot can reliably grasp the line in case of autonomous obstacle crossing,a control method is proposed for line grasping based on hand-eye visual servo.On the basis of the transmission line's geometrical characteristics and the camera's imaging principle,a line recognition and extraction method based on structure constraint is designed.The line's intercept and inclination are defined in an imaging space to represent the robot's change of pose and a law governing the pose decoupling servo control is developed.Under the integrated consideration of the influence of light intensity and background change,noise(from the camera itself and electromagnetic field)as well as the robot's kinetic inertia on the robot's imaging quality in the course of motion and the grasping control precision,a servo controller for grasping the line of the robot's off-line arm is designed with the method of fuzzy control.An experiment is conducted on a 1:1 simulation line using an inspection robot and the robot is put into on-line operation on a real overhead transmission line,where the robot can grasp the line within 18 s in the case of autonomous obstacle-crossing.The robot's autonomous line-grasping function is realized without manual intervention and the robot can grasp the line in a precise,reliable and efficient manner,thus the need of actual operation can be satisfied.展开更多
A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visua...A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visual guiding mode, for the robot works in an open loop visual servo control mode, the manipulating burden of the operator is reduced largely. In the visual servo mode the robot can locate the position of the target assigned by the operator and pick it up by its manipulator. With the help of the operator, the diffieuh problems of finding and handling a target in a complicated environment by the robot can be solved easily.展开更多
Soft robots show remarkable benefits over conventional rigid robots due to their high energy density and other factors. We propose a circular soft robot integrating the control system, actuating it with several shape ...Soft robots show remarkable benefits over conventional rigid robots due to their high energy density and other factors. We propose a circular soft robot integrating the control system, actuating it with several shape memory alloy (SMA) actuators. Our research methodology involved connecting the DC voltage supply and L298N module to provide uninterrupted power to the actuator and thence control the actuator via Arduino Uno MCU and TOF camera. We designed the controller to simultaneously complete the positioning and manipulation tasks. A novel method utilizing visual servo and closed-loop control algorithm was proposed and integrated into the controller. This method involves the implementation of multi-gait locomotion using SMA actuators. Additionally, the development of closed-loop dynamic controllers for a continuous soft robot is also evaluated. The proposed control model is designed and simulated on the MATLAB tool. To verify the efficiency of the proposed forward-feedback controller, simulations and experiments were conducted in the current study. A new control method using PID control based on the Kalman filtering algorithm and visual servo for the SMA actuator designed in this research is introduced. We conclude that applying spike excitation voltage would benefit the actuating performance. Overall, the experimental results demonstrated a promising future for the purposed control method.展开更多
针对无标定分拣并联机器人需获取精确图像雅可比矩阵的问题,同时为克服图像检测误差、建模误差及外部干扰对无标定视觉伺服系统的影响,提出一种基于扩张状态观测器(extended state observer,ESO)的分拣并联机器人无标定视觉伺服自适应...针对无标定分拣并联机器人需获取精确图像雅可比矩阵的问题,同时为克服图像检测误差、建模误差及外部干扰对无标定视觉伺服系统的影响,提出一种基于扩张状态观测器(extended state observer,ESO)的分拣并联机器人无标定视觉伺服自适应滑模控制方法。通过将表征机器人图像空间与任务空间映射关系的图像雅可比矩阵与系统不确定项集总到同一通道的状态方程,引入ESO对分拣并联机器人视觉伺服系统的集总不确定性进行在线估计,设计一种基于扩张状态观测器的自适应积分滑模控制器,并通过设计自适应律动态调整滑模控制切换增益,以提高视觉伺服系统精度,同时达到抑制滑模控制抖振的效果。采用Lyapunov稳定性理论证明该控制方法的稳定性,最后通过仿真实验验证了所提出视觉伺服自适应滑模控制方法的可行性和有效性。展开更多
文摘A new visual servo control scheme for a robotic manipulator is presented in this paper, where a back propagation (BP) neural network is used to make a direct transition from image feature to joint angles without requiring robot kinematics and camera calibration. To speed up the convergence and avoid local minimum of the neural network, this paper uses a genetic algorithm to find the optimal initial weights and thresholds and then uses the BP Mgorithm to train the neural network according to the data given. The proposed method can effectively combine the good global searching ability of genetic algorithms with the accurate local searching feature of BP neural network. The Simulink model for PUMA560 robot visual servo system based on the improved BP neural network is built with the Robotics Toolbox of Matlab. The simulation results indicate that the proposed method can accelerate convergence of the image errors and provide a simple and effective way of robot control.
基金This project was supported by the research foundation of China Education Ministry for the scholars from abroad (2002247).
文摘A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of the robot are derived and learned by a neural network. Secondly, a learning controller based on the neural network is designed for the robot to trace the object. Thirdly, a discrete time impedance control law is obtained for the force servoing of the robot, the on-line learning algorithms for three neural networks are developed to adjust the impedance parameters of the robot in the unknown environment. Lastly, wiping experiments are carried out by using a 6 DOF industrial robot with a CCD camera and a force/torque sensor in its end effector, and the experimental results confirm the effecti veness of the approach.
基金supported by National Natural Science Foundation of China(No.50475011).
文摘The tele-operation robotic system which consists of an excavator as the construction robot, and two joysticks for operating the robot from a safe place are useful for performing restoration in damaged areas. In order to accomplish a precise task, the operator needs to feel a realistic sense of task force brought about from a feedback force between the fork glove of slave robot and unfamiliar environment. A novel force feedback model is proposed based on velocity control of cylinder to determine environment force acting on fork glove. Namely, the feedback force is formed by the error of displacement of joystick with velocity and driving force of piston, and the gain is calculated by the driving force and threshold of driving force of hydraulic cylinder. Moreover, the variable gain improved algorithm is developed to overcome the defect for grasping soft object. Experimental results for fork glove freedom of robotic system are provided to demonstrate the developed algorithm is available for grasping soft object.
基金Project(2006AA04Z202)supported by the National High Technology Research and Development Program of ChinaProject(51105281)supported by the National Natural Science Foundation of China
文摘In order to ensure that the off-line arm of a two-arm-wheel combined inspection robot can reliably grasp the line in case of autonomous obstacle crossing,a control method is proposed for line grasping based on hand-eye visual servo.On the basis of the transmission line's geometrical characteristics and the camera's imaging principle,a line recognition and extraction method based on structure constraint is designed.The line's intercept and inclination are defined in an imaging space to represent the robot's change of pose and a law governing the pose decoupling servo control is developed.Under the integrated consideration of the influence of light intensity and background change,noise(from the camera itself and electromagnetic field)as well as the robot's kinetic inertia on the robot's imaging quality in the course of motion and the grasping control precision,a servo controller for grasping the line of the robot's off-line arm is designed with the method of fuzzy control.An experiment is conducted on a 1:1 simulation line using an inspection robot and the robot is put into on-line operation on a real overhead transmission line,where the robot can grasp the line within 18 s in the case of autonomous obstacle-crossing.The robot's autonomous line-grasping function is realized without manual intervention and the robot can grasp the line in a precise,reliable and efficient manner,thus the need of actual operation can be satisfied.
基金Supported by National Natural Science Foundation of China(60874002) Key Project of Shanghai Education Committee (09ZZ158) Leading Academic Discipline Project of Shanghai Municipal Government (S30501)
基金Supported by the National High Technology Research and Development Program of China (No. 2003AA421030) and the National Science Foundation of China (No. 60375026).
文摘A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visual guiding mode, for the robot works in an open loop visual servo control mode, the manipulating burden of the operator is reduced largely. In the visual servo mode the robot can locate the position of the target assigned by the operator and pick it up by its manipulator. With the help of the operator, the diffieuh problems of finding and handling a target in a complicated environment by the robot can be solved easily.
文摘Soft robots show remarkable benefits over conventional rigid robots due to their high energy density and other factors. We propose a circular soft robot integrating the control system, actuating it with several shape memory alloy (SMA) actuators. Our research methodology involved connecting the DC voltage supply and L298N module to provide uninterrupted power to the actuator and thence control the actuator via Arduino Uno MCU and TOF camera. We designed the controller to simultaneously complete the positioning and manipulation tasks. A novel method utilizing visual servo and closed-loop control algorithm was proposed and integrated into the controller. This method involves the implementation of multi-gait locomotion using SMA actuators. Additionally, the development of closed-loop dynamic controllers for a continuous soft robot is also evaluated. The proposed control model is designed and simulated on the MATLAB tool. To verify the efficiency of the proposed forward-feedback controller, simulations and experiments were conducted in the current study. A new control method using PID control based on the Kalman filtering algorithm and visual servo for the SMA actuator designed in this research is introduced. We conclude that applying spike excitation voltage would benefit the actuating performance. Overall, the experimental results demonstrated a promising future for the purposed control method.
文摘针对无标定分拣并联机器人需获取精确图像雅可比矩阵的问题,同时为克服图像检测误差、建模误差及外部干扰对无标定视觉伺服系统的影响,提出一种基于扩张状态观测器(extended state observer,ESO)的分拣并联机器人无标定视觉伺服自适应滑模控制方法。通过将表征机器人图像空间与任务空间映射关系的图像雅可比矩阵与系统不确定项集总到同一通道的状态方程,引入ESO对分拣并联机器人视觉伺服系统的集总不确定性进行在线估计,设计一种基于扩张状态观测器的自适应积分滑模控制器,并通过设计自适应律动态调整滑模控制切换增益,以提高视觉伺服系统精度,同时达到抑制滑模控制抖振的效果。采用Lyapunov稳定性理论证明该控制方法的稳定性,最后通过仿真实验验证了所提出视觉伺服自适应滑模控制方法的可行性和有效性。