A tracking stability control problem for the vertical electric stabilization system of moving tank based on adaptive robust servo control is addressed.This paper mainly focuses on two types of possibly fast timevaryin...A tracking stability control problem for the vertical electric stabilization system of moving tank based on adaptive robust servo control is addressed.This paper mainly focuses on two types of possibly fast timevarying but bounded uncertainty within the vertical electric stabilization system:model parameter uncertainty and uncertain nonlinearity.First,the vertical electric stabilization system is constructed as an uncertain nonlinear dynamic system that can reflect the practical mechanics transfer process of the system.Second,the dynamical equation in the form of state space is established by designing the angular tracking error.Third,the comprehensive parameter of system uncertainty is designed to estimate the most conservative effects of uncertainty.Finally,an adaptive robust servo control which can effectively handle the combined effects of complex nonlinearity and uncertainty is proposed.The feasibility of the proposed control strategy under the practical physical condition is validated through the tests on the experimental platform.This paper pioneers the introduction of the internal nonlinearity and uncertainty of the vertical electric stabilization system into the settlement of the tracking stability control problem,and validates the advanced servo control strategy through experiment for the first time.展开更多
This article analyzes and discusses the working principle and problems encountered by various servo amplification devices used in the on-site continuous adjustment system,analyzes and discusses the application of the ...This article analyzes and discusses the working principle and problems encountered by various servo amplification devices used in the on-site continuous adjustment system,analyzes and discusses the application of the servo mechanism,and analyzes the mechanism of the servo device's implementation of the"positioning"func-tion on the control device.Intended to guide the continuous adjustment process in controlling the function/accuracy of actuator equipment and application debugging,ensuring the safe and stable operation of production equipment and facilities.展开更多
A visual servoing tracking controller is proposed based on the sliding mode control theory in order to achieve strong robustness against parameter variations and external disturbances. A sliding plane with time delay ...A visual servoing tracking controller is proposed based on the sliding mode control theory in order to achieve strong robustness against parameter variations and external disturbances. A sliding plane with time delay compensation is presented by the pre-estimate of states. To reduce the chattering of the sliding mode controller, a modified exponential reaching law and hyperbolic tangent function are applied to the design of visual controller and robot joint controller. Simulation results show that the visual servoing control scheme is robust and has good tracking performance.展开更多
This paper presents an improved support vector machine (SVM) algorithm, which employs invariant moments-based edge extraction to obtain feature attribute. A heuristic attribute reduction algorithm based on rough set...This paper presents an improved support vector machine (SVM) algorithm, which employs invariant moments-based edge extraction to obtain feature attribute. A heuristic attribute reduction algorithm based on rough set's discernible matrix is proposed to identify and classify micro-targets. To avoid the complicated calibration for intrinsic parameters of camera, an improved Broyden's method is proposed to estimate the image Jacobian matrix which employs Chebyshev polynomial to construct a cost function to approximate the optimization value. Finally, a visual controller is designed for a robotic micromanipulation system. The experiment results of micro-parts assembly show that the proposed methods and algorithms are effective and feasible.展开更多
A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of ...A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of the robot are derived and learned by a neural network. Secondly, a learning controller based on the neural network is designed for the robot to trace the object. Thirdly, a discrete time impedance control law is obtained for the force servoing of the robot, the on-line learning algorithms for three neural networks are developed to adjust the impedance parameters of the robot in the unknown environment. Lastly, wiping experiments are carried out by using a 6 DOF industrial robot with a CCD camera and a force/torque sensor in its end effector, and the experimental results confirm the effecti veness of the approach.展开更多
There are two main trends in the development of unmanned aerial vehicle(UAV)technologies:miniaturization and intellectualization,in which realizing object tracking capabilities for a nano-scale UAV is one of the most ...There are two main trends in the development of unmanned aerial vehicle(UAV)technologies:miniaturization and intellectualization,in which realizing object tracking capabilities for a nano-scale UAV is one of the most challenging problems.In this paper,we present a visual object tracking and servoing control system utilizing a tailor-made 38 g nano-scale quadrotor.A lightweight visual module is integrated to enable object tracking capabilities,and a micro positioning deck is mounted to provide accurate pose estimation.In order to be robust against object appearance variations,a novel object tracking algorithm,denoted by RMCTer,is proposed,which integrates a powerful short-term tracking module and an efficient long-term processing module.In particular,the long-term processing module can provide additional object information and modify the short-term tracking model in a timely manner.Furthermore,a positionbased visual servoing control method is proposed for the quadrotor,where an adaptive tracking controller is designed by leveraging backstepping and adaptive techniques.Stable and accurate object tracking is achieved even under disturbances.Experimental results are presented to demonstrate the high accuracy and stability of the whole tracking system.展开更多
This paper describes a system for grasping known objects with unmanned aerial vehicles (UAVs) provided with dual manipulators using an RGB-D camera. Aerial manipulation remains a very challenging task. This paper cove...This paper describes a system for grasping known objects with unmanned aerial vehicles (UAVs) provided with dual manipulators using an RGB-D camera. Aerial manipulation remains a very challenging task. This paper covers three principal aspects for this task: object detection and pose estimation, grasp planning, and in-flight grasp execution. First, an artificial neural network (ANN) is used to obtain clues regarding the object’s position. Next, an alignment algorithm is used to obtain the object’s sixdimensional (6D) pose, which is filtered with an extended Kalman filter. A three-dimensional (3D) model of the object is then used to estimate an arranged list of good grasps for the aerial manipulator. The results from the detection algorithm—that is, the object’s pose—are used to update the trajectories of the arms toward the object. If the target poses are not reachable due to the UAV’s oscillations, the algorithm switches to the next feasible grasp. This paper introduces the overall methodology, and provides the experimental results of both simulation and real experiments for each module, in addition to a video showing the results.展开更多
In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of im...In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of image Jacobian, CMAC (cerebellar model articulation controller) neural network is inserted into visual servo control loop to implement the nonlinear mapping. Two control schemes are used. Simulation results on two schemes are provided, which show a better tracking precision and stability can be achieved using scheme 2.展开更多
Target tracking is one typical application of visual servoing technology. It is still a difficult task to track high speed target with current visual servo system. The improvement of visual servoing scheme is strongly...Target tracking is one typical application of visual servoing technology. It is still a difficult task to track high speed target with current visual servo system. The improvement of visual servoing scheme is strongly required. A position-based visual servo parallel system is presented for tracking target with high speed. A local Frenet frame is assigned to the sampling point of spatial trajectory. Position estimation is formed by the differential features of intrinsic geometry, and orientation estimation is formed by homogenous transformation. The time spent for searching and processing can be greatly reduced by shifting the window according to features location prediction. The simulation results have demonstrated the ability of the system to track spatial moving object.展开更多
Hydraulic servo system plays an important role in industrial fields due to the advantages of high response,small size-to-power ratio and large driving force.However,inherent nonlinear behaviors and modeling uncertaint...Hydraulic servo system plays an important role in industrial fields due to the advantages of high response,small size-to-power ratio and large driving force.However,inherent nonlinear behaviors and modeling uncertainties are the main obstacles for hydraulic servo system to achieve high tracking perfor-mance.To deal with these difficulties,this paper presents a backstepping sliding mode controller to improve the dynamic tracking performance and anti-interfer-ence ability.For this purpose,the nonlinear dynamic model is firstly established,where the nonlinear behaviors and modeling uncertainties are lumped as one term.Then,the extended state observer is introduced to estimate the lumped distur-bance.The system stability is proved by using the Lyapunov stability theorem.Finally,comparative simulation and experimental are conducted on a hydraulic servo system platform to verify the efficiency of the proposed control scheme.展开更多
A robust visual servoing system is investigated on a humanoid robot which grasps a brush in Chinese calligraphy task.The system is implemented based on uncalibrated visual servoing controller utilizing Kalman-Bucy fil...A robust visual servoing system is investigated on a humanoid robot which grasps a brush in Chinese calligraphy task.The system is implemented based on uncalibrated visual servoing controller utilizing Kalman-Bucy filter,with the help of an object detector by continuously adaptive MeanShift(CAMShift) algorithm.Under this control scheme,a humanoid robot can satisfactorily grasp a brush without system modeling.The proposed method is shown to be robust and effective through a Chinese calligraphy task on a NAO robot.展开更多
The hydraulic servo actuator of heavy vehicle active suspension is investigated to clarify the correlation between system parameters and the control characteristics of active suspension hydraulic servo system.Accordin...The hydraulic servo actuator of heavy vehicle active suspension is investigated to clarify the correlation between system parameters and the control characteristics of active suspension hydraulic servo system.Accordingly, a nonlinear physical model of electro-hydraulic servo active suspension system is built.Compared with the conventional nonlinear modeling, the model in this study considers the asymmetry of working areas caused by single rod hydraulic cylinder in the suspension system.In accordance with the model, a nonlinear output feedback controller based on backstepping is designed, and the effectiveness of the controller is proved based on the experimental platform.The dynamic response curve of the electro-hydraulic servo control system under the change of parameters is generated based on the simulation model.The sensitivity of electro-hydraulic servo control performance to the change of system physical parameters is investigated, and two evaluation indexes are proposed to quantify and compare the effect of all physical parameter changes on position control system.As revealed by the results, the position control characteristics of suspension actuator are more sensitive to the changes of flow gain of the servo valve, system supply oil pressure and effective working areas of cylinder, and the two evaluation indexes are over 10 times higher than other physical parameters.展开更多
Welding path planning can substitute for the manual teaching process of the robot and can promote the autonomous level of the robotic welding. A path planning method by visual servoing was presented, in which the opti...Welding path planning can substitute for the manual teaching process of the robot and can promote the autonomous level of the robotic welding. A path planning method by visual servoing was presented, in which the optimal angle of charge-coupled device (CCD) camera was also planned. Aiming at planning two forms of kinked line seams, obtuse angle seam and right angle seam, a practicable solution was put forward. In this solution, the intersection of two adjacent straight segments is detected in each local seam image, and if intersection is found, the seam errors are calculated using the next straight segment. The experimental results show that kinked line seam can be well planned using this solution.展开更多
In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the traject...In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.展开更多
Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing sys...Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing system of tracking a moving target is proposed. The method does not require calibration of camera and robot kinematic models. Vision guided algorithm for tracking dynamic image is developed through minimizing nonlinear objective function. For the large residual has not been approximated in dynamic environment and the change of composite image Jacobian with time increment has not been computed in visual servoing system now,large residuals are dynamic approximated and the change of composite image Jacobian at each iterative step is computed. Simulation results demonstrate the validity of these approaches.展开更多
Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distribute...Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distributed visual sensors. The designed fusion algorithm is suitable to have dynamically adjustable fusion weights, and the fusion structure was analyzed. Simulations and experiments without any knowledge of mobile robots and uncalibrated visual sensors show that the method has higher adaptability than the traditional instant switch control method. The method can enhance the system stability at the switching process.展开更多
基金supported in part by the Nation Natural Science Foundation of China under Grant No.52175099China Postdoctoral Science Foundation under Grant No.2020M671494Jiangsu Planned Projects for Postdoctoral Research Funds under Grant No.2020Z179。
文摘A tracking stability control problem for the vertical electric stabilization system of moving tank based on adaptive robust servo control is addressed.This paper mainly focuses on two types of possibly fast timevarying but bounded uncertainty within the vertical electric stabilization system:model parameter uncertainty and uncertain nonlinearity.First,the vertical electric stabilization system is constructed as an uncertain nonlinear dynamic system that can reflect the practical mechanics transfer process of the system.Second,the dynamical equation in the form of state space is established by designing the angular tracking error.Third,the comprehensive parameter of system uncertainty is designed to estimate the most conservative effects of uncertainty.Finally,an adaptive robust servo control which can effectively handle the combined effects of complex nonlinearity and uncertainty is proposed.The feasibility of the proposed control strategy under the practical physical condition is validated through the tests on the experimental platform.This paper pioneers the introduction of the internal nonlinearity and uncertainty of the vertical electric stabilization system into the settlement of the tracking stability control problem,and validates the advanced servo control strategy through experiment for the first time.
文摘This article analyzes and discusses the working principle and problems encountered by various servo amplification devices used in the on-site continuous adjustment system,analyzes and discusses the application of the servo mechanism,and analyzes the mechanism of the servo device's implementation of the"positioning"func-tion on the control device.Intended to guide the continuous adjustment process in controlling the function/accuracy of actuator equipment and application debugging,ensuring the safe and stable operation of production equipment and facilities.
基金supported by China Postdoctoral Science Founda-tion (No. 20080441093)Key Laboratory Foundation of Liaoning Province (No. 2008S088).
文摘A visual servoing tracking controller is proposed based on the sliding mode control theory in order to achieve strong robustness against parameter variations and external disturbances. A sliding plane with time delay compensation is presented by the pre-estimate of states. To reduce the chattering of the sliding mode controller, a modified exponential reaching law and hyperbolic tangent function are applied to the design of visual controller and robot joint controller. Simulation results show that the visual servoing control scheme is robust and has good tracking performance.
基金supported by National Natural Science Foundation of China (No.60873032)National High Technology Research and Development Program of China (863 Program) (No.2008AA8041302)
文摘This paper presents an improved support vector machine (SVM) algorithm, which employs invariant moments-based edge extraction to obtain feature attribute. A heuristic attribute reduction algorithm based on rough set's discernible matrix is proposed to identify and classify micro-targets. To avoid the complicated calibration for intrinsic parameters of camera, an improved Broyden's method is proposed to estimate the image Jacobian matrix which employs Chebyshev polynomial to construct a cost function to approximate the optimization value. Finally, a visual controller is designed for a robotic micromanipulation system. The experiment results of micro-parts assembly show that the proposed methods and algorithms are effective and feasible.
基金This project was supported by the research foundation of China Education Ministry for the scholars from abroad (2002247).
文摘A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of the robot are derived and learned by a neural network. Secondly, a learning controller based on the neural network is designed for the robot to trace the object. Thirdly, a discrete time impedance control law is obtained for the force servoing of the robot, the on-line learning algorithms for three neural networks are developed to adjust the impedance parameters of the robot in the unknown environment. Lastly, wiping experiments are carried out by using a 6 DOF industrial robot with a CCD camera and a force/torque sensor in its end effector, and the experimental results confirm the effecti veness of the approach.
基金supported in part by the Institute for Guo Qiang of Tsinghua University(2019GQG1023)in part by Graduate Education and Teaching Reform Project of Tsinghua University(202007J007)+1 种基金in part by National Natural Science Foundation of China(U19B2029,62073028,61803222)in part by the Independent Research Program of Tsinghua University(2018Z05JDX002)。
文摘There are two main trends in the development of unmanned aerial vehicle(UAV)technologies:miniaturization and intellectualization,in which realizing object tracking capabilities for a nano-scale UAV is one of the most challenging problems.In this paper,we present a visual object tracking and servoing control system utilizing a tailor-made 38 g nano-scale quadrotor.A lightweight visual module is integrated to enable object tracking capabilities,and a micro positioning deck is mounted to provide accurate pose estimation.In order to be robust against object appearance variations,a novel object tracking algorithm,denoted by RMCTer,is proposed,which integrates a powerful short-term tracking module and an efficient long-term processing module.In particular,the long-term processing module can provide additional object information and modify the short-term tracking model in a timely manner.Furthermore,a positionbased visual servoing control method is proposed for the quadrotor,where an adaptive tracking controller is designed by leveraging backstepping and adaptive techniques.Stable and accurate object tracking is achieved even under disturbances.Experimental results are presented to demonstrate the high accuracy and stability of the whole tracking system.
文摘This paper describes a system for grasping known objects with unmanned aerial vehicles (UAVs) provided with dual manipulators using an RGB-D camera. Aerial manipulation remains a very challenging task. This paper covers three principal aspects for this task: object detection and pose estimation, grasp planning, and in-flight grasp execution. First, an artificial neural network (ANN) is used to obtain clues regarding the object’s position. Next, an alignment algorithm is used to obtain the object’s sixdimensional (6D) pose, which is filtered with an extended Kalman filter. A three-dimensional (3D) model of the object is then used to estimate an arranged list of good grasps for the aerial manipulator. The results from the detection algorithm—that is, the object’s pose—are used to update the trajectories of the arms toward the object. If the target poses are not reachable due to the UAV’s oscillations, the algorithm switches to the next feasible grasp. This paper introduces the overall methodology, and provides the experimental results of both simulation and real experiments for each module, in addition to a video showing the results.
基金This project is supported by National Natural Science Foundation of China (No.59990470).
文摘In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of image Jacobian, CMAC (cerebellar model articulation controller) neural network is inserted into visual servo control loop to implement the nonlinear mapping. Two control schemes are used. Simulation results on two schemes are provided, which show a better tracking precision and stability can be achieved using scheme 2.
基金Supported by National Natural Science Foundation of China(60874002) Key Project of Shanghai Education Committee (09ZZ158) Leading Academic Discipline Project of Shanghai Municipal Government (S30501)
基金This project is supported by National Electric Power Corporation Foundation of China(No.SPKJ010-27).
文摘Target tracking is one typical application of visual servoing technology. It is still a difficult task to track high speed target with current visual servo system. The improvement of visual servoing scheme is strongly required. A position-based visual servo parallel system is presented for tracking target with high speed. A local Frenet frame is assigned to the sampling point of spatial trajectory. Position estimation is formed by the differential features of intrinsic geometry, and orientation estimation is formed by homogenous transformation. The time spent for searching and processing can be greatly reduced by shifting the window according to features location prediction. The simulation results have demonstrated the ability of the system to track spatial moving object.
基金Thework issupportedby the Key Scienceand Technology Programof Henan Province(Grant No.222102220104)the Science and Technology Key Project Foundation of Henan Provincial Education Department(Grant No.23A460014)the High Level Talent Foundation of Henan University of Technology(Grant No.2020BS043).
文摘Hydraulic servo system plays an important role in industrial fields due to the advantages of high response,small size-to-power ratio and large driving force.However,inherent nonlinear behaviors and modeling uncertainties are the main obstacles for hydraulic servo system to achieve high tracking perfor-mance.To deal with these difficulties,this paper presents a backstepping sliding mode controller to improve the dynamic tracking performance and anti-interfer-ence ability.For this purpose,the nonlinear dynamic model is firstly established,where the nonlinear behaviors and modeling uncertainties are lumped as one term.Then,the extended state observer is introduced to estimate the lumped distur-bance.The system stability is proved by using the Lyapunov stability theorem.Finally,comparative simulation and experimental are conducted on a hydraulic servo system platform to verify the efficiency of the proposed control scheme.
基金Supported by the National High Technology Research and Development Program of China (No. 2003AA421030) and the National Science Foundation of China (No. 60375026).
基金Supported by the National Natural Science Foundation of China(No.61221003)
文摘A robust visual servoing system is investigated on a humanoid robot which grasps a brush in Chinese calligraphy task.The system is implemented based on uncalibrated visual servoing controller utilizing Kalman-Bucy filter,with the help of an object detector by continuously adaptive MeanShift(CAMShift) algorithm.Under this control scheme,a humanoid robot can satisfactorily grasp a brush without system modeling.The proposed method is shown to be robust and effective through a Chinese calligraphy task on a NAO robot.
基金Supported by the National Natural Science Foundation of China (No. U20A20332, 52175063)Hebei Province PhD Graduate Innovation Funding Project (No. CXZZBS2021121)。
文摘The hydraulic servo actuator of heavy vehicle active suspension is investigated to clarify the correlation between system parameters and the control characteristics of active suspension hydraulic servo system.Accordingly, a nonlinear physical model of electro-hydraulic servo active suspension system is built.Compared with the conventional nonlinear modeling, the model in this study considers the asymmetry of working areas caused by single rod hydraulic cylinder in the suspension system.In accordance with the model, a nonlinear output feedback controller based on backstepping is designed, and the effectiveness of the controller is proved based on the experimental platform.The dynamic response curve of the electro-hydraulic servo control system under the change of parameters is generated based on the simulation model.The sensitivity of electro-hydraulic servo control performance to the change of system physical parameters is investigated, and two evaluation indexes are proposed to quantify and compare the effect of all physical parameter changes on position control system.As revealed by the results, the position control characteristics of suspension actuator are more sensitive to the changes of flow gain of the servo valve, system supply oil pressure and effective working areas of cylinder, and the two evaluation indexes are over 10 times higher than other physical parameters.
文摘Welding path planning can substitute for the manual teaching process of the robot and can promote the autonomous level of the robotic welding. A path planning method by visual servoing was presented, in which the optimal angle of charge-coupled device (CCD) camera was also planned. Aiming at planning two forms of kinked line seams, obtuse angle seam and right angle seam, a practicable solution was put forward. In this solution, the intersection of two adjacent straight segments is detected in each local seam image, and if intersection is found, the seam errors are calculated using the next straight segment. The experimental results show that kinked line seam can be well planned using this solution.
基金Supported by the National Natural Science Foundation of China(No.60905061)the National Natural Science Foundation of Tianjin(No.08JCYBJC12700)
文摘In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.
文摘Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing system of tracking a moving target is proposed. The method does not require calibration of camera and robot kinematic models. Vision guided algorithm for tracking dynamic image is developed through minimizing nonlinear objective function. For the large residual has not been approximated in dynamic environment and the change of composite image Jacobian with time increment has not been computed in visual servoing system now,large residuals are dynamic approximated and the change of composite image Jacobian at each iterative step is computed. Simulation results demonstrate the validity of these approaches.
基金The National Natural Science Foundation of China (No 60428303)
文摘Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distributed visual sensors. The designed fusion algorithm is suitable to have dynamically adjustable fusion weights, and the fusion structure was analyzed. Simulations and experiments without any knowledge of mobile robots and uncalibrated visual sensors show that the method has higher adaptability than the traditional instant switch control method. The method can enhance the system stability at the switching process.