Human stochastic closed-loop behavior for master-slave teleoperation using multi-leap-motion sensor

abstracting human control strategy in controlling dynamically stable robots.J Intell Robot Syst,2009,55：39-54

A master-slave generalized predictive synchronization control for preheating process of multi-cavity hot runner system

As a key component of injection molding,multi-cavity hot runner(MCHR)system faces the crucial problem of polymer melt filling imbalance among the cavities.The thermal imbalance in the system has been considered as the leading cause.Hence,the solution may rest with the synchronization of those heating processes in MCHR system.This paper proposes a’Master-Slave’generalized predictive synchronization control(MS-GPSC)method with’Mr.Slowest’strategy for preheating stage of MCHR system.The core of the proposed method is choosing the heating process with slowest dynamics as the’Master’to track the setpoint,while the other heating processes are treated as‘Slaves’tracking the output of’Master’.This proposed method is shown to have the good ability of temperature synchronization.The corresponding analysis is conducted on parameters tuning and stability,simulations and experiments show the strategy is effective.

An Adaptive Hand Exoskeleton for Teleoperation System

Teleoperation can assist people to complete various complex tasks in inaccessible or high-risk environments,in which a wearable hand exoskeleton is one of the key devices.Adequate adaptability would be available to enable the master hand exoskeleton to capture the motion of human fingers and reproduce the contact force between the slave hand and its object.This paper presents a novel finger exoskeleton based on the cascading four-link closed-loop kinematic chain.Each finger has an independent closed-loop kinematic chain,and the angle sensors are used to obtain the finger motion including the flexion/extension and the adduction/abduction.The cable tension is changed by the servo motor to transmit the contact force to the fingers in real time.Based on the finger exoskeleton,an adaptive hand exoskeleton is consequently developed.In addition,the hand exoskeleton is tested in a master-slave system.The experiment results show that the adaptive hand exoskeleton can be worn without any mechanical constraints,and the slave hand can follow the motions of each human finger.The accuracy and the real-time capability of the force reproduction are validated.The proposed adaptive hand exoskeleton can be employed as the master hand to remotely control the humanoid five-fingered dexterous slave hand,thus,enabling the teleoperation system to complete complex dexterous manipulation tasks.

Position Measurement Based Slave Torque Feedback Control for Teleoperation Systems With Time-Varying Communication Delays

Bilateral teleoperation system is referred to as a promising technology to extend human actions and intelligence to manipulating objects remotely.For the tracking control of teleoperation systems,velocity measurements are necessary to provide feedback information.However,due to hardware technology and cost constraints,the velocity measurements are not always available.In addition,the time-varying communication delay makes it challenging to achieve tracking task.This paper provides a solution to the issue of real-time tracking for teleoperation systems,subjected to unavailable velocity signals and time-varying communication delays.In order to estimate the velocity information,immersion and invariance(I&I)technique is employed to develop an exponential stability velocity observer.For the proposed velocity observer,a linear relationship between position and observation state is constructed,through which the need of solving partial differential and certain integral equations can be avoided.Meanwhile,the mean value theorem is exploited to separate the observation error terms,and hence,all functions in our observer can be analytically expressed.With the estimated velocity information,a slave-torque feedback control law is presented.A novel Lyapunov-Krasovskii functional is constructed to establish asymptotic tracking conditions.In particular,the relationship between the controller design parameters and the allowable maximum delay values is provided.Finally,simulation and experimental results reveal that the proposed velocity observer and controller can guarantee that the observation errors and tracking error converge to zero.

Tremor suppression in master-slave robot remote welding system

Welding seam tracking precision was decreased due to human hand tremor during the master-slave welding teleoperation. To solve this problem, a master-slave robot remote welding system was built, the system consisted of a master manipulator with six degree of freedom （ DOF ） , an industrial computer control system and a slave Motoman HP3 J robot, and human hand tremor and digital filtering were discussed. An optimal digital filter was designed to clean human tremor signal for improving the welding seam tracking precision. The experimental results show that the digital filter suppresses the operator＇ s tremor signal.

Master-Slave机器手协调控制选择行列式算法

提出了一种基于选择行列式的Master-Slave机器手的协调控制算法。通过选择行列式的导入,实现了对Master机器手和Slave机器手各个变量的协调控制。本方法应用于装有视觉传感器的机器手的追踪控制,经过实验证明了基于选择行列式的算法能够实现人类的某些技能赋予机器手,在支援机器手的同时还能够通过有效地协调遥控,完成机器手的自主控制。

Composite Nonlinear Bilateral Control for Teleoperation Systems With External Disturbances

This paper presents a new composite nonlinear bilateral control method based on the nonlinear disturbance observer(NDOB) for teleoperation systems with external disturbances. By introducing the estimations of NDOB and systems' nominal nonlinear dynamics into controller design, a NDOB based composite nonlinear bilateral controller is constructed to attenuate the influence of disturbance and uncertain nonlinearities. As compared with the existing bilateral control methods which usually achieve force haptic(i.e., contact force tracking)through a passive way, the newly proposed method has two major merits: 1) asymptotical convergence of both position and force tracking errors is guaranteed;2) disturbance influence on force tracking error dynamics is rejected through the direct feedforward compensation of disturbance estimation. Simulations on a nonlinear teleoperation system are carried out and the results validate the effectiveness of the proposed controller.

NOVEL 6-DOF WEARABLE EXOSKELETON ARM WITH PNEUMATIC FORCE-FEEDBACK FOR BILATERAL TELEOPERATION

A particular emphasis is put on a novel wearable exoskeleton arm, ZJUESA, with 6 degrees of freedom, which is used for the robot teleoperation with the force-feedback in the unknown environment. In this external structure mechanism, the 3-revolution-prismatic-spherical （3RPS） parallel mechanism is devised from the concept of the human upper-limb anatomy and applied for the shoulder 3-DOF joint. Meanwhile, the orthogonal experiment design method is introduced for its optimal design. Aiming at enhancing the performance of teleoperation, the force feedback is employed by the pneumatic system on ZJUESA to produce the vivid feeling in addition to the soft control interface. Due to the compressibility and nonlinearity of the pneumatic force feedback system, a novel hybrid fuzzy controller for the precise force control is proposed and realized based on the Mega8 microcontroller units as the units of the distributed control system on ZJUESA. With the results of several experiments for master-slave control with force feedback, the feasibility of ZJUESA system and the effect of its hybrid fuzzy controller are verified.

A Composite State Convergence Scheme for Bilateral Teleoperation Systems

State convergence is a novel control algorithm for bilateral teleoperation of robotic systems. First, it models the teleoperation system on state space and considers all the possible interactions between the master and slave systems. Second, it presents an elegant design procedure which requires a set of equations to be solved in order to compute the control gains of the bilateral loop. These design conditions are obtained by turning the master-slave error into an autonomous system and imposing the desired dynamic behavior of the teleoperation system. Resultantly, the convergence of master and slave states is achieved in a well-defined manner. The present study aims at achieving a similar convergence behavior offered by state convergence controller while reducing the number of variables sent across the communication channel. The proposal suggests transmitting composite master and slave variables instead of full master and slave states while keeping the operator's force channel intact. We show that,with these composite and force variables;it is indeed possible to achieve the convergence of states in a desired way by strictly following the method of state convergence. The proposal leads to a reduced complexity state convergence algorithm which is termed as composite state convergence controller. In order to validate the proposed scheme in the absence and presence of communication time delays, MATLAB simulations and semi-real time experiments are performed on a single degree-of-freedom teleoperation system.

A Master-Slave Blockchain Paradigm and Application in Digital Rights Management

Upon flaws of current blockchain platforms of heavyweight, large capacity of ledger, and time-consuming of synchronization of data, in this paper, we proposed a new paradigm of master-slave blockchain scheme(MSB) for pervasive computing that suitable for general PC, mobile device such as smart phones or PADs to participants in the working of mining and verification, in which we separated traditional blockchain model in 2 layer defined as master node layer and a series of slavery agents layer, then we proposed 2 approaches for partially computing model(PCM) and non-computing of model(NCM) in the MSB blockchain, Finally large amounts of simulations manifest the proposed master-slave blockchain scheme is feasible, extendible and suitable for pervasive computing especially in the 5 G generation environment, and can apply in the DRM-related applications.

A Telepresence-Guaranteed Control Scheme for Teleoperation Applications of Transferring Weight-Unknown Objects

Currently,most teleoperation work is focusing on scenarios where slave robots interact with unknown environments.However,in some fields such as medical robots or rescue robots,the other typical teleoperation application is precise object transportation.Generally,the object’s weight is unknown yet essential for both accurate control of the slave robot and intuitive perception of the human operator.However,due to high cost and limited installation space,it is unreliable to employ a force sensor to directly measure the weight.Therefore,in this paper,a control scheme free of force sensor is proposed for teleoperation robots to transfer a weight-unknown object accurately.In this scheme,the workspace mapping between master and slave robot is firstly established,based on which,the operator can generate command trajectory on-line by operating the master robot.Then,a slave controller is designed to follow the master command closely and estimate the object’s weight rapidly,accurately and robust to unmodeled uncertainties.Finally,for the sake of telepresence,a master controller is designed to generate force feedback to reproduce the estimated weight of the object.In the end,comparative experiments show that the proposed scheme can achieve better control accuracy and telepresence,with accurate force feedback generated in only 500 ms.

Achievement of chaotic synchronization trajectories of master-slave manipulators with feedback control strategy

This paper addresses a master-slave synchro- nization strategy for complex dynamic systems based on feedback control. This strategy is applied to 3-DOF pla- nar manipulators in order to obtain synchronization in such complicated as chaotic motions of end-effectors. A chaotic curve is selected from Duffing equation as the trajectory of master end-effector and a piecewise approximation method is proposed to accurately represent this chaotic trajectory of end-effectors. The dynamical equations of master-slave manipulators with synchronization controller are derived, and the Lyapunov stability theory is used to determine the stability of this controlled synchronization system. In numer- ical experiments, the synchronous motions of end-effectors as well as three joint angles and torques of master-slave manipulators are studied under the control of the proposed synchronization strategy. It is found that the positive gain matrix affects the implementation of synchronization con- trol strategy. This synchronization control strategy proves the synchronization＇s feasibility and controllability for com- plicated motions generated by master-slave manipulators.

Teleoperation strategies research for collaborative welding systems based on virtual reality

Teleoperation control strategies for collaborative welding system which is targeting at giving full play to human’s superiority is designed and the fitness for teleoperation welding task of which are studied. During the teleoperation welding process, 6-DOF controller’s signal can be converted into welding torch’s position, velocity or acceleration changing which is being controlled. For welding purposes, control strategies of four modes are designed, which are static position and posture mode, dynamic position and posture mode, velocity mode and acceleration mode. A test and analysis system for testing the tracking accuracy and reliability of control strategy based on virtual reality is developed. The tracking accuracies of the four control strategies are studied in the following tests with straight line trajectory, curve trajectory or space curve trajectory. The results show that the control strategy in dynamic position and posture mode has best stability and strong adaptability which is the most suitable for the teleoperation system.

Exponential networked synchronization of master-slave chaotic systems with timevarying communication topologies

The networked synchronization problem of a class of master-slave chaotic systems with time-varying communication topologies is investigated in this paper. Based on algebraic graph theory and matrix theory, a simple linear state feedback controller is designed to synchronize the master chaotic system and the slave chaotic systems with a time- varying communication topology connection. The exponential stability of the closed-loop networked synchronization error system is guaranteed by applying Lyapunov stability theory. The derived novel criteria are in the form of linear matrix inequalities （LMIs）, which are easy to examine and tremendously reduce the computation burden from the feedback matrices. This paper provides an alternative networked secure communication scheme which can be extended conveniently. An illustrative example is given to demonstrate the effectiveness of the proposed networked synchronization method.

Controller Design for a Teleoperation System with Time Delay

A robust controller design method is presented to guarantee the stability and zero tracking error for teleoperation system with time delay. Through choosing appropriate master and slave parameters, extended state equation about master and master-slave error is achieved, which can be analyzed by using time delay knowledge. Thus delay-independent and delay-dependent criteria are derived in terms of the Lyapunov stability theorem, control parameters are obtained by the feasible of linear matrix inequalities. Experimental results show the validity of these approaches and the performance of master and slave manipulators with delay variations is analyzed.

A Teleoperation System Based on Predictive Simulation and Its Application to Spacecraft Maintenance

A teleoperation system based on predictive simulation is proposed for the sake of compensating the large time delay in the process of teleoperation to a degree and providing a friendly operating interface. The framework and function architecture of the system is discussed firstly. Then, the operator interface and a graphics simulation system is described in detail. Furthermore, a predictive algorithm aiming at position control based teleoperation is studied in our research, and the relative framework of predictive simulation is discussed. Finally, the system is applied to spacecraft breakdown maintenance; multi-agent reinforcement learning based semi-autonomous teleoperation is discussed at the same time for safe operation.

Research on Master-slave Telerobot Force Telepresence Technology

A 3 DOF master-slave telerobot system is established for study on force telepresence technology. A force feedback and position control scheme is adopted in the bilateral force response control system,and force fidelity and controllability experiments demonstrate feasibility of the con-trol system.

Operation Modes and Control Schemes for Internet-Based Teleoperation System with Time Delay

Teleoperation system plays an important role in executing task under hazard environment. As the computer networks such as the Internet are being used as the communication channel of teleoperation system, varying time delay causes the overall system unstable and reduces the performance of transparency. This paper proposed twelve operation modes with different control schemes for teleoperation on the Internet with time delay. And an optimal operation mode with control scheme was specified for teleoperation with time delay, based on the tradeoff between passivity and transparency properties. It experimentally confirmed the validity of the proposed optimal mode and control scheme by using a simple one DOF master-slave manipulator system.

A Novel 6‑DOF Force‑Sensed Human‑Robot Interface for an Intuitive Teleoperation

The teleoperation of a 6 degrees-of-freedom(DOF)manipulator is one of the basic methods to extend people’s capabilities in the wide variety of applications.The master interface based on the force/torque(FT)sensor could provide the full-dimension intuitive teleoperation of a 6-DOF robot since it has the ability to trigger 6-DOF command input.However,due to the force coupling,noise disturbance and unlimited input signals of the FT sensor,this force-sensed interface could not be widely used in practice.In this paper,we present an intuitive teleoperation method based on the FT sensor to overcome these challenges.In this method,the input signals from the force-sensed joystick were filtered and then processed to the force commands by force limit algorithm,with the merits of anti-interference,output limitation,and online velocity adjustment.Furthermore,based on the admittance control and position controller,the manipulator could be teleoperated by the force commands.Three experiments were conducted on our self-designed robotic system.The result of the first experiment shows that the interfered force from the force coupling could be effectively suppressed with the limitation of the input force through force limit algorithm.Then,a parameter was introduced in the other two experiments to adjust the velocity online practically with force limit algorithm.The proposed method could give a practical solution to the intuitive teleoperation based on the FT sensor.

Safety architecture of internet based multi-robot teleoperation system

Safety subsystem is one of the important parts in robot teleoperation system. In this paper, a safety architecture of safety subsystem in Internet based multi-operator-multi-robot (MOMR) teleoperation system is presented. The subsystem is divided into three layers in its logic architecture: interactive monitor layer, collaborative control layer and real-time control layer. The safety problems and the related strategy are clarified by detailed analysis of each layer and relationship among the layers. So we can obtain a high performance MOMR teleoperation system with multi-layer safety architecture.