A virtual 3D interactive painting method for Chinese calligraphy and painting based on real-time force feedback technology

本文提出了一种新的基于实时力反馈技术的中国书画三维交互绘制方法。本文通过分析毛笔受力与变形的关系,基于一种弹簧振子模型构建了三维毛笔模型。根据毛笔受力产生的变形计算得到毛笔在绘制平面上形成的2D笔触,并将其实时映射到3D物体表面形成3D笔触,沿着绘制方向叠加3D笔触形成3D笔道。本方法已成功应用于基于实时力反馈技术的虚拟三维交互绘制系统,用户可以通过Phantom Desktop力反馈设备实时绘制三维笔道,从而实现对三维交互绘制过程的有效仿真。

Do cardiopulmonary resuscitation real-time audiovisual feedback devices improve patient outcomes? A systematic review and metaanalysis

BACKGROUND Cardiac arrest is a leading cause of mortality in America and has increased in the incidence of cases over the last several years.Cardiopulmonary resuscitation(CPR)increases survival outcomes in cases of cardiac arrest;however,healthcare workers often do not perform CPR within recommended guidelines.Real-time audiovisual feedback(RTAVF)devices improve the quality of CPR performed.This systematic review and meta-analysis aims to compare the effect of RTAVF-assisted CPR with conventional CPR and to evaluate whether the use of these devices improved outcomes in both in-hospital cardiac arrest(IHCA)and out-of-hospital cardiac arrest(OHCA)patients.AIM To identify the effect of RTAVF-assisted CPR on patient outcomes and CPR quality with in-and OHCA.METHODS We searched PubMed,SCOPUS,the Cochrane Library,and EMBASE from inception to July 27,2020,for studies comparing patient outcomes and/or CPR quality metrics between RTAVF-assisted CPR and conventional CPR in cases of IHCA or OHCA.The primary outcomes of interest were return of spontaneous circulation(ROSC)and survival to hospital discharge(SHD),with secondary outcomes of chest compression rate and chest compression depth.The methodo-logical quality of the included studies was assessed using the Newcastle-Ottawa scale and Cochrane Collaboration’s“risk of bias”tool.Data was analyzed using R statistical software 4.2.0.results were statistically significant if P<0.05.RESULTS Thirteen studies(n=17600)were included.Patients were on average 69±17.5 years old,with 7022(39.8%)female patients.Overall pooled ROSC in patients in this study was 37%(95%confidence interval=23%-54%).RTAVF-assisted CPR significantly improved ROSC,both overall[risk ratio(RR)1.17(1.001-1.362);P=0.048]and in cases of IHCA[RR 1.36(1.06-1.80);P=0.002].There was no significant improvement in ROSC for OHCA(RR 1.04;0.91-1.19;P=0.47).No significant effect was seen in SHD[RR 1.04(0.91-1.19);P=0.47]or chest compression rate[standardized mean difference(SMD)-2.1;(-4.6-0.5);P=0.09].A significant improvement was seen in chest compression depth[SMD 1.6;(0.02-3.1);P=0.047].CONCLUSION RTAVF-assisted CPR increases ROSC in cases of IHCA and chest compression depth but has no significant effect on ROSC in cases of OHCA,SHD,or chest compression rate.

Restoring force correction based on online discrete tangent stiffness estimation method for real-time hybrid simulation

In real-time hybrid simulation（RTHS）, it is difficult if not impossible to completely erase the error in restoring force due to actuator response delay using existing displacement-based compensation methods. This paper proposes a new force correction method based on online discrete tangent stiffness estimation（online DTSE） to provide accurate online estimation of the instantaneous stiffness of the physical substructure. Following the discrete curve parameter recognition theory, the online DTSE method estimates the instantaneous stiffness mainly through adaptively building a fuzzy segment with the latest measurements, constructing several strict bounding lines of the segment and calculating the slope of the strict bounding lines, which significantly improves the calculation efficiency and accuracy for the instantaneous stiffness estimation. The results of both computational simulation and real-time hybrid simulation show that：（1） the online DTSE method has high calculation efficiency, of which the relatively short computation time will not interrupt RTHS; and（2） the online DTSE method provides better estimation for the instantaneous stiffness, compared with other existing estimation methods. Due to the quick and accurate estimation of instantaneous stiffness, the online DTSE method therefore provides a promising technique to correct restoring forces in RTHS.

Experimental Research of Force Feedback Dataglove Based on Pneumatic Artificial Muscle

Force feedback dataglove is an important interface of human-machine interaction between manipulator and virtual assembly system, which is in charge of the bidirectional transmission of movement and force information between computer and operator. The exoskeleton force feedback dataglove is designed taking the pneumatic artificial muscle as actuator, meanwhile, its structure and work principle are introduced, and the force control problem is analyzed and researched by experiment. The mathematic model of grasping rigid object for finger is established. Considering the friction of tendon-sheath system and finger deformation, the closed-loop force control for a single joint, a single finger and multi-fingers are studied respectively by the feedforward proportional-integral（PI） control method with variable arguments. On the premise of the force smoothness, the control error of the force exerted on the finger joint is in the range of ±0.25 N, which meets the requirement of force feedback. By experimental analysis, the reason of force fluctuation is that the finger joint has a small amplitude quiver, and the consistent change tendency of the force between proximal interphalangeal（PIP） joint and distal interphalangeal（DIP） joint results from their angle coupling relationship.

Force Feedback Coupling with Dynamics for Physical Simulation of Product Assembly and Operation Performance

Most existing force feedback methods are still difficult to meet the requirements of real-time force calculation in virtual assembly and operation with complex objects. In addition, there is often an assumption that the controlled objects are completely flee and the target object is only completely fixed or flee, thus, the dynamics of the kinematic chain where the controlled objects are located are neglected during the physical simulation of the product manipulation with force feedback interaction. This paper proposes a physical simulation method of product assembly and operation manipulation based on statistically learned contact force prediction model and the coupling of force feedback and dynamics. In the proposed method, based on hidden Markov model （HMM） and local weighting learning （LWL）, contact force prediction model is constructed, which can estimate the contact force in real time during interaction. Based on computational load balance model, the computing resources are dynamically assigned and the dynamics integral step is optimized. In addition, smoothing process is performed to the force feedback on the synchronization points. Consequently, we can solve the coupling and synchronization problems of high-frequency feedback force servo. low-frequency dynamics solver servo and scene rendering servo, and realize highly stable and accurate force feedback in the physical simulation of product assembly and operation manipulation. This research proposes a physical simulation method of product assembly and operation manipulation.

FORCE FEEDBACK DATAGLOVE BASED ON PNEUMATIC ARTIFICIAL MUSCLES

An exoskeleton force feedback dataglove is developed, which uses the pneumatic artificial muscles as actuators. On the basis of the simplified hand model, the motion equation is deduced according to the theory of Denavit-Hartenberg. The model of the equivalent contact forces exerted by the object on the finger is proposed. By the principle of virtual work, the static equilibrium of finger is established. The force Jacobian matrix of finger is calculated, and then the joint torques of the finger when grasping objects are obtained. The theory and structure of the force feedback datagolve are introduced. Based on the theory of motion stabilization of four-bar linkage, the flexion angles of joints are measured. The torques on finger joints caused by the output forces of pneumatic artificial muscles are calculated. The output forces of pneumatic artificial muscle, whose values are controlled by its inner pressure, can be calculated by the joint torques of the finger when grasping objects. The arms of force, driving torques and the needed output forces of pneumatic muscle are calculated for each joint of the index finger. The criterion of output force of pneumatic muscle is given.

PI force feedback control for large flexible structure vibration with active tendons

Active tendon, consisting of a displacement actuator and a collocated force sensor, was first presented by Preumont and his co-workers to attenuate the vibration of large flexible space structures, and the control algorithm adopted by them was integral force feedback. This paper presents a new proportional-integral （PI） force feedback algorithm to achieve larger damping ratios for the structure without the requirement of structure model. Stability of the control system is shown, and simulations of a structure similar to JPL-MPI demonstrate the effectiveness of the proposed algorithm for vibration control of space structures.

Enhancement of Stabilization Control in Remote Robot System with Force Feedback

In this paper, we deal with a remote robot system in which a user can operate an industrial robot with a force sensor at a remote location by using a haptic interface device. We apply a method using the wave filter together with the phase control filter which was previously proposed by the authors to the remote robot system for stabilization control. We also propose a method to enhance the haptic quality. By experiment, we demonstrate the effectiveness of the proposed method. We compare the proposed method with the conventional method quantitatively and clarify which domains the proposed method is applied to more effectively.

NOVEL 6-DOF WEARABLE EXOSKELETON ARM WITH PNEUMATIC FORCE-FEEDBACK FOR BILATERAL TELEOPERATION

A particular emphasis is put on a novel wearable exoskeleton arm, ZJUESA, with 6 degrees of freedom, which is used for the robot teleoperation with the force-feedback in the unknown environment. In this external structure mechanism, the 3-revolution-prismatic-spherical （3RPS） parallel mechanism is devised from the concept of the human upper-limb anatomy and applied for the shoulder 3-DOF joint. Meanwhile, the orthogonal experiment design method is introduced for its optimal design. Aiming at enhancing the performance of teleoperation, the force feedback is employed by the pneumatic system on ZJUESA to produce the vivid feeling in addition to the soft control interface. Due to the compressibility and nonlinearity of the pneumatic force feedback system, a novel hybrid fuzzy controller for the precise force control is proposed and realized based on the Mega8 microcontroller units as the units of the distributed control system on ZJUESA. With the results of several experiments for master-slave control with force feedback, the feasibility of ZJUESA system and the effect of its hybrid fuzzy controller are verified.

Orthodontic simulation system with force feedback for training complete bracket placement procedures

Background A virtual system that simulates the complete process of orthodontic bracket placement can be used for pre-clinical skill training to help students gain confidence by performing the required tasks on a virtual patient.Methods The hardware for the virtual simulation system is built using two force feedback devices to support bi-manual force feedback operation.A 3D mouse is used to adjust the position of the virtual patient.A multi-threaded computational methodology is adopted to satisfy the requirements of the frame rate.The computation threads mainly consist of the haptic thread running at a frequency of>1000Hz and the graphic thread at>30Hz.The graphic thread allows the graphics engine to effectively display the visual effects of biofilm removal and acid erosion through texture mapping.Using the haptic thread,the physics engine adopts the hierarchy octree collision-detection algorithm to simulate the multi-point and multi-region interaction between the tools and the virtual environment.Its high efficiency guarantees that the time cost can be controlled within 1 ms.The physics engine also performs collision detection between the tools and particles,making it possible to simulate paint and removal of colloids.The surface-contact constraints are defined in the system;this ensures that the bracket will not divorce from or embed into the tooth during the adjustment of the bracket.Therefore,the simulated adjustment is more realistic and natural.Results A virtual system to simulate the complete process of orthodontic bracket bonding was developed.In addition to bracket bonding and adjustment,the system simulates the necessary auxiliary steps such as smearing,acid etching,and washing.Furthermore,the system supports personalized case training.Conclusions The system provides a new method for students to practice orthodontic skills.

Design and Study of Virtual Interventional Surgical System with Force Feedback

A virtual interventional surgical system with force feedback is designed to provide practice before complicated interventional operation and assistance during operation.The collision detection,vessel deformation calculating and virtual force computing of the virtual system are implemented by using skeleton spring model as the physical modeling foundation,which is based on the mass spring model and easy to construct with high computing efficiency.In order to increase the real time performance,the central plane of the vessel model is extracted and then simplified to complete the skeleton filling.The initiative bending kinematics of the virtual catheter is analyzed so as to provide the virtual system with higher fidelity.The experimental results show that the virtual system can well simulate the vessel deformation and force feedback within an interventional surgery,which gives the virtual system better immersion.

Force-feedback based active compliant position control strategy for a hydraulic quadruped robot

Most existing legged robots are developed under laboratory environments and, corre- spondingly, have good performance of locomotion. The robots＇ ability of walking on rough terrain is of great importance but is seldom achieved. Being compliant to external unperceived impacts is cru- cial since it is unavoidable that the slip, modeling errors and imprecise information of terrain will make planned trajectories to be followed with errors and unpredictable contacts. The impedance control gives an inspiration to realize an active compliance which allows the legged robots to follow reference trajectories and overcome external disturbances. In this paper, a novel impedance force/ position control scheme is presented, which is based on Cartesian force measurement of leg＇ s end effector for our hydraulic quadruped robot The simulation verifies the efficiency of the impedance model, and the experimental results at the end demonstrate the feasibility of the proposed control scheme.

Miniature 6-axis force/torque sensor for force feedback in robot-assisted minimally invasive surgery

In order to restore force sensation to robot-assisted minimally invasive surgery(RMIS),design and performance evaluation of a miniature 6-axis force/torque sensor for force feedback is presented.Based on the resistive sensing method,a flexural-hinged Stewart platform is designed as the flexible structure,and a straightforward optimization method considering the force and sensitivity isotropy of the sensor is proposed to determine geometric parameters which are best suited for the given external loads.The accuracy of this method is preliminarily discussed by finite element methods(FEMs).The sensor prototype is fabricated with the development of the electronic system.Calibration and dynamic loading tests for this sensor prototype are carried out.The working ranges of this sensor prototype are 30 N and 300 N·mm,and resolutions are 0.08 N in radial directions,0.25 N in axial direction,and 2.4 N·mm in rotational directions.It also exhibits a good capability for a typical dynamic force sensing at a frequency close to the normal heart rate of an adult.The sensor is compatible with surgical instruments for force feedback in RMIS.

FORCE FEEDBACK MODEL OF ELECTRO-HYDRAULIC SERVO TELE-OPERATION ROBOT BASED ON VELOCITY CONTROL

The tele-operation robotic system which consists of an excavator as the construction robot, and two joysticks for operating the robot from a safe place are useful for performing restoration in damaged areas. In order to accomplish a precise task, the operator needs to feel a realistic sense of task force brought about from a feedback force between the fork glove of slave robot and unfamiliar environment. A novel force feedback model is proposed based on velocity control of cylinder to determine environment force acting on fork glove. Namely, the feedback force is formed by the error of displacement of joystick with velocity and driving force of piston, and the gain is calculated by the driving force and threshold of driving force of hydraulic cylinder. Moreover, the variable gain improved algorithm is developed to overcome the defect for grasping soft object. Experimental results for fork glove freedom of robotic system are provided to demonstrate the developed algorithm is available for grasping soft object.

A Fully Differential Interface Circuit of Closed-loop Accelerometer with Force Feedback Linearization

In this paper,a fifth-order fully differential interface circuit( IC) is presented to improve the noise performance for micromechanical sigma-delta( Σ-Δ) accelerometer. A lead compensator is adopted to ensure the stability of the closed-loop high-order system. A low noise capacitance detection circuit is described with a correlated-double-sampling( CDS) technique to decrease 1 /f noise and offset of the operational amplifier. This paper also proposes a self-test technique for the interface circuit to test the harmonic distortion. An electrostatic force feedback linearization circuit is presented to reduce the harmonic distortion resulting in larger dynamic range( DR). The layout of the IC is implemented in a standard 0. 6 μm CMOS technology and operates at a sampling frequency of 250 kHz. The interface consumes 20 mW from a 5 V supply. The post-simulation results indicate that the noise floor of the digital accelerometer is about- 140 dBV /Hz1 /2at low frequency. The sensitivity is 2. 5 V /g and the nonlinearity is 0. 11%. The self-test function is achieved with 98. 2 dB thirdorder harmonic distortion detection based on the electrostatic force feedback linearization.

Robot Position Control Using Force Information for Cooperative Work in Remote Robot Systems with Force Feedback

This paper proposes robot position control using force information for cooperative work between two remote robot systems with force feedback in each of which a user operates a remote robot by using a haptic interface device while observing work of the robot with a video camera. We also investigate the effect of the proposed control by experiment. As cooperative work, we deal with work in which two robots carry an object together. The robot position control using force information finely adjusts the position of the robot arm to reduce the force applied to the object. Thus, the purpose of the control is to avoid large force so that the object is not broken. In our experiment, we make a comparison among the following three cases in order to clarify how to carry out the control effectively. In the first case, the two robots are operated manually by a user with his/her both hands. In the second case, one robot is operated manually by a user, and the other robot is moved automatically under the proposed control. In the last case, the object is carried directly by a human instead of the robot which is operated by the user in the second case. As a result, experimental results demonstrate that the control can help each system operated manually by the user to carry the object smoothly.

Practical Application of a Tongue-Operated Joystick Device with Force Feedback Mechanism

The human tongue has superior movement and tactile sensations. For individuals with severe disabilities, a tongue operated interface device can be used to operate life-support equipment, such as powered wheelchairs and robotic manipulators. A joystick-type device can directly translate various tongue motions to external equipment behavior. In addition, the user can interactively communicate with the equipment by tactile feedback. This helps the user to control the equipment safely and skillfully. Considering these factors, in a previous study [1], we developed a novel tongue-operated joystick device with reaction force feedback mechanism. We described the design process including the analysis of human tongue movement and tactile sensations and showed fundamental performances of reaction force feedback with the prototype device. In this study, we discuss the shape of the operational part that is used by the tongue. Two types of operational tools are prepared and their operability and perception of reaction force feedback are compared. Furthermore, we confirm the effectiveness of reaction force feedback to operate the joystick device safely and skillful controlling a mobile robot in an unknown environment.

Real-Time Detection of Unstable Control Loop Behavior in a Feedback Active Noise Cancellation System for In-Ear Headphones

Active noise controls are used in a wide field of applications to cancel out unwanted surrounding noise. Control systems based on the feedback structure however have the disadvantage that they may become unstable during run-time due to changes in the control path—in this context including the listener’s ear. Especially when applied to active noise cancellation (ANC) headphones, the risk of instability is associated with the risk of harmful influence on the listener’s ear, which is exposed to the speaker in striking distance. This paper discusses several methods to enable the analysis of a feedback ANC system during run-time to immediately detect instability. Finally, a solution is proposed, which identifies the open loop behavior parametrically by means of an adaptive filter to subsequently evaluate the coefficients regarding stability.

An Underwater Robot Inspection Anomaly Localization Feedback System Based on Sonar Technology

This article introduces an underwater robot inspection anomaly localization feedback system comprising a real-time water surface tracking,detection,and positioning system located on the water surface,while the underwater robot inspection anomaly feedback system is housed within the underwater robot.The system facilitates the issuance of corresponding mechanical responses based on the water surface’s real-time tracking,detection,and positioning,enabling recognition and feedback of anomaly information.Through sonar technology,the underwater robot inspection anomaly feedback system monitors the underwater robot in real-time,triggering responsive actions upon encountering anomalies.The real-time tracking,detection,and positioning system from the water surface identifies abnormal conditions of underwater robots based on changes in sonar images,subsequently notifying personnel for necessary intervention.