Lidar and visual data are affected heavily in adverse weather conditions due to sensing mechanisms,which bring potential safety hazards for vehicle navigation.Radar sensing is desirable to build a more robust navigati...Lidar and visual data are affected heavily in adverse weather conditions due to sensing mechanisms,which bring potential safety hazards for vehicle navigation.Radar sensing is desirable to build a more robust navigation system.In this paper,a cross-modality radar localisation on prior lidar maps is presented.Specifically,the proposed workflow consists of two parts:first,bird's-eye-view radar images are transferred to fake lidar images by training a generative adversarial network offline.Then with online radar scans,a Monte Carlo localisation framework is built to track the robot pose on lidar maps.The whole online localisation system only needs a rotating radar sensor and a pre-built global lidar map.In the experimental section,the authors conduct an ablation study on image settings and test the proposed system on Oxford Radar Robot Car Dataset.The promising results show that the proposed localisation system could track the robot pose successfully,thus demonstrating the feasibility of radar style transfer for metric robot localisation on lidar maps.展开更多
BACKGROUND:To assess the efficacy of the epidemic prevention measures of the“closed-loop”system adopted by the Beijing 2022 Olympic Winter Games(BOWG).METHODS:We retrospectively collected and analyzed information,in...BACKGROUND:To assess the efficacy of the epidemic prevention measures of the“closed-loop”system adopted by the Beijing 2022 Olympic Winter Games(BOWG).METHODS:We retrospectively collected and analyzed information,including age,sex,nationality,vaccination status,date of diagnosis,and date of entry,from 280 SARS-CoV-2-positive individuals identified during the BOWG.A susceptibility-exposed-infectious-remove model was employed to evaluate the effectiveness of epidemic prevention strategies on controlling the spread of SARS-CoV-2 under different scenarios during the BOWG.RESULTS:Regarding SARS-CoV-2-positive cases,97.9%were imported,and 96.4%were asymptomatic.The median age was 37 years(range:29–47 years),and 73.9%were male,with the majority of cases being broadcasters and European attendees.Regarding vaccination status,93.5%were fully vaccinated,and six cases were considered to have been infected in the closed-loop system during the BOWG.Assuming that the BOWG adopted a semi-closed-loop management system,the cumulative number of confirmed cases would be 1,137 for quick quarantine measures(3 d later)implemented and 5,530 for delayed quarantine measures(9 d later)implemented.This modeling revealed that stringent pandemic prevention measures and closed-loop management effectively controlled the spread of SARS-CoV-2 during the BOWG.CONCLUSION:Imported cases are considered the main risk factor for SARS-CoV-2 transmission during mass gatherings,but a comprehensive closed-loop system could minimize transmission among attendees and general personnel.展开更多
Digital display instrument identification is a crucial approach for automating the collection of digital display data.In this study,we propose a digital display area detection CTPNpro algorithm to address the problem ...Digital display instrument identification is a crucial approach for automating the collection of digital display data.In this study,we propose a digital display area detection CTPNpro algorithm to address the problem of recognizing multiclass digital display instruments.We developed a multiclass digital display instrument recognition algorithm by combining the character recognition network constructed using a convolutional neural network and bidirectional variable-length long short-term memory(LSTM).First,the digital display region detection CTPNpro network framework was designed based on the CTPN network architecture by introducing feature fusion and residual structure.Next,the digital display instrument identification network was constructed based on a convolutional neural network using twoway LSTM and Connectionist temporal classification(CTC)of indefinite length.Finally,an automatic calibration system for digital display instruments was built,and a multiclass digital display instrument dataset was constructed by sampling in the system.We compared the performance of the CTPNpro algorithm with other methods using this dataset to validate the effectiveness and robustness of the proposed algorithm.展开更多
Inthis paper,we describethe advances inthe design,actuation,modeling,and controlfield of continuum robots.After decades ofpioneering research,many innovativeve structural designandUntethered magnetic robots are agood ...Inthis paper,we describethe advances inthe design,actuation,modeling,and controlfield of continuum robots.After decades ofpioneering research,many innovativeve structural designandUntethered magnetic robots are agood example;its external actuationcharteristigotten a lot of interest fromacademics.Furthermoodeling,modeling approachesbased on continuunnechals after years oof research.Geometricexactcontilodeling when combined withnumerical analytic methodschtFifecodle-b realized.In the control,closed.loop and hybrid control methodscombined with sensor feedbackinformation.On the other hand,tladeg and control of continum robotseasier.The data-driven modeling technique simplifies modeling aproves anti-interference and generalization abilities.This paper discusses the current development and challenges of continum robots in the above felds and provides prospectsfor the future.展开更多
Untethered soft miniature robots are considered to have a wide range of applications in biomedical field.However,researchers today still have not reached a consensus on its configuration design and actuation method.He...Untethered soft miniature robots are considered to have a wide range of applications in biomedical field.However,researchers today still have not reached a consensus on its configuration design and actuation method.Here,inspired by the tentacles of a certain kind of echinodermata,we propose a soft multi-legged robot with a total weight of 0.26 g capable of multiple locomotion modes.Based on the magnetic field distribution of a square permanent magnet,we qualitatively analyze the motion mechanism of the robot.Finally,we carried out relevant experimental research.The research shows that the robot can move forward,backward,steering and cross obstacles under the control of the magnetic field,and can combine these abilities to navigate the maze.展开更多
Visual servo control rules that refer to the control methods of robot motion planning using image data acquired from the camera mounted on the robot have been widely applied to the motion control of robotic arms or mo...Visual servo control rules that refer to the control methods of robot motion planning using image data acquired from the camera mounted on the robot have been widely applied to the motion control of robotic arms or mobile robots.The methods are usually classified as image-based visual servo,position-based visual servo,and hybrid visual servo(HVS)control rules.Mobile manipulation enhances the working range and flexibility of robotic arms.However,there is little work on applying visual servo control rules to the motion of the whole mobile manipulation robot.We propose an HVS motion control method for a mobile manipulation robot which combines a six-degreeof-freedom(6-DOF)robotic arm with a nonholonomic mobile base.Based on the kinematic differential equations of the mobile manipulation robot,the global Jacobian matrix of the whole robot is derived,and the HVS control equation is derived using the whole Jacobian matrix combined with position and visual image information.The distance between the gripper and target is calculated through the observation of the marker by a camera mounted on the gripper.The differences between the positions of the markers’feature points and the expected positions of them in the image coordinate system are also calculated.These differences are substituted into the control equation to obtain the speed control law of each degree of freedom of the mobile manipulation robot.To avoid the position error caused by observation,we also introduce the Kalman filter to correct the positions and orientations of the end of the manipulator.Finally,the proposed algorithm is validated on a mobile manipulation platform consisting of a Bulldog chassis,a UR5 robotic arm,and a ZED camera.展开更多
For quadruped robots with springy legs,a successful jump usually requires both suitable elastic parts and well-designed control algorithms.However,these two problems are mutually restricted and hard to solve at the sa...For quadruped robots with springy legs,a successful jump usually requires both suitable elastic parts and well-designed control algorithms.However,these two problems are mutually restricted and hard to solve at the same time.In this study,we attempt to solve the problem of controller design with the help of a robot without any elastic mounted parts,in which the untethered robot is made to jump on a trampoline.The differences between jumping on hard surfaces with springy legs and jumping on springy surfaces with rigid legs are briefly discussed.An intuitive control law is proposed to balance foot contact forces;in this manner,excessive pitch oscillation during hopping or bounding can be avoided.Hopping height is controlled by tuning the time delay of the leg stretch.Together with other motion generators based on kinematic law,the robot can perform translational and rotational movements while hopping or bounding on the trampoline.Experiments are conducted to validate the effectiveness of the proposed control framework.展开更多
基金National Key R&D Program of China,Grant/Award Number:2020YFB1313300National Nature Science Foundation of China under Grant,Grant/Award Number:61903332Hong Kong Center for Construction Robotics(InnoHK center supported by Hong Kong ITC)。
文摘Lidar and visual data are affected heavily in adverse weather conditions due to sensing mechanisms,which bring potential safety hazards for vehicle navigation.Radar sensing is desirable to build a more robust navigation system.In this paper,a cross-modality radar localisation on prior lidar maps is presented.Specifically,the proposed workflow consists of two parts:first,bird's-eye-view radar images are transferred to fake lidar images by training a generative adversarial network offline.Then with online radar scans,a Monte Carlo localisation framework is built to track the robot pose on lidar maps.The whole online localisation system only needs a rotating radar sensor and a pre-built global lidar map.In the experimental section,the authors conduct an ablation study on image settings and test the proposed system on Oxford Radar Robot Car Dataset.The promising results show that the proposed localisation system could track the robot pose successfully,thus demonstrating the feasibility of radar style transfer for metric robot localisation on lidar maps.
基金National Key R&D Program of China(2022YFC3006201)Beijing Public Health High-level Scholars Development Program(2022-1-001)。
文摘BACKGROUND:To assess the efficacy of the epidemic prevention measures of the“closed-loop”system adopted by the Beijing 2022 Olympic Winter Games(BOWG).METHODS:We retrospectively collected and analyzed information,including age,sex,nationality,vaccination status,date of diagnosis,and date of entry,from 280 SARS-CoV-2-positive individuals identified during the BOWG.A susceptibility-exposed-infectious-remove model was employed to evaluate the effectiveness of epidemic prevention strategies on controlling the spread of SARS-CoV-2 under different scenarios during the BOWG.RESULTS:Regarding SARS-CoV-2-positive cases,97.9%were imported,and 96.4%were asymptomatic.The median age was 37 years(range:29–47 years),and 73.9%were male,with the majority of cases being broadcasters and European attendees.Regarding vaccination status,93.5%were fully vaccinated,and six cases were considered to have been infected in the closed-loop system during the BOWG.Assuming that the BOWG adopted a semi-closed-loop management system,the cumulative number of confirmed cases would be 1,137 for quick quarantine measures(3 d later)implemented and 5,530 for delayed quarantine measures(9 d later)implemented.This modeling revealed that stringent pandemic prevention measures and closed-loop management effectively controlled the spread of SARS-CoV-2 during the BOWG.CONCLUSION:Imported cases are considered the main risk factor for SARS-CoV-2 transmission during mass gatherings,but a comprehensive closed-loop system could minimize transmission among attendees and general personnel.
基金This work is supported by the National Natural Science Foundation of China (Grant No. NSFC: 61473258, U 1509210), and the Joint Centre for Robotics Research (JCRR) between Zhejiang University and the University of Technology, Sydney.
基金supported by the National Key R&D Program of China(2022YFB4701502)the“Leading Goose”R&D Program of Zhejiang(2023C01177)+1 种基金the Key Research Project of Zhejiang Lab(2021NB0AL03)the Key R&D Project on Agriculture and Social Development in Hangzhou City(Asian Games)(20230701 A05).
文摘Digital display instrument identification is a crucial approach for automating the collection of digital display data.In this study,we propose a digital display area detection CTPNpro algorithm to address the problem of recognizing multiclass digital display instruments.We developed a multiclass digital display instrument recognition algorithm by combining the character recognition network constructed using a convolutional neural network and bidirectional variable-length long short-term memory(LSTM).First,the digital display region detection CTPNpro network framework was designed based on the CTPN network architecture by introducing feature fusion and residual structure.Next,the digital display instrument identification network was constructed based on a convolutional neural network using twoway LSTM and Connectionist temporal classification(CTC)of indefinite length.Finally,an automatic calibration system for digital display instruments was built,and a multiclass digital display instrument dataset was constructed by sampling in the system.We compared the performance of the CTPNpro algorithm with other methods using this dataset to validate the effectiveness and robustness of the proposed algorithm.
基金Project supported by the National Natural Science Foundation of China (Nos. 51305396 and U1509210) and the Fundamental Research Funds for the Central Universities, China
基金supported by the Fundamental Research Funds for the Zhejiang Provincial Universities(2021XZZX021)Science and Technology on Space Intelli-gent Control Laboratory(2021-JCJQ-LB-010-13)Zhe-jiang Provincial Natural Science Foundation of China(LD22E050007).
文摘Inthis paper,we describethe advances inthe design,actuation,modeling,and controlfield of continuum robots.After decades ofpioneering research,many innovativeve structural designandUntethered magnetic robots are agood example;its external actuationcharteristigotten a lot of interest fromacademics.Furthermoodeling,modeling approachesbased on continuunnechals after years oof research.Geometricexactcontilodeling when combined withnumerical analytic methodschtFifecodle-b realized.In the control,closed.loop and hybrid control methodscombined with sensor feedbackinformation.On the other hand,tladeg and control of continum robotseasier.The data-driven modeling technique simplifies modeling aproves anti-interference and generalization abilities.This paper discusses the current development and challenges of continum robots in the above felds and provides prospectsfor the future.
基金the Fundamental Research Funds for the Zhejiang Provincial Universities,China(2021XZZX021).
文摘Untethered soft miniature robots are considered to have a wide range of applications in biomedical field.However,researchers today still have not reached a consensus on its configuration design and actuation method.Here,inspired by the tentacles of a certain kind of echinodermata,we propose a soft multi-legged robot with a total weight of 0.26 g capable of multiple locomotion modes.Based on the magnetic field distribution of a square permanent magnet,we qualitatively analyze the motion mechanism of the robot.Finally,we carried out relevant experimental research.The research shows that the robot can move forward,backward,steering and cross obstacles under the control of the magnetic field,and can combine these abilities to navigate the maze.
基金Project supported by the National Natural Science Foundation of China(No.U1609210)Science and Technology Project of Zhejiang Province,China(No.2019C01043)。
文摘Visual servo control rules that refer to the control methods of robot motion planning using image data acquired from the camera mounted on the robot have been widely applied to the motion control of robotic arms or mobile robots.The methods are usually classified as image-based visual servo,position-based visual servo,and hybrid visual servo(HVS)control rules.Mobile manipulation enhances the working range and flexibility of robotic arms.However,there is little work on applying visual servo control rules to the motion of the whole mobile manipulation robot.We propose an HVS motion control method for a mobile manipulation robot which combines a six-degreeof-freedom(6-DOF)robotic arm with a nonholonomic mobile base.Based on the kinematic differential equations of the mobile manipulation robot,the global Jacobian matrix of the whole robot is derived,and the HVS control equation is derived using the whole Jacobian matrix combined with position and visual image information.The distance between the gripper and target is calculated through the observation of the marker by a camera mounted on the gripper.The differences between the positions of the markers’feature points and the expected positions of them in the image coordinate system are also calculated.These differences are substituted into the control equation to obtain the speed control law of each degree of freedom of the mobile manipulation robot.To avoid the position error caused by observation,we also introduce the Kalman filter to correct the positions and orientations of the end of the manipulator.Finally,the proposed algorithm is validated on a mobile manipulation platform consisting of a Bulldog chassis,a UR5 robotic arm,and a ZED camera.
基金Financial support was provided by the Zhejiang Provincial Natural Science Foundation(Grant No.Y18F030012)the Science and Technology Project of Zhejiang Province(Grant No.2019C01043)+1 种基金the National Natural Science Foundation of China(Grant No.61836015)the State Key Laboratory of Industrial Control Technology(ICT1807)。
文摘For quadruped robots with springy legs,a successful jump usually requires both suitable elastic parts and well-designed control algorithms.However,these two problems are mutually restricted and hard to solve at the same time.In this study,we attempt to solve the problem of controller design with the help of a robot without any elastic mounted parts,in which the untethered robot is made to jump on a trampoline.The differences between jumping on hard surfaces with springy legs and jumping on springy surfaces with rigid legs are briefly discussed.An intuitive control law is proposed to balance foot contact forces;in this manner,excessive pitch oscillation during hopping or bounding can be avoided.Hopping height is controlled by tuning the time delay of the leg stretch.Together with other motion generators based on kinematic law,the robot can perform translational and rotational movements while hopping or bounding on the trampoline.Experiments are conducted to validate the effectiveness of the proposed control framework.