Smart homes can provide complementary information to assist home service robots.We present a robotic misplaced item finding(MIF)system,which uses human historical trajectory data obtained in a smart home environment.F...Smart homes can provide complementary information to assist home service robots.We present a robotic misplaced item finding(MIF)system,which uses human historical trajectory data obtained in a smart home environment.First,a multi-sensor fusion method is developed to localize and track a resident.Second,a path-planning method is developed to generate the robot movement plan,which considers the knowledge of the human historical trajectory.Third,a real-time object detector based on a convolutional neural network is applied to detect the misplaced item.We present MIF experiments in a smart home testbed and the experimental results verify the accuracy and efficiency of our solution.展开更多
基金Project supported by the Basic Public Research Program of Zhejiang Province,China(No.LGF18F030001)the Open Research Project of the State Key Laboratory of Industrial Control Technology,Zhejiang University,China(No.ICT1800414)
文摘Smart homes can provide complementary information to assist home service robots.We present a robotic misplaced item finding(MIF)system,which uses human historical trajectory data obtained in a smart home environment.First,a multi-sensor fusion method is developed to localize and track a resident.Second,a path-planning method is developed to generate the robot movement plan,which considers the knowledge of the human historical trajectory.Third,a real-time object detector based on a convolutional neural network is applied to detect the misplaced item.We present MIF experiments in a smart home testbed and the experimental results verify the accuracy and efficiency of our solution.
