Holograms provide a characteristic manner to display and convey information, and have been improved to provide better user interactions Holographic interactions are important as they improve user interactions with vir...Holograms provide a characteristic manner to display and convey information, and have been improved to provide better user interactions Holographic interactions are important as they improve user interactions with virtual objects. Gesture interaction is a recent research topic, as it allows users to use their bare hands to directly interact with the hologram. However, it remains unclear whether real hand gestures are well suited for hologram applications. Therefore, we discuss the development process and implementation of three-dimensional object manipulation using natural hand gestures in a hologram. We describe the design and development process for hologram applications and its integration with real hand gesture interactions as initial findings. Experimental results from Nasa TLX form are discussed. Based on the findings, we actualize the user interactions in the hologram.展开更多
In some complicated tabletop object manipulation task for robotic system, demonstration based control is an efficient way to enhance the stability of execution. In this paper, we use a new optical hand tracking sensor...In some complicated tabletop object manipulation task for robotic system, demonstration based control is an efficient way to enhance the stability of execution. In this paper, we use a new optical hand tracking sensor, LeapMotion, to perform a non-contact demonstration for robotic systems. A Multi-LeapMotion hand tracking system is developed. The setup of the two sensors is analyzed to gain a optimal way for efficiently use the informations from the two sensors. Meanwhile, the coordinate systems of the Mult-LeapMotion hand tracking device and the robotic demonstration system are developed. With the recognition to the element actions and the delay calibration, the fusion principles are developed to get the improved and corrected gesture recognition. The gesture recognition and scenario experiments are carried out, and indicate the improvement of the proposed Multi-LeapMotion hand tracking system in tabletop object manipulation task for robotic demonstration.展开更多
触摸屏的出现使人们逐渐摒弃鼠标和键盘,而触摸操作的不便和局限性也随之显现,非接触式操作凭借其独特的优势正逐渐成为未来人机交互方式的新潮流。针对现有的非接触式操作方式存在的手势定义不合理,方法复杂难解,识别精度低等许多问题...触摸屏的出现使人们逐渐摒弃鼠标和键盘,而触摸操作的不便和局限性也随之显现,非接触式操作凭借其独特的优势正逐渐成为未来人机交互方式的新潮流。针对现有的非接触式操作方式存在的手势定义不合理,方法复杂难解,识别精度低等许多问题,提出了使用"抓"和"放"这两个手势的非接触式操控方式RemoteControl,用户可在三维空间中做出操控动作来完成大部分基础图形用户界面(graphical user interface,GUI)操作。RemoteControl使用支持向量机(support vector machine,SVM)和随机森林来从手部图像中识别出手的形状。实验结果表明RemoteControl的操控动作识别取得了较高的精确度。展开更多
文摘Holograms provide a characteristic manner to display and convey information, and have been improved to provide better user interactions Holographic interactions are important as they improve user interactions with virtual objects. Gesture interaction is a recent research topic, as it allows users to use their bare hands to directly interact with the hologram. However, it remains unclear whether real hand gestures are well suited for hologram applications. Therefore, we discuss the development process and implementation of three-dimensional object manipulation using natural hand gestures in a hologram. We describe the design and development process for hologram applications and its integration with real hand gesture interactions as initial findings. Experimental results from Nasa TLX form are discussed. Based on the findings, we actualize the user interactions in the hologram.
基金This research is funded by National Natural Science Foundation of China under Project no. 61210013, Science and Technology Planning Project of Guangdong Province under no. 2014A020215027.
文摘In some complicated tabletop object manipulation task for robotic system, demonstration based control is an efficient way to enhance the stability of execution. In this paper, we use a new optical hand tracking sensor, LeapMotion, to perform a non-contact demonstration for robotic systems. A Multi-LeapMotion hand tracking system is developed. The setup of the two sensors is analyzed to gain a optimal way for efficiently use the informations from the two sensors. Meanwhile, the coordinate systems of the Mult-LeapMotion hand tracking device and the robotic demonstration system are developed. With the recognition to the element actions and the delay calibration, the fusion principles are developed to get the improved and corrected gesture recognition. The gesture recognition and scenario experiments are carried out, and indicate the improvement of the proposed Multi-LeapMotion hand tracking system in tabletop object manipulation task for robotic demonstration.
文摘触摸屏的出现使人们逐渐摒弃鼠标和键盘,而触摸操作的不便和局限性也随之显现,非接触式操作凭借其独特的优势正逐渐成为未来人机交互方式的新潮流。针对现有的非接触式操作方式存在的手势定义不合理,方法复杂难解,识别精度低等许多问题,提出了使用"抓"和"放"这两个手势的非接触式操控方式RemoteControl,用户可在三维空间中做出操控动作来完成大部分基础图形用户界面(graphical user interface,GUI)操作。RemoteControl使用支持向量机(support vector machine,SVM)和随机森林来从手部图像中识别出手的形状。实验结果表明RemoteControl的操控动作识别取得了较高的精确度。
