In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and...In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and cameras,often caused by environmental factors.This issue has spurred the need for advanced data processing methods to achieve more accurate gesture recognition and predictions.Our study presents a novel virtual keyboard allowing character input via distinct hand gestures,focusing on two key aspects:hand gesture recognition and character input mechanisms.We developed a novel model with LSTM and fully connected layers for enhanced sequential data processing and hand gesture recognition.We also integrated CNN,max-pooling,and dropout layers for improved spatial feature extraction.This model architecture processes both temporal and spatial aspects of hand gestures,using LSTM to extract complex patterns from frame sequences for a comprehensive understanding of input data.Our unique dataset,essential for training the model,includes 1,662 landmarks from dynamic hand gestures,33 postures,and 468 face landmarks,all captured in real-time using advanced pose estimation.The model demonstrated high accuracy,achieving 98.52%in hand gesture recognition and over 97%in character input across different scenarios.Its excellent performance in real-time testing underlines its practicality and effectiveness,marking a significant advancement in enhancing human-device interactions in the digital age.展开更多
We propose an eye-shaped keyboard for high-speed text entry in virtual reality (VR), having the shape of dual eyes with characters arranged along the curved eyelids, which ensures low density and short spacing of the ...We propose an eye-shaped keyboard for high-speed text entry in virtual reality (VR), having the shape of dual eyes with characters arranged along the curved eyelids, which ensures low density and short spacing of the keys. The eye-shaped keyboard references the QWERTY key sequence, allowing the users to benefit from their experience using the QWERTY keyboard. The user interacts with an eye-shaped keyboard using rays controlled with both the hands. A character can be entered in one step by moving the rays from the inner eye regions to regions of the characters. A high-speed auto-complete system was designed for the eye-shaped keyboard. We conducted a pilot study to determine the optimal parameters, and a user study to compare our eye-shaped keyboard with the QWERTY and circular keyboards. For beginners, the eye-shaped keyboard performed significantly more efficiently and accurately with less task load and hand movement than the circular keyboard. Compared with the QWERTY keyboard, the eye-shaped keyboard is more accurate and significantly reduces hand translation while maintaining similar efficiency. Finally, to evaluate the potential of eye-shaped keyboards, we conducted another user study. In this study, the participants were asked to type continuously for three days using the proposed eye-shaped keyboard, with two sessions per day. In each session, participants were asked to type for 20min, and then their typing performance was tested. The eye-shaped keyboard was proven to be efficient and promising, with an average speed of 19.89 words per minute (WPM) and mean uncorrected error rate of 1.939%. The maximum speed reached 24.97 WPM after six sessions and continued to increase.展开更多
Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexib...Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.展开更多
We have proposed some methods for feature extraction and identification that enable identification of individuals through long-text input as an important topic in keystroke dynamics research. As to the robustness in p...We have proposed some methods for feature extraction and identification that enable identification of individuals through long-text input as an important topic in keystroke dynamics research. As to the robustness in practical circumstances, there exists a question on the keystroke dynamics how much the recognition accuracy is influenced by the change of keyboard. By comparing the performance in the cases of using the same keyboard and different keyboards, the dependencies on keyboards are evaluated through three implemented experiments for subjects. As a result, it is found that we do not need to worry about the keyboard difference for users whose typing skills reach high level with about 900 or more letters in 5 minutes, and only for the remaining users it would be necessary to register their profile data with respect to each keyboard they use in order to avoid recognition accuracy degradation.展开更多
A robust system for backlit keyboard inspection is revealed. The backlit keyboard not only has changeable diverse colors but also has the laser marking keys. The keys on the keyboard can be divided into regions of fun...A robust system for backlit keyboard inspection is revealed. The backlit keyboard not only has changeable diverse colors but also has the laser marking keys. The keys on the keyboard can be divided into regions of function keys, normal keys, and number keys. However, there might have some types of defects： incorrect illuminating area, non-uniform illumination of specified inspection region（IR）, and incorrect luminance and intensity of individual key. Since the illumination features of backlit keyboard are too complex to inspect for human inspector in the production line, an auto-mated inspection system for the backlit keyboard is proposed in this paper. The system was designed into the operation module and inspection module. A set of image processing methods were developed for these defects inspection. Some experimental results demonstrate the robustness and effectiveness of the proposed system.展开更多
The password keyboard as a kind of input device that is essential to bank and other financial departments,it must have high credibility,safety,and the function of keeping secret.Disorder keyboard is a developed kind o...The password keyboard as a kind of input device that is essential to bank and other financial departments,it must have high credibility,safety,and the function of keeping secret.Disorder keyboard is a developed kind on the basis of the traditional password keyboard,which increased some new functions and characteristics,for example,there is LED on the surface of the keys,and the numbers displayed on the keys are random,also a certain angle of view is restricted.Outside of a certain angle,the number LED displayed on the keyboard is impossible to be seen.Even other people can see the keys that the customer pressed,but because when the customer finished inputting the password,the key numbers will be re-arranged again,so,the customer unnecessarily worried about that other people would take his password.展开更多
Both the variety of Chinese Information input techniques and the complexity of the users' demands require that the keyboard management module with the ability to input Chinese Information could be modified and exp...Both the variety of Chinese Information input techniques and the complexity of the users' demands require that the keyboard management module with the ability to input Chinese Information could be modified and expanded conveniently.This paper presents a standard structure of this keyboard management module which will meet the needs of developing Chinese Information input techniques.展开更多
文摘In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and cameras,often caused by environmental factors.This issue has spurred the need for advanced data processing methods to achieve more accurate gesture recognition and predictions.Our study presents a novel virtual keyboard allowing character input via distinct hand gestures,focusing on two key aspects:hand gesture recognition and character input mechanisms.We developed a novel model with LSTM and fully connected layers for enhanced sequential data processing and hand gesture recognition.We also integrated CNN,max-pooling,and dropout layers for improved spatial feature extraction.This model architecture processes both temporal and spatial aspects of hand gestures,using LSTM to extract complex patterns from frame sequences for a comprehensive understanding of input data.Our unique dataset,essential for training the model,includes 1,662 landmarks from dynamic hand gestures,33 postures,and 468 face landmarks,all captured in real-time using advanced pose estimation.The model demonstrated high accuracy,achieving 98.52%in hand gesture recognition and over 97%in character input across different scenarios.Its excellent performance in real-time testing underlines its practicality and effectiveness,marking a significant advancement in enhancing human-device interactions in the digital age.
文摘We propose an eye-shaped keyboard for high-speed text entry in virtual reality (VR), having the shape of dual eyes with characters arranged along the curved eyelids, which ensures low density and short spacing of the keys. The eye-shaped keyboard references the QWERTY key sequence, allowing the users to benefit from their experience using the QWERTY keyboard. The user interacts with an eye-shaped keyboard using rays controlled with both the hands. A character can be entered in one step by moving the rays from the inner eye regions to regions of the characters. A high-speed auto-complete system was designed for the eye-shaped keyboard. We conducted a pilot study to determine the optimal parameters, and a user study to compare our eye-shaped keyboard with the QWERTY and circular keyboards. For beginners, the eye-shaped keyboard performed significantly more efficiently and accurately with less task load and hand movement than the circular keyboard. Compared with the QWERTY keyboard, the eye-shaped keyboard is more accurate and significantly reduces hand translation while maintaining similar efficiency. Finally, to evaluate the potential of eye-shaped keyboards, we conducted another user study. In this study, the participants were asked to type continuously for three days using the proposed eye-shaped keyboard, with two sessions per day. In each session, participants were asked to type for 20min, and then their typing performance was tested. The eye-shaped keyboard was proven to be efficient and promising, with an average speed of 19.89 words per minute (WPM) and mean uncorrected error rate of 1.939%. The maximum speed reached 24.97 WPM after six sessions and continued to increase.
基金the National Key R&D Project from Minister of Science and Technology(Grant No.2016YFA0202704)the Beijing Municipal Natural Science Foundation(Grant No.2212052)+1 种基金the Shanghai Sailing Program(Grant No.19S28101)the Fundamental Research Funds for the Central Universities(Grant No.19D128102).
文摘Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.
文摘We have proposed some methods for feature extraction and identification that enable identification of individuals through long-text input as an important topic in keystroke dynamics research. As to the robustness in practical circumstances, there exists a question on the keystroke dynamics how much the recognition accuracy is influenced by the change of keyboard. By comparing the performance in the cases of using the same keyboard and different keyboards, the dependencies on keyboards are evaluated through three implemented experiments for subjects. As a result, it is found that we do not need to worry about the keyboard difference for users whose typing skills reach high level with about 900 or more letters in 5 minutes, and only for the remaining users it would be necessary to register their profile data with respect to each keyboard they use in order to avoid recognition accuracy degradation.
文摘A robust system for backlit keyboard inspection is revealed. The backlit keyboard not only has changeable diverse colors but also has the laser marking keys. The keys on the keyboard can be divided into regions of function keys, normal keys, and number keys. However, there might have some types of defects： incorrect illuminating area, non-uniform illumination of specified inspection region（IR）, and incorrect luminance and intensity of individual key. Since the illumination features of backlit keyboard are too complex to inspect for human inspector in the production line, an auto-mated inspection system for the backlit keyboard is proposed in this paper. The system was designed into the operation module and inspection module. A set of image processing methods were developed for these defects inspection. Some experimental results demonstrate the robustness and effectiveness of the proposed system.
文摘The password keyboard as a kind of input device that is essential to bank and other financial departments,it must have high credibility,safety,and the function of keeping secret.Disorder keyboard is a developed kind on the basis of the traditional password keyboard,which increased some new functions and characteristics,for example,there is LED on the surface of the keys,and the numbers displayed on the keys are random,also a certain angle of view is restricted.Outside of a certain angle,the number LED displayed on the keyboard is impossible to be seen.Even other people can see the keys that the customer pressed,but because when the customer finished inputting the password,the key numbers will be re-arranged again,so,the customer unnecessarily worried about that other people would take his password.
文摘Both the variety of Chinese Information input techniques and the complexity of the users' demands require that the keyboard management module with the ability to input Chinese Information could be modified and expanded conveniently.This paper presents a standard structure of this keyboard management module which will meet the needs of developing Chinese Information input techniques.
