Virtual Keyboard:A Real-Time Hand Gesture Recognition-Based Character Input System Using LSTM and Mediapipe Holistic

In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and cameras,often caused by environmental factors.This issue has spurred the need for advanced data processing methods to achieve more accurate gesture recognition and predictions.Our study presents a novel virtual keyboard allowing character input via distinct hand gestures,focusing on two key aspects:hand gesture recognition and character input mechanisms.We developed a novel model with LSTM and fully connected layers for enhanced sequential data processing and hand gesture recognition.We also integrated CNN,max-pooling,and dropout layers for improved spatial feature extraction.This model architecture processes both temporal and spatial aspects of hand gestures,using LSTM to extract complex patterns from frame sequences for a comprehensive understanding of input data.Our unique dataset,essential for training the model,includes 1,662 landmarks from dynamic hand gestures,33 postures,and 468 face landmarks,all captured in real-time using advanced pose estimation.The model demonstrated high accuracy,achieving 98.52%in hand gesture recognition and over 97%in character input across different scenarios.Its excellent performance in real-time testing underlines its practicality and effectiveness,marking a significant advancement in enhancing human-device interactions in the digital age.

Design and Implementation of Hand Gesture Detection System Using HM Model for Sign Language Recognition Development

Gesture detection is the primary and most significant step for sign language detection and sign language is the communication medium for people with speaking and hearing disabilities. This paper presents a novel method for dynamic hand gesture detection using Hidden Markov Models (HMMs) where we detect different English alphabet letters by tracing hand movements. The process involves skin color-based segmentation for hand isolation in video frames, followed by morphological operations to enhance image trajectories. Our system employs hand tracking and trajectory smoothing techniques, such as the Kalman filter, to monitor hand movements and refine gesture paths. Quantized sequences are then analyzed using the Baum-Welch Re-estimation Algorithm, an HMM-based approach. A maximum likelihood classifier is used to identify the most probable letter from the test sequences. Our method demonstrates significant improvements over traditional recognition techniques in real-time, automatic hand gesture recognition, particularly in its ability to distinguish complex gestures. The experimental results confirm the effectiveness of our approach in enhancing gesture-based sign language detection to alleviate the barrier between the deaf and hard-of-hearing community and general people.

基于HAND的流域洪水淹没快速分析技术

快速分析计算流域洪水淹没,对于防洪具有重要作用,而基于水动力学模型的经典淹没算法在时效性方面存在不足,制约防洪“四预”功能实现和数字孪生流域建设。针对此,本文建立了基于HAND(Height Above Nearest Drainage)的形态淹没模型,用于快速分析流域洪水淹没情况,在乐安河流域上游进行了应用验证。结果表明,模型可在5秒内完成洪水淹没计算,对四场历史洪水和三场设计洪水淹没范围的总体模拟精度平均为0.95,达到水动力学模型的模拟精度;对淹没水深的模拟存在较大误差,平均误差为0.79 m。基于HAND的形态淹没模型可快速绘制全流域洪水淹没范围图,大幅提升影响预报和防洪预演的时效性水平。

子痫前期病人长链非编码RNA H19和长链非编码RNA HAND2-AS1表达水平与胰岛素抵抗的相关性研究

目的检测子痫前期病人胎盘组织、血清长链非编码RNA H19(LncRNA H19)与长链非编码RNAHAND2-AS1(Ln⁃cRNA HAND2-AS1)表达水平,并分析其与病人胰岛素抵抗(IR)的相关性。方法将2021年1—12月在唐山市妇幼保健院建卡的子痫前期孕妇105例作为子痫前期组,根据子痫前期孕妇严重程度分为轻度子痫前期组与重度子痫前期组,另选取同期孕周、年龄相符的健康孕妇97例作为对照组,收集所有孕妇身体质量指数(BMI)、孕周、收缩压、舒张压、空腹胰岛素(FINS)、空腹血糖(FBG)等一般资料,并计算稳态模型的IR指数(HOMA-IR);实时荧光定量PCR(qRT-PCR)法测定孕妇血清、胎盘组织中LncRNA H19,LncRNA HAND2-AS1水平;比较对照组与子痫前期组、轻度子痫前期组与重度子痫前期组间血清、胎盘组织LncRNA H19、LncRNA HAND2-AS1水平;Pearson法分析子痫前期孕妇血清、胎盘组织LncRNA H19、LncRNA HAND2-AS1与HOMA-IR的相关性。结果子痫前期组病人收缩压、舒张压高于对照组(P<0.05),且重度子痫前期病人收缩压、舒张压高于轻度子痫前期病人,孕周低于轻度子痫前期病人(P<0.05);与对照组相比,子痫前期组孕妇24 h尿蛋白、FBG[(5.84±0.97)mmol/L比(4.22±0.70)mmol/L]、FINS[(13.37±2.23)mU/L比(7.52±1.25)mU/L]、HOMI-IR水平(3.47±0.57比1.41±0.23)升高(P<0.05),且重度子痫前期孕妇24 h尿蛋白、FBG[(6.90±1.15)mmol/L比(5.24±0.85)mmol/L]、FINS[(13.97±2.32)mU/L比(13.05±2.17)mU/L]、HOMI-IR水平(4.27±0.71比3.03±0.50)高于轻度子痫前期孕妇(P<0.05);与对照组相比,子痫前期组孕妇血清、胎盘组织Ln⁃cRNA H19(2.52±1.42比1.01±0.15,3.75±0.62比1.02±0.17)与LncRNA HAND2-AS1水平(1.98±0.33比1.01±0.15,2.87±0.47比1.02±0.17)升高(P<0.05),且重度子痫前期孕妇血清、胎盘组织LncRNA H19(2.84±0.47比2.34±0.39,4.28±0.71比3.45±0.57)与LncRNA HAND2-AS1水平(2.59±0.43比1.63±0.27,3.56±0.59比2.49±0.41)高于轻度子痫前期孕妇(P<0.05);子痫前期病人血清与胎盘组织间LncRNA H19水平呈正相关(r=0.55,P<0.05),血清与胎盘组织间LncRNA HAND2-AS1水平呈正相关性(r=0.65,P<0.05)。子痫前期孕妇血清、胎盘组织LncRNA H19水平分别与HOMI-IR呈正相关(r=0.53、0.59,P<0.05);血清、胎盘组织LncRNA HAND2-AS1水平分别与HOMI-IR呈正相关(r=0.60、0.61,P<0.05)。结论子痫前期病人血清、胎盘组织LncRNA H19、LncRNA HAND2-AS1高表达,二者与IR密切相关,可能通过影响IR参与子痫前期发生发展。

An Adaptive Hand Exoskeleton for Teleoperation System

Teleoperation can assist people to complete various complex tasks in inaccessible or high-risk environments,in which a wearable hand exoskeleton is one of the key devices.Adequate adaptability would be available to enable the master hand exoskeleton to capture the motion of human fingers and reproduce the contact force between the slave hand and its object.This paper presents a novel finger exoskeleton based on the cascading four-link closed-loop kinematic chain.Each finger has an independent closed-loop kinematic chain,and the angle sensors are used to obtain the finger motion including the flexion/extension and the adduction/abduction.The cable tension is changed by the servo motor to transmit the contact force to the fingers in real time.Based on the finger exoskeleton,an adaptive hand exoskeleton is consequently developed.In addition,the hand exoskeleton is tested in a master-slave system.The experiment results show that the adaptive hand exoskeleton can be worn without any mechanical constraints,and the slave hand can follow the motions of each human finger.The accuracy and the real-time capability of the force reproduction are validated.The proposed adaptive hand exoskeleton can be employed as the master hand to remotely control the humanoid five-fingered dexterous slave hand,thus,enabling the teleoperation system to complete complex dexterous manipulation tasks.

Dynamic Hand Gesture-Based Person Identification Using Leap Motion and Machine Learning Approaches

Person identification is one of the most vital tasks for network security. People are more concerned about theirsecurity due to traditional passwords becoming weaker or leaking in various attacks. In recent decades, fingerprintsand faces have been widely used for person identification, which has the risk of information leakage as a resultof reproducing fingers or faces by taking a snapshot. Recently, people have focused on creating an identifiablepattern, which will not be reproducible falsely by capturing psychological and behavioral information of a personusing vision and sensor-based techniques. In existing studies, most of the researchers used very complex patternsin this direction, which need special training and attention to remember the patterns and failed to capturethe psychological and behavioral information of a person properly. To overcome these problems, this researchdevised a novel dynamic hand gesture-based person identification system using a Leap Motion sensor. Thisstudy developed two hand gesture-based pattern datasets for performing the experiments, which contained morethan 500 samples, collected from 25 subjects. Various static and dynamic features were extracted from the handgeometry. Randomforest was used to measure feature importance using the Gini Index. Finally, the support vectormachinewas implemented for person identification and evaluate its performance using identification accuracy. Theexperimental results showed that the proposed system produced an identification accuracy of 99.8% for arbitraryhand gesture-based patterns and 99.6% for the same dynamic hand gesture-based patterns. This result indicatedthat the proposed system can be used for person identification in the field of security.

An Efficient and Robust Hand Gesture Recognition System of Sign Language Employing Finetuned Inception-V3 and Efficientnet-B0 Network

Hand Gesture Recognition(HGR)is a promising research area with an extensive range of applications,such as surgery,video game techniques,and sign language translation,where sign language is a complicated structured form of hand gestures.The fundamental building blocks of structured expressions in sign language are the arrangement of the fingers,the orientation of the hand,and the hand’s position concerning the body.The importance of HGR has increased due to the increasing number of touchless applications and the rapid growth of the hearing-impaired population.Therefore,real-time HGR is one of the most effective interaction methods between computers and humans.Developing a user-free interface with good recognition performance should be the goal of real-time HGR systems.Nowadays,Convolutional Neural Network(CNN)shows great recognition rates for different image-level classification tasks.It is challenging to train deep CNN networks like VGG-16,VGG-19,Inception-v3,and Efficientnet-B0 from scratch because only some significant labeled image datasets are available for static hand gesture images.However,an efficient and robust hand gesture recognition system of sign language employing finetuned Inception-v3 and Efficientnet-Bo network is proposed to identify hand gestures using a comparative small HGR dataset.Experiments show that Inception-v3 achieved 90%accuracy and 0.93%precision,0.91%recall,and 0.90%f1-score,respectively,while EfficientNet-B0 achieved 99%accuracy and 0.98%,0.97%,0.98%,precision,recall,and f1-score respectively.

基于隐喻与转喻的人体多义词hand的认知研究及其教学启示

人体是人类认知世界的起点,人体词的义项拓展严格遵循隐喻、转喻路径进行生成和演化。为帮助英语学习者更好地理解、记忆多义词,从隐喻映射和转喻映射角度出发,考察人体多义词hand的义项拓展路径及其类别。研究发现,hand的义项派生共有七种映射路径,分别为基本、抽象、人物、形貌、意动、计量、修饰,并探讨如何基于人体词分析其他多义词的义项拓展,尝试为二语词汇学习和教学提供思路。

Tenosynovitis of hand: Causes and complications

Tenosynovitis represents a common clinical condition characterized by inflam-mation of the synovium that encases the tendon sheath.Although tenosynovities may be noted in any tendon in the body,extremities such as hand,and foot remain the sites of high predilection to acquire this condition.The predominant cause of this predilection rests in the intricate tendon arrangements in these extremities that permit fine motor actions.This editorial explores the common causes and the complications associated with this condition to improve the understanding of the readers of this common condition encountered in our everyday clinical practice.

Japanese Sign Language Recognition by Combining Joint Skeleton-Based Handcrafted and Pixel-Based Deep Learning Features with Machine Learning Classification

Sign language recognition is vital for enhancing communication accessibility among the Deaf and hard-of-hearing communities.In Japan,approximately 360,000 individualswith hearing and speech disabilities rely on Japanese Sign Language(JSL)for communication.However,existing JSL recognition systems have faced significant performance limitations due to inherent complexities.In response to these challenges,we present a novel JSL recognition system that employs a strategic fusion approach,combining joint skeleton-based handcrafted features and pixel-based deep learning features.Our system incorporates two distinct streams:the first stream extracts crucial handcrafted features,emphasizing the capture of hand and body movements within JSL gestures.Simultaneously,a deep learning-based transfer learning stream captures hierarchical representations of JSL gestures in the second stream.Then,we concatenated the critical information of the first stream and the hierarchy of the second stream features to produce the multiple levels of the fusion features,aiming to create a comprehensive representation of the JSL gestures.After reducing the dimensionality of the feature,a feature selection approach and a kernel-based support vector machine(SVM)were used for the classification.To assess the effectiveness of our approach,we conducted extensive experiments on our Lab JSL dataset and a publicly available Arabic sign language(ArSL)dataset.Our results unequivocally demonstrate that our fusion approach significantly enhances JSL recognition accuracy and robustness compared to individual feature sets or traditional recognition methods.

Surgical management of adult hand macrodactyly in a 49-year-old patient:A case report

BACKGROUND Macrodactyly is a rare congenital malformation characterized by an increase in the size of all structures of a digit,accounting for less than 1%of all congenital upper extremity conditions.CASE SUMMARY We report a case involving a 49-year-old woman who presented for the first time with untreated,radial-sided hand macrodactyly.We performed soft tissue debulking,amputation,median nerve neurotomy and coaptation,and carpal tunnel release.At the 6-year follow-up,no significant growth was observed in the bone or soft tissue of the affected area.CONCLUSION Tissue overgrowth in patients with progressive macrodactyly can continue and progress excessively with age.Median nerve neurotomy and coaptation play a crucial role in preventing recurrence of the deformity.

Epidemiology of work-related hand and wrist injuries in a referral center: A descriptive study

BACKGROUND Occupational hand and wrist injuries(OHWIs)account for 25%of work-related accidents in low-and middle-income countries.In Colombia,more than 500000 occupational accidents occurred in 2021,and although the rate declined to less than 5%in 2020 and 2021,at least one in four accidents involved a hand or wrist injury.AIM To describe the OHWIs in workers seen at the emergency room at a second-level hospital in Colombia.METHODS An observational study was performed using data from workers who experienced OHWIs and attended a second-level hospital,between June,2020 and May,2021.The overall frequency of OHWIs,as well as their distribution by sociodemo-graphic,clinical,and occupational variables,are described.Furthermore,association patterns between sex,anatomical area(fingers,hand,wrist),and type of job were analyzed by correspondence analysis(CA).RESULTS There were 2.101 workers treated for occupational accidents,423(20.3%)were cases of OHWIs,which mainly affected men(93.9%)with a median age of 31 years and who worked mainly in mining(75.9%).OHWIs were more common in the right upper extremity(55.3%)and comprised different types of injuries,such as contusion(42.1%),laceration(27.9%),fracture(18.7%),and crush injury(15.6%).They primarily affected the phalanges(95.2%),especially those of the first finger(25.7%).The CAs showed associations between the injured anatomical area and the worker’s job that differed in men and women(explained variance>90%).CONCLUSION One out of five workers who suffered occupational accidents in Cundinamarca,Columbia had an OHWI,affecting mainly males employed in mining.This occupational profile is likely to lead to prolonged rehabilitation,and permanent functional limitations.Our results might be useful for adjusting preventive measures in cluster risk groups.

Non-steroidal anti-inflammatory drugs in postoperative hand fracture management:Do they positively or negatively impact recovery?

This editorial explores the impact of non-steroidal anti-inflammatory drugs(NSAIDs)on postoperative recovery in hand fracture patients,amidst shifting pain management strategies away from opioids due to their adverse effects.With hand fractures being significantly common and postoperative pain management crucial for recovery,the potential of NSAIDs offers a non-addictive pain control alternative.However,the controversy over NSAIDs'effects on bone healing—stemming from their Cyclooxygenase-2 inhibition and associated risks of fracture non-union or delayed union—necessitates further investigation.Despite a comprehensive literature search,the study finds a lack of specific research on NSAIDs in postoperative hand fracture management,highlighting an urgent need for future studies to balance their benefits against possible risks.

Expression and clinical significance of pattern recognition receptor-associated genes in hand, foot and mouth disease

Objective:To explore which pattern recognition receptors(PRRs)play a key role in the development of hand,foot,and mouth disease(HFMD)by analyzing PRR-associated genes.Methods:We conducted a comparative analysis of PRR-associated gene expression in human peripheral blood mononuclear cells(PBMCs)infected with enterovirus 71(EV-A71)which were derived from patients with HFMD of different severities and at different stages.A total of 30 PRR-associated genes were identified as significantly upregulated both over time and across different EV-A71 isolates.Subsequently,ELISA was employed to quantify the expression of the six most prominent genes among these 30 identified genes,specifically,BST2,IRF7,IFI16,TRIM21,MX1,and DDX58.Results:Compared with those at the recovery stage,the expression levels of BST2(P=0.027),IFI16(P=0.016),MX1(P=0.046)and DDX58(P=0.008)in the acute stage of infection were significantly upregulated,while no significant difference in the expression levels of IRF7(P=0.495)and TRIM21(P=0.071)was found between different stages of the disease.The expression levels of BST2,IRF7,IFI16 and MX1 were significantly higher in children infected with single pathogen than those infected with mixed pathogens,and BST2,IRF7,IFI16 and MX1 expression levels were significantly lower in coxsackie B virus(COXB)positive patients than the negative patients.Expression levels of one or more of BST2,IRF7,IFI16,TRIM21,MX1 and DDX58 genes were correlated with PCT levels,various white blood cell counts,and serum antibody levels that reflect disease course of HFMD.Aspartate aminotransferase was correlated with BST2,MX1 and DDX58 expression levels.Conclusions:PRR-associated genes likely initiate the immune response in patients at the acute stage of HFMD.

Long noncoding RNAs HAND2-AS1 ultrasound microbubbles suppress hepatocellular carcinoma progression by regulating the miR-873-5p/tissue inhibitor of matrix metalloproteinase-2 axis

BACKGROUND Increasing data indicated that long noncoding RNAs(lncRNAs)were directly or indirectly involved in the occurrence and development of tumors,including hepatocellular carcinoma(HCC).Recent studies had found that the expression of lncRNA HAND2-AS1 was downregulated in HCC tissues,but its role in HCC progression is unclear.Ultrasound targeted microbubble destruction mediated gene transfection is a new method to overexpress genes.AIM To study the role of ultrasound microbubbles(UTMBs)mediated HAND2-AS1 in the progression of HCC,in order to provide a new reference for the treatment of HCC.METHODS In vitro,we transfected HAND2-AS1 siRNA into HepG2 cells by UTMBs,and detected cell proliferation,apoptosis,invasion and epithelial-mesenchymal transition(EMT)by cell counting kit-8 assay,flow cytometry,Transwell invasion assay and Western blotting,respectively.In addition,we transfected miR-837-5p mimic into UTMBs treated cells and observed the changes of cell behavior.Next,the UTMBs treated HepG2 cells were transfected together with miR-837-5p mimic and tissue inhibitor of matrix metalloproteinase-2(TIMP2)overexpression vector,and we detected cell proliferation,apoptosis,invasion and EMT.In vivo,we established a mouse model of subcutaneous transplantation of HepG2 cells and observed the effect of HAND2-AS1 silencing on tumor formation ability.RESULTS We found that UTMBs carrying HAND2-AS1 restricted cell proliferation,invasion,and EMT,encouraged apoptosis,and HAND2-AS1 silencing eliminated the effect of UTMBs.Additionally,miR-873-5p targets the gene HAND2-AS1,which also targets the 3’UTR of TIMP2.And miR-873-5p mimic counteracted the impact of HAND2-AS1.Further,miR-873-5p mimic solely or in combination with pcDNA-TIMP2 had been transformed into HepG2 cells exposed to UTMBs.We discovered that TIMP2 reversed the effect of miR-873-5p mimic caused by the blocked signalling cascade for matrix metalloproteinase(MMP)2/MMP9.In vivo results showed that HAND2-AS1 silencing significantly inhibited tumor formation in mice.CONCLUSION LncRNA HAND2-AS1 promotes TIMP2 expression by targeting miR-873-5p to inhibit HepG2 cell growth and delay HCC progression.

Hand Cooling Enhances the Proprioceptive Drift during Rubber Hand Illusion

Background: The neural representation of the body is easily altered by integrating multiple sensory signals in the brain. The “Rubber Hand Illusion” (RHI) is one of the most popular experimental paradigms to investigate this phenomenon. During this illusion, ownership of a rubber hand is temporarily induced. It was shown that external and continuous cooling of the palm enhanced the RHI, suggesting an association between altered the autonomic nervous system regulation and altered the sense of ownership of a specific limb. Purpose: To investigate whether artificially cooling the entire hand for a short period affects the magnitude of the illusion. Methods: Participants immersed their entire hand in cool, cold, or warm water for 1 min before the RHI procedure. Results: We found that cooling the entire hand enhanced the proprioceptive drift during the RHI but not the subjective feeling of ownership. In contrast, warming and intense cooling of the entire hand did not affect the RHI strength. Conclusion: Our results suggest that transient and moderate cooling of the entire hand was sufficient in enhancing the illusory disembodiment of one’s own hand.

Comparison between Care Strategies for Patients with Osteoarthritis of the Hands Based on the Use of Joint Protection, Assistive Technology and Exercises

Background: Osteoarthritis (OA) is a disabling disease that can affect 6% to 12% of the adult population and more than a third of people over 65 years of age. Purpose: To assess whether a group of people with hand osteoarthritis (hOA) who received different types of treatment improved their function after two years of follow-up. Method: The entire sample (n = 97) underwent three follow-up assessments regarding anthropometric parameters of the upper limbs and ability to perform functional activities. Subsequently, the sample was divided into two groups for the intervention periods, called the First Period (n = 73) and the Second Period (n = 24);the First Period kept the same protocol with orientations, and the Second Period went to an intervention with orientation strength exercises and use of orthosis. Findings: In the separate analysis of the three questions of the DASH pain module, no differences were found between the assessment moments for groups of guidelines, treatment, or symptoms. Significant effects were observed for F(2, 162) = 3.5, p = 0.033, η2 = 0.04, and interaction for moments and intervention F(2, 162) = 4.3, p = 0.016, η2 = 0.05. Implications: It can be concluded that only guidance treatment does not benefit patients with hand osteoarthritis. In contrast, guidance, exercise, and orthosis treatment can significantly improve the disease.

Analysis of Hand Hygiene Knowledge,Compliance,and Influencing Factors Among Psychiatric Healthcare Workers

Objective:To evaluate the knowledge,compliance,and influencing factors of hand hygiene among psychiatric healthcare workers.Methods:68 healthcare workers who worked in the Department of Psychiatry between September 2023 and May 2024 were selected to assess their knowledge of hand hygiene and compliance by questionnaire as well as to analyze their influencing factors.Results:Knowledge of hand hygiene among healthcare workers was less than 90%,and doctors’knowledge was lower than that of nurses(P<0.05).The healthcare workers’compliance with hand hygiene was lower than 80%,and the adherence of doctors was lower than that of nurses(P<0.05).Analysis of influencing factors reveals that skepticism about the effectiveness of rapid disinfectants/hand washing,skin irritation from disinfectants/cleaning agents,and busy work schedules with time constraints are the main factors affecting healthcare workers’compliance with hand hygiene,with P<0.05 compared with the same group.Conclusion:Psychiatric healthcare workers’knowledge of hand hygiene as well as compliance with it is low,and there are various factors affecting it,so targeted training is required to strengthen their hand hygiene implementation.

Application of PDCA in improving hand hygiene compliance and nosocomial infection quality in orthopedics

Objective:To explore the effect of the Plan-Do-Check-Action(PDCA)cycle on hand hygiene and nosocomial infection quality of or thopedic medical staff.Methods:The whole year of 2021 was selected to monitor the quality of hand hygiene and hospitalization.Follow-up monitoring and real-time recording during the period of morning shift and medical operation concentration time,and compare the compliance of hand hygiene before and after implementation,and evaluate the quality of nosocomial infection.Results:The hand hygiene compliance of doctors and nurses in stage P was 82%.The compliance of medical staff in stage D was 93%.The compliance of stage C was 94%and that of stage A was 95%.The quality score of hospital self-examination nosocomial infection was also significantly increased.Conclusions:The PDCA management cycle can effectively improve the compliance of hand hygiene and the nosocomial infection quality,which is wor thy of circulatory application in or thopedic nosocomial infection quality control,especially improving the quality of hand hygiene.

Commodity Value Theory-Invisible Hands Seen

Through the revelation of“commodity value”,the“invisible hand”described by Adam Smith is now clearly visible.It is precisely“commodity value”that guides people to seek benefits for themselves and for others,adding enormous wealth to society.