The fusion of VlSI (visual identity system Internet), digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, ...The fusion of VlSI (visual identity system Internet), digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.展开更多
Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Severa...Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.展开更多
Multidimensional sensing is a highly desired attribute for allowing human-machine interfaces(HMIs)to perceive various types of information from both users and the environment,thus enabling the advancement of various s...Multidimensional sensing is a highly desired attribute for allowing human-machine interfaces(HMIs)to perceive various types of information from both users and the environment,thus enabling the advancement of various smart electronics/applications,e.g.,smartphones and smart cities.Conventional multidimensional sensing is achieved through the integration of multiple discrete sensors,which introduces issues such as high energy consumption and high circuit complexity.These disadvantages have motivated the widespread use of functional materials for detecting various stimuli at low cost with low power requirements.This work presents an overview of simply structured touch interfaces for multidimensional(x-y location,force and temperature)sensing enabled by piezoelectric,piezoresistive,triboelectric,pyroelectric and thermoelectric materials.For each technology,the mechanism of operation,state-of-the-art designs,merits,and drawbacks are investigated.At the end of the article,the author discusses the challenges limiting the successful applications of functional materials in commercial touch interfaces and corresponding development trends.展开更多
Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexib...Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.展开更多
Letter handwriting,especially stroke correction,is of great importance for recording languages and expressing and exchanging ideas for individual behavior and the public.In this study,a biodegradable and conductive ca...Letter handwriting,especially stroke correction,is of great importance for recording languages and expressing and exchanging ideas for individual behavior and the public.In this study,a biodegradable and conductive carboxymethyl chitosan-silk fibroin(CSF)film is prepared to design wearable triboelectric nanogenerator(denoted as CSF-TENG),which outputs of V_(oc)≈165 V,I_(sc)≈1.4μA,and Q_(sc)≈72 mW cm^(−2).Further,in vitro biodegradation of CSF film is performed through trypsin and lysozyme.The results show that trypsin and lysozyme have stable and favorable biodegradation properties,removing 63.1%of CSF film after degrading for 11 days.Further,the CSF-TENG-based human-machine interface(HMI)is designed to promptly track writing steps and access the accuracy of letters,resulting in a straightforward communication media of human and machine.The CSF-TENG-based HMI can automatically recognize and correct three representative letters(F,H,and K),which is benefited by HMI system for data processing and analysis.The CSF-TENG-based HMI can make decisions for the next stroke,highlighting the stroke in advance by replacing it with red,which can be a candidate for calligraphy practice and correction.Finally,various demonstrations are done in real-time to achieve virtual and real-world controls including writing,vehicle movements,and healthcare.展开更多
Sense of touch is one of the important information from environment for human to live in daily life. Haptic interface is a hot topic in virtual reality but almost all of the devices focus on fingers and hands as targe...Sense of touch is one of the important information from environment for human to live in daily life. Haptic interface is a hot topic in virtual reality but almost all of the devices focus on fingers and hands as targets. In this paper, we focus on the foot haptic device with magnetic flied sensitive elastomer (MSE). We developed a haptic unit used as a magnetic field generator for MSE and contact point of foot haptic device. MSE samples mixed with 80 wt% carbonyl iron particles were prepared and evaluated with the developed magnet. Experimental results show that the mechanical property of the haptic unit can be modeled with the adjustable friction element. This property has a good advantage for the haptic unit.展开更多
With the rapid development of digital and intelligent information systems, display of radar situation interface has become an important challenge in the field of human-computer interaction. We propose a method for the...With the rapid development of digital and intelligent information systems, display of radar situation interface has become an important challenge in the field of human-computer interaction. We propose a method for the optimization of radar situation interface from error-cognition through the mapping of information characteristics. A mapping method of matrix description is adopted to analyze the association properties between error-cognition sets and design information sets. Based on the mapping relationship between the domain of error-cognition and the domain of design information, a cross-correlational analysis is carried out between error-cognition and design information.We obtain the relationship matrix between the error-cognition of correlation between design information and the degree of importance among design information. Taking the task interface of a warfare navigation display as an example, error factors and the features of design information are extracted. Based on the results, we also propose an optimization design scheme for the radar situation interface.展开更多
This paper describes the design and evaluation of a user interface for a remotely supervised autonomous agricultural sprayer. The interface was designed to help the remote supervisor to instruct the autonomous sprayer...This paper describes the design and evaluation of a user interface for a remotely supervised autonomous agricultural sprayer. The interface was designed to help the remote supervisor to instruct the autonomous sprayer to commence operation, monitor the status of the sprayer and its operation in the field, and intervene when needed (i.e., to stop or shut down). Design principles and guidelines were carefully selected to help develop a human-centered automation interface. Evaluation of the interface using a combination of heuristic, cognitive walkthrough, and user testing techniques revealed several strengths of the design as well as areas that needed further improvement. Overall, this paper provides guidelines that will assist other researchers to develop an ergonomic user interface for a fully autonomous agricultural machine.展开更多
Ionic hydrogel-based sensors have shined a spotlight on wearable electronics.However,the sensitivity and reliability of hydrogel devices are significantly hampered by the weak adhesion of skin-sensor interface as well...Ionic hydrogel-based sensors have shined a spotlight on wearable electronics.However,the sensitivity and reliability of hydrogel devices are significantly hampered by the weak adhesion of skin-sensor interface as well as inferior temperature tolerance.Here,inspired by the structure and composition of dermis,a novel skin-attachable and environment-stable hydrogel was designed by integrating collagen into the LiCl-containing chemically cross-linked polyacrylamide hydrogel.The hydrogel exhibited skin-like mechanical properties of low modulus,superior stretchability as well as excellent elasticity.Furthermore,the introduction of collagen endowed the hydrogel with robust and seamless interfaces with diverse materials,including the curved skin.As a result,the hydrogel is capable of serving as a human-machine interface for collecting reliable electrocardiography(ECG)signals and discerning various human motions,with high sensitivity(gauge factor=10.7),fast response,negligible hysteresis as well as extensive monitoring range.Notably,the hydrogel that can mimick the temperature-tolerant mechanism of most organisms possesses persistent stabilization of adhesive,conductive,sensory and mechanical performances at subzero or ambient conditions.The skin-inspired strategy paves an effective way for the design of multifunctional materials with potential applications in next-generation electronics.展开更多
Wearable human-machine interface(HMI)is an advanced technology that has a wide range of applications from robotics to augmented/virtual reality(AR/VR).In this study,an optically driven wearable human-interactive smart...Wearable human-machine interface(HMI)is an advanced technology that has a wide range of applications from robotics to augmented/virtual reality(AR/VR).In this study,an optically driven wearable human-interactive smart textile is proposed by integrating a polydimethylsiloxane(PDMS)patch embedded with optical micro/nanofibers(MNF)array with a piece of textiles.Enabled by the highly sensitive pressure dependent bending loss of MNF,the smart textile shows high sensitivity(65.5 kPa^(−1))and fast response(25 ms)for touch sensing.Benefiting from the warp and weft structure of the textile,the optical smart textile can feel slight finger slip along the MNF.Furthermore,machine learning is utilized to classify the touch manners,achieving a recognition accuracy as high as 98.1%.As a proof-of-concept,a remote-control robotic hand and a smart interactive doll are demonstrated based on the optical smart textile.This optical smart textile represents an ideal HMI for AR/VR and robotics applications.展开更多
We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraint...We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraints related to acceptance by patients and physiotherapist users.To date,most designs have focused on mobile platforms that are designed to be operated as an end-effector connected to human limbs for direct patient interaction.Some specific examples are illustrated from the authors' experience with prototypes available at Laboratory of Robotics and Mechatronics (LARM),Italy.展开更多
Current stretchable surface electrodes have attracted increasing attention owing to their potential applications in biological signal monitoring, wearable human-machine interfaces(HMIs) and the Internet of Things. T...Current stretchable surface electrodes have attracted increasing attention owing to their potential applications in biological signal monitoring, wearable human-machine interfaces(HMIs) and the Internet of Things. The paper proposed a stretchable HMI based on a surface electromyography(sEMG) electrode with a self-similar serpentine configuration. The sEMG electrode was transfer-printed onto the skin surface conformally to monitor biological signals, followed by signal classification and controlling of a mobile robot. Such electrodes can bear rather large deformation(such as 〉30%) under an appropriate areal coverage. The sEMG electrodes have been used to record electrophysiological signals from different parts of the body with sharp curvature, such as the index finger,back of the neck and face, and they exhibit great potential for HMI in the fields of robotics and healthcare. The electrodes placed onto the two wrists would generate two different signals with the fist clenched and loosened. It is classified to four kinds of signals with a combination of the gestures from the two wrists, that is, four control modes. Experiments demonstrated that the electrodes were successfully used as an HMI to control the motion of a mobile robot remotely.展开更多
We never stop finding better ways to communicate with machines.To interact with computers we tried several ways,from punched tape and tape reader to QWERTY keyboards and command lines,from graphic user interface and m...We never stop finding better ways to communicate with machines.To interact with computers we tried several ways,from punched tape and tape reader to QWERTY keyboards and command lines,from graphic user interface and mouse to multi-touch screens.The way we communicate with computers or devices are getting more direct and easier.In this paper,we give gesture mouse simulation in human–computer interface based on 3 Gear Systems using two Kinect sensors.The Kinect sensor is the perfect device to achieve dynamic gesture tracking and pose recognition.We hope the 3 Gear Systems can work as a mouse,to be more specific,use gestures to do click,double click and scroll.We use Coordinate Converting Matrix and Kalman Filter to reduce the shaking caused by errors and makes the interface create a better user experience.Finally the future of human-computer interface is discussed.展开更多
This article presents a new design of a distributed-parameter control system for human-machine perception interface,which is capable of precisely stimulating the neural systems with electromagnetic fields.By discretis...This article presents a new design of a distributed-parameter control system for human-machine perception interface,which is capable of precisely stimulating the neural systems with electromagnetic fields.By discretising the neural systems,a state-space representation of the electromagnetic stimulation is developed to facilitate the following design and analysis.A forward controller with multiple inputs and multiple outputs is consequently designed to estimate the excitation current.This novel approach enables the applications of the well-established control theory to analyse the system.The feasibility and accuracy of the control system are numerically illustrated and validated with the applications of Transcranial Magnetic Stimulation(TMS)and retinal stimulation.The results indicate that the newly designed control system can not only generate electromagnetic stimulation with better attenuation and focality than the most widely used Figure-8 coil,but also transmit the patterns extracted from images with electromagnetic stimulations to human retinas.展开更多
Aircraft cockpit display interface (CDI) is one of the most important human-machine interfaces for information perceiving. During the process of aircraft design, situation awareness (SA) is frequently considered t...Aircraft cockpit display interface (CDI) is one of the most important human-machine interfaces for information perceiving. During the process of aircraft design, situation awareness (SA) is frequently considered to improve the design, as the CDI must provide enough SA for the pilot to maintain the flight safety. In order to study the SA in the pilot-aircraft system, a cockpit flight simulation environment is built up, which includes a virtual instrument panel, a flight visual display and the corresponding control system. Based on the simulation environment, a human-in-the-loop experiment is designed to measure the SA by the situation awareness global assessment technique (SAGAT). Through the experiment, the SA degrees and heart rate (HR) data of the subjects are obtained, and the SA levels under different CDI designs are analyzed. The results show that analyzing the SA can serve as an objective way to evaluate the design of CDI, which could be proved from the consistent HR data. With this method, evaluations of the CDI design are performed in the experimental flight simulation environment, and optimizations could be guided through the analysis.展开更多
With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out ...With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out under flight simulation task conditions using the performance evaluation, subjective evaluation and physiological measurement methods. The experimental results show that with an increased mental workload, the detection accuracy of flight operation significantly reduced and the reaction time was significantly prolonged; the standard deviation of R-R intervals(SDNN) significantly decreased, while the mean heart rate exhibited little change; the score of NASA_TLX scale significantly increased. On this basis, the indexes sensitive to mental workload were screened, and an integrated model for the discrimination and prediction of mental workload of aircraft cockpit display interface was established based on the Bayesian Fisher discrimination and classification method. The original validation and cross-validation methods were employed to test the accuracy of the results of discrimination and prediction of the integrated model, and the average prediction accuracies determined by these two methods are both higher than 85%. Meanwhile, the integrated model shows a higher accuracy in discrimination and prediction of mental workload compared with single indexes. The model proposed in this paper exhibits a satisfactory coincidence with the measured data and could accurately reflect the variation characteristics of the mental workload of aircraft cockpit display interface, thus providing a basis for the ergonomic evaluation and optimization design of the aircraft cockpit display interface in the future.展开更多
We describe a user interface and interaction technique,named'Javelin',designed for large display environments.It provides quick access to random screen regions and manipulation methods for screen widgets which...We describe a user interface and interaction technique,named'Javelin',designed for large display environments.It provides quick access to random screen regions and manipulation methods for screen widgets which are difficult or impossible to reach.It consists of a dynamic global thumbnail,a touchpad widget that drives the screen cursor,and a teleport widget in which interactions are transferred to its target screen region.Javelin can be easily integrated into many programs to optimize their interaction performance in large screens.The experiment and user study show that Javelin can extend user access field and enhance widget manipulation in large displays.展开更多
Current electronics are driven by advanced microfabrication for fast and efficient information processing.In spite of high performance,these wafer-based devices are rigid,non-degradable,and unable to autonomous repair...Current electronics are driven by advanced microfabrication for fast and efficient information processing.In spite of high performance,these wafer-based devices are rigid,non-degradable,and unable to autonomous repair.Skin-inspired electronics have emerged as a new class of devices and systems for next-generation flexible and wearable electronics.The technology gains inspiration from the structures,properties,and sensing mechanisms of the skin,which may find a broad range of applications in cutting-edge fields such as healthcare monitoring,human-machine interface,and soft robotics/prostheses.Practical demands have fueled the development of electronic materials with skin-like properties in terms of stretchability,self-healing capability,and biodegradability.These materials provide the basis for functional sensors with innovative and biomimetic designs.Further system-level integrations and optimizations enable new forms of electronics for real-world applications.This review summarizes recent advancements in this active area and speculates on future directions.展开更多
基金Supported by the National Natural Science Foundation of China (No. 40071071).
文摘The fusion of VlSI (visual identity system Internet), digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.
基金Supported by the‘Automotive Glazing Application in Intelligent Cockpit Human-Machine Interface’project(SKHX2021049)a collaboration between the Saint-Go Bain Research and the Beijing Normal University。
文摘Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.
文摘Multidimensional sensing is a highly desired attribute for allowing human-machine interfaces(HMIs)to perceive various types of information from both users and the environment,thus enabling the advancement of various smart electronics/applications,e.g.,smartphones and smart cities.Conventional multidimensional sensing is achieved through the integration of multiple discrete sensors,which introduces issues such as high energy consumption and high circuit complexity.These disadvantages have motivated the widespread use of functional materials for detecting various stimuli at low cost with low power requirements.This work presents an overview of simply structured touch interfaces for multidimensional(x-y location,force and temperature)sensing enabled by piezoelectric,piezoresistive,triboelectric,pyroelectric and thermoelectric materials.For each technology,the mechanism of operation,state-of-the-art designs,merits,and drawbacks are investigated.At the end of the article,the author discusses the challenges limiting the successful applications of functional materials in commercial touch interfaces and corresponding development trends.
基金the National Key R&D Project from Minister of Science and Technology(Grant No.2016YFA0202704)the Beijing Municipal Natural Science Foundation(Grant No.2212052)+1 种基金the Shanghai Sailing Program(Grant No.19S28101)the Fundamental Research Funds for the Central Universities(Grant No.19D128102).
文摘Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.
基金This study was financially supported by National Natural Science Foundation of China(NO.31470509)China Postdoctoral Science Foundation(No.2019T120390)+1 种基金China Scholarship Council(NO.202006790091)the Opening Project of China National Textile and Apparel Council Key Laboratory of Natural Dyes,Soochow University(No.SDHY2122)。
文摘Letter handwriting,especially stroke correction,is of great importance for recording languages and expressing and exchanging ideas for individual behavior and the public.In this study,a biodegradable and conductive carboxymethyl chitosan-silk fibroin(CSF)film is prepared to design wearable triboelectric nanogenerator(denoted as CSF-TENG),which outputs of V_(oc)≈165 V,I_(sc)≈1.4μA,and Q_(sc)≈72 mW cm^(−2).Further,in vitro biodegradation of CSF film is performed through trypsin and lysozyme.The results show that trypsin and lysozyme have stable and favorable biodegradation properties,removing 63.1%of CSF film after degrading for 11 days.Further,the CSF-TENG-based human-machine interface(HMI)is designed to promptly track writing steps and access the accuracy of letters,resulting in a straightforward communication media of human and machine.The CSF-TENG-based HMI can automatically recognize and correct three representative letters(F,H,and K),which is benefited by HMI system for data processing and analysis.The CSF-TENG-based HMI can make decisions for the next stroke,highlighting the stroke in advance by replacing it with red,which can be a candidate for calligraphy practice and correction.Finally,various demonstrations are done in real-time to achieve virtual and real-world controls including writing,vehicle movements,and healthcare.
文摘Sense of touch is one of the important information from environment for human to live in daily life. Haptic interface is a hot topic in virtual reality but almost all of the devices focus on fingers and hands as targets. In this paper, we focus on the foot haptic device with magnetic flied sensitive elastomer (MSE). We developed a haptic unit used as a magnetic field generator for MSE and contact point of foot haptic device. MSE samples mixed with 80 wt% carbonyl iron particles were prepared and evaluated with the developed magnet. Experimental results show that the mechanical property of the haptic unit can be modeled with the adjustable friction element. This property has a good advantage for the haptic unit.
基金supported by Jiangsu Province Nature Science Foundation of China (BK20221490)the Key Fundamental Research Funds for the Central Universities (30920041114)+2 种基金the National Natural Science Foundation of China (52175469,71601068)the Key Research and Development (Social Development) Project of Jiangsu Province(BE2019647)Jiangsu Province Social Science Foundation of China (20YSB013)。
文摘With the rapid development of digital and intelligent information systems, display of radar situation interface has become an important challenge in the field of human-computer interaction. We propose a method for the optimization of radar situation interface from error-cognition through the mapping of information characteristics. A mapping method of matrix description is adopted to analyze the association properties between error-cognition sets and design information sets. Based on the mapping relationship between the domain of error-cognition and the domain of design information, a cross-correlational analysis is carried out between error-cognition and design information.We obtain the relationship matrix between the error-cognition of correlation between design information and the degree of importance among design information. Taking the task interface of a warfare navigation display as an example, error factors and the features of design information are extracted. Based on the results, we also propose an optimization design scheme for the radar situation interface.
文摘This paper describes the design and evaluation of a user interface for a remotely supervised autonomous agricultural sprayer. The interface was designed to help the remote supervisor to instruct the autonomous sprayer to commence operation, monitor the status of the sprayer and its operation in the field, and intervene when needed (i.e., to stop or shut down). Design principles and guidelines were carefully selected to help develop a human-centered automation interface. Evaluation of the interface using a combination of heuristic, cognitive walkthrough, and user testing techniques revealed several strengths of the design as well as areas that needed further improvement. Overall, this paper provides guidelines that will assist other researchers to develop an ergonomic user interface for a fully autonomous agricultural machine.
基金supported by the National Natural Science Foundation of China (51873024)the Science and Technology Department of Jilin Province (20200708102YY and 20190201234JC)
文摘Ionic hydrogel-based sensors have shined a spotlight on wearable electronics.However,the sensitivity and reliability of hydrogel devices are significantly hampered by the weak adhesion of skin-sensor interface as well as inferior temperature tolerance.Here,inspired by the structure and composition of dermis,a novel skin-attachable and environment-stable hydrogel was designed by integrating collagen into the LiCl-containing chemically cross-linked polyacrylamide hydrogel.The hydrogel exhibited skin-like mechanical properties of low modulus,superior stretchability as well as excellent elasticity.Furthermore,the introduction of collagen endowed the hydrogel with robust and seamless interfaces with diverse materials,including the curved skin.As a result,the hydrogel is capable of serving as a human-machine interface for collecting reliable electrocardiography(ECG)signals and discerning various human motions,with high sensitivity(gauge factor=10.7),fast response,negligible hysteresis as well as extensive monitoring range.Notably,the hydrogel that can mimick the temperature-tolerant mechanism of most organisms possesses persistent stabilization of adhesive,conductive,sensory and mechanical performances at subzero or ambient conditions.The skin-inspired strategy paves an effective way for the design of multifunctional materials with potential applications in next-generation electronics.
基金We acknowledge funding from the National Natural Science Foundation of China(No.61975173)Major Scientific Research Project of Zhejiang Lab(No.2019MC0AD01)+1 种基金Key Research and Development Project of Zhejiang Province(No.2021C05003)the CIE-Tencent Robotics X Rhino-Bird Focused Research Program(No.2020-01-006).
文摘Wearable human-machine interface(HMI)is an advanced technology that has a wide range of applications from robotics to augmented/virtual reality(AR/VR).In this study,an optically driven wearable human-interactive smart textile is proposed by integrating a polydimethylsiloxane(PDMS)patch embedded with optical micro/nanofibers(MNF)array with a piece of textiles.Enabled by the highly sensitive pressure dependent bending loss of MNF,the smart textile shows high sensitivity(65.5 kPa^(−1))and fast response(25 ms)for touch sensing.Benefiting from the warp and weft structure of the textile,the optical smart textile can feel slight finger slip along the MNF.Furthermore,machine learning is utilized to classify the touch manners,achieving a recognition accuracy as high as 98.1%.As a proof-of-concept,a remote-control robotic hand and a smart interactive doll are demonstrated based on the optical smart textile.This optical smart textile represents an ideal HMI for AR/VR and robotics applications.
基金supported by the research project RORAS 2 of the Mediterranean Program funded by INRIA,France
文摘We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraints related to acceptance by patients and physiotherapist users.To date,most designs have focused on mobile platforms that are designed to be operated as an end-effector connected to human limbs for direct patient interaction.Some specific examples are illustrated from the authors' experience with prototypes available at Laboratory of Robotics and Mechatronics (LARM),Italy.
基金supported by the National Natural Science Foundation of China(Nos.51635007,91323303)
文摘Current stretchable surface electrodes have attracted increasing attention owing to their potential applications in biological signal monitoring, wearable human-machine interfaces(HMIs) and the Internet of Things. The paper proposed a stretchable HMI based on a surface electromyography(sEMG) electrode with a self-similar serpentine configuration. The sEMG electrode was transfer-printed onto the skin surface conformally to monitor biological signals, followed by signal classification and controlling of a mobile robot. Such electrodes can bear rather large deformation(such as 〉30%) under an appropriate areal coverage. The sEMG electrodes have been used to record electrophysiological signals from different parts of the body with sharp curvature, such as the index finger,back of the neck and face, and they exhibit great potential for HMI in the fields of robotics and healthcare. The electrodes placed onto the two wrists would generate two different signals with the fist clenched and loosened. It is classified to four kinds of signals with a combination of the gestures from the two wrists, that is, four control modes. Experiments demonstrated that the electrodes were successfully used as an HMI to control the motion of a mobile robot remotely.
基金Scientific Research Common Program of Beijing Municipal Commission of Education(KM201411232007)BISTU Teaching Reform Projects(2014KG22)+2 种基金IHLB(PHR201108258,PHR201106226)Beijing Natural Science Foundation(4142017)NSFC(Grant No.61261160497)。
文摘We never stop finding better ways to communicate with machines.To interact with computers we tried several ways,from punched tape and tape reader to QWERTY keyboards and command lines,from graphic user interface and mouse to multi-touch screens.The way we communicate with computers or devices are getting more direct and easier.In this paper,we give gesture mouse simulation in human–computer interface based on 3 Gear Systems using two Kinect sensors.The Kinect sensor is the perfect device to achieve dynamic gesture tracking and pose recognition.We hope the 3 Gear Systems can work as a mouse,to be more specific,use gestures to do click,double click and scroll.We use Coordinate Converting Matrix and Kalman Filter to reduce the shaking caused by errors and makes the interface create a better user experience.Finally the future of human-computer interface is discussed.
基金This work was supported by Faculty Research Grant (FRG) of Minnesota State University Mankato.
文摘This article presents a new design of a distributed-parameter control system for human-machine perception interface,which is capable of precisely stimulating the neural systems with electromagnetic fields.By discretising the neural systems,a state-space representation of the electromagnetic stimulation is developed to facilitate the following design and analysis.A forward controller with multiple inputs and multiple outputs is consequently designed to estimate the excitation current.This novel approach enables the applications of the well-established control theory to analyse the system.The feasibility and accuracy of the control system are numerically illustrated and validated with the applications of Transcranial Magnetic Stimulation(TMS)and retinal stimulation.The results indicate that the newly designed control system can not only generate electromagnetic stimulation with better attenuation and focality than the most widely used Figure-8 coil,but also transmit the patterns extracted from images with electromagnetic stimulations to human retinas.
基金supported by National Basic Research Program of China(No.2010CB734104)
文摘Aircraft cockpit display interface (CDI) is one of the most important human-machine interfaces for information perceiving. During the process of aircraft design, situation awareness (SA) is frequently considered to improve the design, as the CDI must provide enough SA for the pilot to maintain the flight safety. In order to study the SA in the pilot-aircraft system, a cockpit flight simulation environment is built up, which includes a virtual instrument panel, a flight visual display and the corresponding control system. Based on the simulation environment, a human-in-the-loop experiment is designed to measure the SA by the situation awareness global assessment technique (SAGAT). Through the experiment, the SA degrees and heart rate (HR) data of the subjects are obtained, and the SA levels under different CDI designs are analyzed. The results show that analyzing the SA can serve as an objective way to evaluate the design of CDI, which could be proved from the consistent HR data. With this method, evaluations of the CDI design are performed in the experimental flight simulation environment, and optimizations could be guided through the analysis.
基金supported by the National Basic Research Program of China (No. 2010CB734104)
文摘With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out under flight simulation task conditions using the performance evaluation, subjective evaluation and physiological measurement methods. The experimental results show that with an increased mental workload, the detection accuracy of flight operation significantly reduced and the reaction time was significantly prolonged; the standard deviation of R-R intervals(SDNN) significantly decreased, while the mean heart rate exhibited little change; the score of NASA_TLX scale significantly increased. On this basis, the indexes sensitive to mental workload were screened, and an integrated model for the discrimination and prediction of mental workload of aircraft cockpit display interface was established based on the Bayesian Fisher discrimination and classification method. The original validation and cross-validation methods were employed to test the accuracy of the results of discrimination and prediction of the integrated model, and the average prediction accuracies determined by these two methods are both higher than 85%. Meanwhile, the integrated model shows a higher accuracy in discrimination and prediction of mental workload compared with single indexes. The model proposed in this paper exhibits a satisfactory coincidence with the measured data and could accurately reflect the variation characteristics of the mental workload of aircraft cockpit display interface, thus providing a basis for the ergonomic evaluation and optimization design of the aircraft cockpit display interface in the future.
基金Project supported by China Academic Digital Associative Library (CADAL)
文摘We describe a user interface and interaction technique,named'Javelin',designed for large display environments.It provides quick access to random screen regions and manipulation methods for screen widgets which are difficult or impossible to reach.It consists of a dynamic global thumbnail,a touchpad widget that drives the screen cursor,and a teleport widget in which interactions are transferred to its target screen region.Javelin can be easily integrated into many programs to optimize their interaction performance in large screens.The experiment and user study show that Javelin can extend user access field and enhance widget manipulation in large displays.
基金the National Natural Science Foundation of China under Grants 61825403,61674078,and 61921005the National Key Research and Development program of China under Grant 2017YFA0206302, the PAPD program.
文摘Current electronics are driven by advanced microfabrication for fast and efficient information processing.In spite of high performance,these wafer-based devices are rigid,non-degradable,and unable to autonomous repair.Skin-inspired electronics have emerged as a new class of devices and systems for next-generation flexible and wearable electronics.The technology gains inspiration from the structures,properties,and sensing mechanisms of the skin,which may find a broad range of applications in cutting-edge fields such as healthcare monitoring,human-machine interface,and soft robotics/prostheses.Practical demands have fueled the development of electronic materials with skin-like properties in terms of stretchability,self-healing capability,and biodegradability.These materials provide the basis for functional sensors with innovative and biomimetic designs.Further system-level integrations and optimizations enable new forms of electronics for real-world applications.This review summarizes recent advancements in this active area and speculates on future directions.