Deep Learning for EMG-based Human-Machine Interaction:A Review

Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.

The Creative Design Research of Product Appearance Based on Human-machine Interaction and Interface

Today’s product creative design has rendered many fe atures and has brought a great change in our everyday life, there are many new c hallenges in its traditional theory and principle. According to the traditional design theory, the FBS design model pays more attention to the function and stru cture of the product. But this model still couldn’t strengthen the relation bet ween product appearance design and human-machine design effectively. This paper adopt converse design thinking and presents an improved design thinking methodo logy based on C: FBS for product appearance design and give a general summarizat ion for the features, methods and technology based on human-machine interaction and interface. Meanwhile it also combines with the behavior design of product r elated IT fields and constructs a new outline to improve the design of product a ppearance supported by the technology of computer aided design. So the new metho d about design thinking for computer aided design, the new abstract product design model and the key problem of design thinking based on human-machine inte raction and interface are addressed in this paper. This kind of creative design theory that is driven by human-machine interaction and interface will help the development of CAD software system and the research of product design and manufa cture. Additionally, this paper gives some beneficial characters to address the theory based on human-machine interaction and interface. Meanwhile, combining with the developing of computer technology, the trends of design thinking based on t he technology of human-machine interaction and interface are also analyzed and discussed at the end of this paper.

BLIND SPEECH SEPARATION FOR ROBOTS WITH INTELLIGENT HUMAN-MACHINE INTERACTION

Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation (BSS) for intelligent Human-Machine Interaction(HMI). Main idea of the algorithm is to simultaneously diagonalize the correlation matrix of the pre-whitened signals at different time delays for every frequency bins in time-frequency domain. The prososed method has two merits: (1) fast convergence speed; (2) high signal to interference ratio of the separated signals. Numerical evaluations are used to compare the performance of the proposed algorithm with two other deconvolution algorithms. An efficient algorithm to resolve permutation ambiguity is also proposed in this paper. The algorithm proposed saves more than 10% of computational time with properly selected parameters and achieves good performances for both simulated convolutive mixtures and real room recorded speeches.

A Robotic Teleoperation System for Precise Robotic Manipulation by Human-Machine Interaction

Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,a robotic teleoperation system for precise robotic manipulation is established.The data glove and the 7-degrees of freedom(DOFs)force feedback controller are used for the remote control interaction.The control system and the monitor system are designed for the remote precise manipulation.The monitor system contains an image acquisition system and a human-machine interaction module,and aims to simulate and detect the robot running state.Besides,a visual object tracking algorithm is developed to estimate the states of the dynamic system from noisy observations.The established robotic teleoperation systemis applied to a series of experiments,and high-precision results are obtained,showing the effectiveness of the physical system.

Web GIS Human-Machine Interactive Interface Design with VISI

The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.

Designing interactive glazing through an engineering psychology approach:Six augmented reality scenarios that envision future car human-machine interface

Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.

Human Interaction Dynamics for Its Use in Mobile Robotics:Impedance Control for Leader-follower Formation

A complete characterization of the behavior in human-robot interactions(HRI) includes both: the behavioral dynamics and the control laws that characterize how the behavior is regulated with the perception data. In this way, this work proposes a leader-follower coordinate control based on an impedance control that allows to establish a dynamic relation between social forces and motion error. For this, a scheme is presented to identify the impedance based on fictitious social forces, which are described by distance-based potential fields.As part of the validation procedure, we present an experimental comparison to select the better of two different fictitious force structures. The criteria are determined by two qualities: least impedance errors during the validation procedure and least parameter variance during the recursive estimation procedure.Finally, with the best fictitious force and its identified impedance,an impedance control is designed for a mobile robot Pioneer 3AT,which is programmed to follow a human in a structured scenario.According to results, and under the hypothesis that moving like humans will be acceptable by humans, it is believed that the proposed control improves the social acceptance of the robot for this kind of interaction.

Magnetic Array Assisted Triboelectric Nanogenerator Sensor for Real‑Time Gesture Interaction

In human-machine interaction,robotic hands are useful in many scenarios.To operate robotic hands via gestures instead of handles will greatly improve the convenience and intuition of human-machine interaction.Here,we present a magnetic array assisted sliding triboelectric sensor for achieving a real-time gesture interaction between a human hand and robotic hand.With a finger’s traction movement of flexion or extension,the sensor can induce positive/negative pulse signals.Through counting the pulses in unit time,the degree,speed,and direction of finger motion can be judged in realtime.The magnetic array plays an important role in generating the quantifiable pulses.The designed two parts of magnetic array can transform sliding motion into contact-separation and constrain the sliding pathway,respectively,thus improve the durability,low speed signal amplitude,and stability of the system.This direct quantization approach and optimization of wearable gesture sensor provide a new strategy for achieving a natural,intuitive,and real-time human-robotic interaction.

Skin‑Inspired Ultra‑Tough Supramolecular Multifunctional Hydrogel Electronic Skin for Human–Machine Interaction

Multifunctional supramolecular ultra-tough bionic e-skin with unique durability for human–machine interaction in complex scenarios still remains challenging.Herein,we develop a skininspired ultra-tough e-skin with tunable mechanical properties by a physical cross-linking salting-freezing-thawing method.The gelling agent(β-Glycerophosphate sodium:Gp)induces the aggregation and binding of PVA molecular chains and thereby toughens them(stress up to 5.79 MPa,toughness up to 13.96 MJ m^(−3)).Notably,due to molecular self-assembly,hydrogels can be fully recycled and reprocessed by direct heating(100°C for a few seconds),and the tensile strength can still be maintained at about 100%after six recoveries.The hydrogel integrates transparency(>60%),super toughness(up to 13.96 MJ m^(−3),bearing 1500 times of its own tensile weight),good antibacterial properties(E.coli and S.aureus),UV protection(Filtration:80%–90%),high electrical conductivity(4.72 S m^(−1)),anti-swelling and recyclability.The hydrogel can not only monitor daily physiological activities,but also be used for complex activities underwater and message encryption/decryption.We also used it to create a complete finger joint rehabilitation system with an interactive interface that dynamically presents the user’s health status.Our multifunctional electronic skin will have a profound impact on the future of new rehabilitation medical,human–machine interaction,VR/AR and the metaverse fields.

Flexible and multifunctional triboelectric nanogenerator based on liquid metal/polyvinyl alcohol hydrogel for energy harvesting and self-powered wearable human-machine interaction

Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriously hinder its development.Herein,we report a robust route to a liquid metal(LM)/polyvinyl alcohol(PVA)hydrogel-based TENG(LP-TENG).Owing to the intrinsically liquid feature of conductive LM within the flexible PVA hydrogel,the as-prepared LP-TENG exhibited comprehensiye advantages of adaptability,biocompatibility,outstanding electrical performance,superior stability,recyclability and diverse applications,which were unattainable by traditional systems.Concretely,the LP-TENG delivered appealing open circuit voltage of 250 V,short circuit current of 4μA and transferred charge of 120 nC with high stability,outperforming most advanced TENG systems.The LP-TENG was successfully employed for versatile applications with multifunctionality,including human motion detection,handwriting recognition,energy collection,message transmission and human-machine interaction.This work presents significant prospects for crafting advanced materials and devices in the fields of wearable electronics,flexible skin and smart robots.

Interaction and the Genesis of Experience: A Phenomenological Contribution for Meaningful Embodied Artificial Intelligence

In this article I will address the issue of the meaning of Embodied Artificial Intelligence(EAI)as it is configured today.My starting point is the refined interactive perspective on the semantics of EAI,as was recently suggested by Froese and colleagues.This perspective rests on the assumption that the concept of human bodily subjectivity must be extended to include meaning-making processes,which are enabled by advanced AI systems that may be incorporated in the human biological body.After having clarified the technical background,I will introduce the genetic component of the phenomenological method as a suitable tool to face the aforementioned issue.Towards this end,I will place the genetic method in the context of the so-called New Human-Machine Interaction(New HMI).I will further outline a genetic phenomenology of visual embodiment,suggesting a futuristic application based on the thesis of the“technological supplementation of phenomenological methodology”through the synthetic method.The case at stake is that of patients with a severe clinical picture characterised by the loss of corneal function,who in the near future could be treated with synthetic corneal prosthetic implants produced by a 3D bio-printing process by using an advanced EAI technique.I will conclude this article with a brief review of the main problems that still remain open.

适度信任构建下面向人车共驾的自动驾驶HMI 设计策略研究

人车共驾是自动驾驶发展的重要方向,信任是影响其中人车协作关系可持续性的关键因素,适度信任构建有助于提升用户使用自动驾驶的意愿、安全性与用户体验。在分析信任与自动驾驶HMI关系的基础上,从共驾与接管两大场景出发,解析人车共驾中信任来源,提炼设计目标,总结设计策略。针对内容与形式设计的一体两面,围绕适度信任构建,提出HMI内容设计涵盖的信息要素及形式设计的可行方向。自动驾驶HMI设计需从系统层、环境层与驾驶层提供维持适度信任交互所需的关键信息,并从多维度、多模态与拟人化方向构建适度的情境信任、经验信任与关系信任。

全媒时代视觉思维下的汽车HMI交互设计研究

随着新媒体、媒介的不断更新,消费者进入全媒体时代,汽车产业也在进行技术更迭与创意革新。新能源汽车近几年在市场占比大幅增加,已在HMI(Human Machine Interface)交互领域做出了巨大改变,智能舱取代了传统繁琐的“车机”操作交互,这种颠覆性的改变影响着人们的驾驶方式和出行体验。基于以人为本的交互设计理念及全媒体下的视觉思维逻辑进化、汽车HMI交互设计、情感共鸣等方面,从手机到汽车实现线性联动,针对如何创造良好的车机交互体验进行深入的分析与探讨,为HMI未来设计提供经验。

基于车联网的HMI交互体验流程与方法探究

目的探索交互设计的方法与流程在基于车联网的HMI交互体验设计过程中的应用方式,推进车联网技术在HMI交互产品中的应用。方法以交互设计方法与流程为基础,分析和对比不同课题中交互设计的方法和流程的应用方式,利用策略性设计成果检验方法的有效性。探讨了交互设计方法与流程在HMI交互体验研究和设计中的有效应用方式。结论结合案例表明了交互设计方法与流程在HMI交互体验设计过程中的重要指导作用,时刻基于用户中心理念对具体方法进行灵活组合运用是必要的。

基于HMI多通道注射泵控制系统的设计

微量注射泵是广泛应用于医疗、生物工程、基因工程、化学工程、环境工程等领域的一种数字化、智能化的精密仪器。该设计通过HMI及同步控制板可以同时控制多台注射泵工作,方便快速设置参数,多个指示灯清晰确认其工作状态。每台注射泵支持多种工作模式及多种注射器选择,适应不同流量的控制要求,提高了工作效率和加注精度。

A Rapid Adaptation Approach for Dynamic Air‑Writing Recognition Using Wearable Wristbands with Self‑Supervised Contrastive Learning

Wearable wristband systems leverage deep learning to revolutionize hand gesture recognition in daily activities.Unlike existing approaches that often focus on static gestures and require extensive labeled data,the proposed wearable wristband with selfsupervised contrastive learning excels at dynamic motion tracking and adapts rapidly across multiple scenarios.It features a four-channel sensing array composed of an ionic hydrogel with hierarchical microcone structures and ultrathin flexible electrodes,resulting in high-sensitivity capacitance output.Through wireless transmission from a Wi-Fi module,the proposed algorithm learns latent features from the unlabeled signals of random wrist movements.Remarkably,only few-shot labeled data are sufficient for fine-tuning the model,enabling rapid adaptation to various tasks.The system achieves a high accuracy of 94.9%in different scenarios,including the prediction of eight-direction commands,and air-writing of all numbers and letters.The proposed method facilitates smooth transitions between multiple tasks without the need for modifying the structure or undergoing extensive task-specific training.Its utility has been further extended to enhance human–machine interaction over digital platforms,such as game controls,calculators,and three-language login systems,offering users a natural and intuitive way of communication.

主副共驾场景下智能网联汽车HMI界面设计研究

通过分析现阶段智能网联汽车HMI的设计不足,提出主副共驾理念下的应对策略,达到主副共驾场景下的设计目的,满足用户对“第三空间”的期待。采取文献查阅、案例研究、用户研究等研究方法,基于国内外智能网联汽车HMI研究现状,挖掘主副共驾趋势与理念。并从协同、互动、沉浸的角度提出设计策略。以福特Evos车型为例进行实践验证。得到符合主副共驾场景的智能网联汽车HMI界面设计。研究得出当智能层级升级到L3及以上,关注主副共驾在智能网联汽车HMI界面设计中具有重要意义。基于“主副贯穿型”屏幕,提出“实时协同、适时互动、沉浸体验”的设计策略,并得出此软硬体的组合设计最为适合主副共驾场景。

Human-machine interaction force control: using a model-referenced adaptive impedance device to control an index finger exoskeleton

Exoskeleton robots and their control methods have been extensively developed to aid post-stroke rehabilitation. Most of the existing methods using linear controllers are designed for position control and are not suitable for human-machine interaction(HMI) force control, as the interaction system between the human body and exoskeleton is uncertain and nonlinear. We present an approach for HMI force control via model reference adaptive impedance control(MRAIC) to solve this problem in case of index finger exoskeleton control. First, a dynamic HMI model, which is based on a position control inner loop, is formulated. Second, the theoretical MRAC framework is implemented in the control system. Then, the adaptive controllers are designed according to the Lyapunov stability theory. To verify the performance of the proposed method, we compare it with a proportional-integral-derivative(PID) method in the time domain with real experiments and in the frequency domain with simulations. The results illustrate the effectiveness and robustness of the proposed method in solving the nonlinear HMI force control problem in hand exoskeleton.

High-performance optical noncontact controlling system based on broadband PtTex/Si heterojunction photodetectors for human-machine interaction

Noncontact interaction systems have attracted considerable research attention in recent years because of convenient operation,sterility,and injury prevention.However,the insufficient sensing distance and weak robustness of noncontact interaction systems for complex environments limit their practical applications.Here,we designed an integrated optical noncontact controlling system(ONCS)based on PtTe_(x)/Si optoelectronic heterojunction array.Broadband sensitive photoresponse is realized at zero bias voltage,with excellent detectivity and responsivity,boosting the noncontact sensing distance to at least 150 mm.Consequently,the system can perform noncontact detection,encoding,and control by recognizing shadow-induced spatiotemporal sequence changes in heterojunction array photocurrents.As a proof of concept,different interactive functions have been demonstrated with good accuracy and robustness by encoding finger movement above the ONCS.This study provides a new perspective for constructing high-performance noncontact interaction systems.

新能源汽车时代车载HMI交互界面发展方向的探索

随着计算机系统的迅速发展,汽车也变得越来越智能,从原来简单的汽油机发展成为一个科技与智慧结合的新产物,随着功能多样化,与之增加的便是繁杂的操作方式,作为人机交流的桥梁,车内HMI交互界面的设计便显得尤为重要,因此文章从多角度来介绍车载交互界面的现状,设计原理,以及未来发展可能性的方向。