Deep Learning for EMG-based Human-Machine Interaction:A Review

Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.

BLIND SPEECH SEPARATION FOR ROBOTS WITH INTELLIGENT HUMAN-MACHINE INTERACTION

Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation (BSS) for intelligent Human-Machine Interaction(HMI). Main idea of the algorithm is to simultaneously diagonalize the correlation matrix of the pre-whitened signals at different time delays for every frequency bins in time-frequency domain. The prososed method has two merits: (1) fast convergence speed; (2) high signal to interference ratio of the separated signals. Numerical evaluations are used to compare the performance of the proposed algorithm with two other deconvolution algorithms. An efficient algorithm to resolve permutation ambiguity is also proposed in this paper. The algorithm proposed saves more than 10% of computational time with properly selected parameters and achieves good performances for both simulated convolutive mixtures and real room recorded speeches.

A Robotic Teleoperation System for Precise Robotic Manipulation by Human-Machine Interaction

Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,a robotic teleoperation system for precise robotic manipulation is established.The data glove and the 7-degrees of freedom(DOFs)force feedback controller are used for the remote control interaction.The control system and the monitor system are designed for the remote precise manipulation.The monitor system contains an image acquisition system and a human-machine interaction module,and aims to simulate and detect the robot running state.Besides,a visual object tracking algorithm is developed to estimate the states of the dynamic system from noisy observations.The established robotic teleoperation systemis applied to a series of experiments,and high-precision results are obtained,showing the effectiveness of the physical system.

Fully Fabric-Based Triboelectric Nanogenerators as Self-Powered Human-Machine Interactive Keyboards

Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.

The Creative Design Research of Product Appearance Based on Human-machine Interaction and Interface

Today’s product creative design has rendered many fe atures and has brought a great change in our everyday life, there are many new c hallenges in its traditional theory and principle. According to the traditional design theory, the FBS design model pays more attention to the function and stru cture of the product. But this model still couldn’t strengthen the relation bet ween product appearance design and human-machine design effectively. This paper adopt converse design thinking and presents an improved design thinking methodo logy based on C: FBS for product appearance design and give a general summarizat ion for the features, methods and technology based on human-machine interaction and interface. Meanwhile it also combines with the behavior design of product r elated IT fields and constructs a new outline to improve the design of product a ppearance supported by the technology of computer aided design. So the new metho d about design thinking for computer aided design, the new abstract product design model and the key problem of design thinking based on human-machine inte raction and interface are addressed in this paper. This kind of creative design theory that is driven by human-machine interaction and interface will help the development of CAD software system and the research of product design and manufa cture. Additionally, this paper gives some beneficial characters to address the theory based on human-machine interaction and interface. Meanwhile, combining with the developing of computer technology, the trends of design thinking based on t he technology of human-machine interaction and interface are also analyzed and discussed at the end of this paper.

Flexible and multifunctional triboelectric nanogenerator based on liquid metal/polyvinyl alcohol hydrogel for energy harvesting and self-powered wearable human-machine interaction

Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriously hinder its development.Herein,we report a robust route to a liquid metal(LM)/polyvinyl alcohol(PVA)hydrogel-based TENG(LP-TENG).Owing to the intrinsically liquid feature of conductive LM within the flexible PVA hydrogel,the as-prepared LP-TENG exhibited comprehensiye advantages of adaptability,biocompatibility,outstanding electrical performance,superior stability,recyclability and diverse applications,which were unattainable by traditional systems.Concretely,the LP-TENG delivered appealing open circuit voltage of 250 V,short circuit current of 4μA and transferred charge of 120 nC with high stability,outperforming most advanced TENG systems.The LP-TENG was successfully employed for versatile applications with multifunctionality,including human motion detection,handwriting recognition,energy collection,message transmission and human-machine interaction.This work presents significant prospects for crafting advanced materials and devices in the fields of wearable electronics,flexible skin and smart robots.

Web GIS Human-Machine Interactive Interface Design with VISI

VISI (视觉身份系统因特网) 的熔化，数字地图和网 GIS 被介绍。网 GIS 与 VISI 需要连接交互设计认为更多是新因素。VISI 能为网 GIS 提供设计原则，元素和内容。武汉总线搜索系统的设计被完成证实熔化的有效性和有实行可能。

Human-machine interactive streaming anomaly detection by online self-adaptive forest

At nomaly detectors are used to distinguish differences between normal and abnormal data,which are usually implemented by evaluating and ranking the anomaly scores of each instance.A static unsupervised streaming anomaly detector is difficult to dynamically adjust anomaly score calculation.In real scenarios,anomaly detection often needs to be regulated by human feedback,which benefits adjusting anomaly detectors.In this paper,we propose a human-machine interactive streaming anomaly detection method,named ISPForest,which can be adaptively updated online under the guidance of human feedback.In particular,the feedback will be used to adjust the anomaly score calculation and structure of the detector,ideally attaining more accurate anomaly scores in the future.Our main contribution is to improve the tree-based streaming anomaly detection model that can be updated online from perspectives of anomaly score calculation and model structure.Our approach is instantiated for the powerful class of tree-based streaming anomaly detectors,and we conduct experiments on a range of benchmark datasets.The results demonstrate that the utility of incorporating feedback can improve the performance of anomaly detectors with a few human efforts.

Designing interactive glazing through an engineering psychology approach:Six augmented reality scenarios that envision future car human-machine interface

Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.

Human-machine interaction force control: using a model-referenced adaptive impedance device to control an index finger exoskeleton

Exoskeleton robots and their control methods have been extensively developed to aid post-stroke rehabilitation. Most of the existing methods using linear controllers are designed for position control and are not suitable for human-machine interaction(HMI) force control, as the interaction system between the human body and exoskeleton is uncertain and nonlinear. We present an approach for HMI force control via model reference adaptive impedance control(MRAIC) to solve this problem in case of index finger exoskeleton control. First, a dynamic HMI model, which is based on a position control inner loop, is formulated. Second, the theoretical MRAC framework is implemented in the control system. Then, the adaptive controllers are designed according to the Lyapunov stability theory. To verify the performance of the proposed method, we compare it with a proportional-integral-derivative(PID) method in the time domain with real experiments and in the frequency domain with simulations. The results illustrate the effectiveness and robustness of the proposed method in solving the nonlinear HMI force control problem in hand exoskeleton.

High-performance optical noncontact controlling system based on broadband PtTex/Si heterojunction photodetectors for human-machine interaction

Noncontact interaction systems have attracted considerable research attention in recent years because of convenient operation,sterility,and injury prevention.However,the insufficient sensing distance and weak robustness of noncontact interaction systems for complex environments limit their practical applications.Here,we designed an integrated optical noncontact controlling system(ONCS)based on PtTe_(x)/Si optoelectronic heterojunction array.Broadband sensitive photoresponse is realized at zero bias voltage,with excellent detectivity and responsivity,boosting the noncontact sensing distance to at least 150 mm.Consequently,the system can perform noncontact detection,encoding,and control by recognizing shadow-induced spatiotemporal sequence changes in heterojunction array photocurrents.As a proof of concept,different interactive functions have been demonstrated with good accuracy and robustness by encoding finger movement above the ONCS.This study provides a new perspective for constructing high-performance noncontact interaction systems.

ST-Map:an Interactive Map for Discovering Spatial and Temporal Patterns in Bibliographic Data

Getting insight into the spatiotemporal distribution patterns of knowledge innovation is receiving increasing attention from policymakers and economic research organizations.Many studies use bibliometric data to analyze the popularity of certain research topics,well-adopted methodologies,influential authors,and the interrelationships among research disciplines.However,the visual exploration of the patterns of research topics with an emphasis on their spatial and temporal distribution remains challenging.This study combined a Space-Time Cube(STC)and a 3D glyph to represent the complex multivariate bibliographic data.We further implemented a visual design by developing an interactive interface.The effectiveness,understandability,and engagement of ST-Map are evaluated by seven experts in geovisualization.The results suggest that it is promising to use three-dimensional visualization to show the overview and on-demand details on a single screen.

Biological Interaction and Imaging of Ultrasmall Gold Nanoparticles

Ultrasmall gold nanoparticles(AuNPs)typically includes atomically precise gold nanoclusters(AuNCs)and AuNPs with a core size below 3 nm.Serving as a bridge between small molecules and traditional inorganic nanoparticles,the ultrasmall AuNPs show the unique advantages of both small molecules(e.g.,rapid distribution,renal clearance,low non-specific organ accumulation)and nanoparticles(e.g.,long blood circulation and enhanced permeability and retention effect).The emergence of ultrasmall AuNPs creates significant opportunities to address many challenges in the health field including disease diagnosis,monitoring and treatment.Since the nano–bio interaction dictates the overall biological applications of the ultrasmall AuNPs,this review elucidates the recent advances in the biological interactions and imaging of ultrasmall AuNPs.We begin with the introduction of the factors that influence the cellular interactions of ultrasmall AuNPs.We then discuss the organ interactions,especially focus on the interactions of the liver and kidneys.We further present the recent advances in the tumor interactions of ultrasmall AuNPs.In addition,the imaging performance of the ultrasmall AuNPs is summarized and discussed.Finally,we summarize this review and provide some perspective on the future research direction of the ultrasmall AuNPs,aiming to accelerate their clinical translation.

Ecological network analysis reveals complex responses of tree species life stage interactions to stand variables

Tree interactions are essential for the structure,dynamics,and function of forest ecosystems,but variations in the architecture of life-stage interaction networks(LSINs)across forests is unclear.Here,we constructed 16 LSINs in the mountainous forests of northwest Hebei,China based on crown overlap from four mixed forests with two dominant tree species.Our results show that LSINs decrease the complexity of stand densities and basal areas due to the interaction cluster differentiation.In addition,we found that mature trees and saplings play different roles,the first acting as“hub”life stages with high connectivity and the second,as“bridges”controlling information flow with high centrality.Across the forests,life stages with higher importance showed better parameter stability within LSINs.These results reveal that the structure of tree interactions among life stages is highly related to stand variables.Our efforts contribute to the understanding of LSIN complexity and provide a basis for further research on tree interactions in complex forest communities.

Study of the Relationship Between New Ionic Interaction Parameters and Salt Solubility in Electrolyte Solutions Based on Molecular Dynamics Simulation

Studying the relationship between ionic interactions and salt solubility in seawater has implications for seawater desalination and mineral extraction.In this paper,a new method of expressing ion-to-ion interaction is proposed by using molecular dynamics simulation,and the relationship between ion-to-ion interaction and salt solubility in a simulated seawater water-salt system is investigated.By analyzing the variation of distance and contact time between ions in an electrolyte solution,from both spatial and temporal perspectives,new parameters were proposed to describe the interaction between ions:interaction distance(ID),and interaction time ratio(ITR).The best correlation between characteristic time ratio and solubility was found for a molar ratio of salt-to-water of 10:100 with a correlation coefficient of 0.96.For the same salt,a positive correlation was found between CTR and the molar ratio of salt and water.For type 1-1,type 2-1,type 1-2,and type 2-2 salts,the correlation coefficients between CTR and solubility were 0.93,0.96,0.92,and 0.98 for a salt-to-water molar ratio of 10:100,respectively.The solubility of multiple salts was predicted by simulations and compared with experimental values,yielding an average relative deviation of 12.4%.The new ion-interaction parameters offer significant advantages in describing strongly correlated and strongly hydrated electrolyte solutions.

Interatomic Interaction Models for Magnetic Materials:Recent Advances

Atomistic modeling is a widely employed theoretical method of computational materials science.It has found particular utility in the study of magnetic materials.Initially,magnetic empirical interatomic potentials or spinpolarized density functional theory(DFT)served as the primary models for describing interatomic interactions in atomistic simulations of magnetic systems.Furthermore,in recent years,a new class of interatomic potentials known as magnetic machine-learning interatomic potentials(magnetic MLIPs)has emerged.These MLIPs combine the computational efficiency,in terms of CPU time,of empirical potentials with the accuracy of DFT calculations.In this review,our focus lies on providing a comprehensive summary of the interatomic interaction models developed specifically for investigating magnetic materials.We also delve into the various problem classes to which these models can be applied.Finally,we offer insights into the future prospects of interatomic interaction model development for the exploration of magnetic materials.

Resistive field generation in intense proton beam interaction with solid targets

The Brown-Preston-Singleton(BPS)stopping power model is added to our previously developed hybrid code to model ion beam-plasma interaction.Hybrid simulations show that both resistive field and ion scattering effects are important for proton beam transport in a solid target,in which they compete with each other.When the target is not completely ionized,the self-generated resistive field effect dominates over the ion scattering effect.However,when the target is completely ionized,this situation is reversed.Moreover,it is found that Ohmic heating is important for higher current densities and materials with high resistivity.The energy fraction deposited as Ohmic heating can be as high as 20%-30%.Typical ion divergences with half-angles of about 5°-10°will modify the proton energy deposition substantially and should be taken into account.

Isotope Tracking of Surface Water Groundwater Interaction in the Beninese Part of the Iullemeden Aquifer System

The Kandi basin is located in northeast Benin (West Africa). This study is focused on the estimation of water fluxes exchanged between the river Niger (and its tributaries) and the transboundary Iullemeden Aquifer System. In that framework, an innovative approach based on the application of the Bayesian Mixing Model (MixSIAR) analysis on water isotopes (oxygen-18, deuterium and tritium) was performed. Moreover, to assess the relevance of the model outputs, Pearson’s correlation and Principal Component Analysis (PCA) have been done. A complex relationship between surface water and groundwater has been found. Sixty percent (60%) of groundwater samples are made of more than 70% river water and rainwater;while 31.25% of surface water samples are made of about 84% groundwater. To safeguard sustainable water resources for the well-being of the local communities, surface water and groundwater must be managed as a unique component in the Kandi basin.

Numerical investigation of the effects of soil-structure and granular material-structure interaction on the seismic response of a flat-bottom reinforced concrete silo

In this work,a numerical study of the effects of soil-structure interaction(SSI)and granular material-structure interaction(GSI)on the nonlinear response and seismic capacity of flat-bottomed storage silos is conducted.A series of incremental dynamic analyses(IDA)are performed on a case of large reinforced concrete silo using 10 seismic recordings.The IDA results are given by two average IDA capacity curves,which are represented,as well as the seismic capacity of the studied structure,with and without a consideration of the SSI while accounting for the effect of GSI.These curves are used to quantify and evaluate the damage of the studied silo by utilizing two damage indices,one based on dissipated energy and the other on displacement and dissipated energy.The cumulative energy dissipation curves obtained by the average IDA capacity curves with and without SSI are presented as a function of the base shear,and these curves allow one to obtain the two critical points and the different limit states of the structure.It is observed that the SSI and GSI significantly influence the seismic response and capacity of the studied structure,particularly at higher levels of PGA.Moreover,the effect of the SSI reduces the damage index of the studied structure by 4%.

Dynamical nonlinear excitations induced by interaction quench in a two-dimensional box-trapped Bose-Einstein condensate

Manipulating nonlinear excitations,including solitons and vortices,is an essential topic in quantum many-body physics.A new progress in this direction is a protocol proposed in[Phys.Rev.Res.2043256(2020)]to produce dark solitons in a one-dimensional atomic Bose–Einstein condensate(BEC)by quenching inter-atomic interaction.Motivated by this work,we generalize the protocol to a two-dimensional BEC and investigate the generic scenario of its post-quench dynamics.For an isotropic disk trap with a hard-wall boundary,we find that successive inward-moving ring dark solitons(RDSs)can be induced from the edge,and the number of RDSs can be controlled by tuning the ratio of the after-and before-quench interaction strength across different critical values.The role of the quench played on the profiles of the density,phase,and sound velocity is also investigated.Due to the snake instability,the RDSs then become vortex–antivortex pairs with peculiar dynamics managed by the initial density and the after-quench interaction.By tuning the geometry of the box traps,demonstrated as polygonal ones,more subtle dynamics of solitons and vortices are enabled.Our proposed protocol and the discovered rich dynamical effects on nonlinear excitations can be realized in near future cold-atom experiments.