BLIND SPEECH SEPARATION FOR ROBOTS WITH INTELLIGENT HUMAN-MACHINE INTERACTION

Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation (BSS) for intelligent Human-Machine Interaction(HMI). Main idea of the algorithm is to simultaneously diagonalize the correlation matrix of the pre-whitened signals at different time delays for every frequency bins in time-frequency domain. The prososed method has two merits: (1) fast convergence speed; (2) high signal to interference ratio of the separated signals. Numerical evaluations are used to compare the performance of the proposed algorithm with two other deconvolution algorithms. An efficient algorithm to resolve permutation ambiguity is also proposed in this paper. The algorithm proposed saves more than 10% of computational time with properly selected parameters and achieves good performances for both simulated convolutive mixtures and real room recorded speeches.

Relationship between Interaction Anxiousness,Academic Resilience,Cultural Intelligence and Ego-Identity among Chinese Vocational Pathway University Students:A Conditional Process Analysis Model

Background:University students’ego-identity,an essential component of their psychological development and mental health,has widely attracted the attention of policymakers,schools,and parents.Method:A total of 298 Chinese vocational pathway undergraduates were recruited,and a conditional process analysis model was adopted to explore the interaction mechanism of ego-identity.Results:The results suggest that the ego-identity of Chinese vocational pathway undergraduates is significantly affected by interaction anxiousness,academic resilience,and cultural intelligence.(1)Interaction anxiousness significantly and positively predicts ego-identity.(2)Academic resilience positively and partially mediates the effect of interaction anxiousness on ego-identity.(3)Cultural intelligence significantly and positively moderates the relationship between interaction anxiousness and ego-identity.However,a similar moderating effect was not found between interaction anxiousness and academic resilience.(4)As cultural intelligence increases,the negative influence of interaction anxiousness on ego-identity gradually diminishes,whatever the cultural intelligence level.Conclusions:Interaction anxiousness,academic resilience,and cultural intelligence are essential determinants of ego-identity among Chinese vocational pathway undergraduates.Strategic interventions should be utilized to enhance their abilities to alleviate interpersonal tensions,promote their resilience in facing academic difficulties,cope with diverse cultures,and boost their sense of self-confirmation.

Role of intelligent/interactive qualitative and quantitative analysisthree-dimensional estimated model in donor-recipient size mismatch following deceased donor liver transplantation

BACKGROUND Donor-recipient size mismatch(DRSM)is considered a crucial factor for poor outcomes in liver transplantation(LT)because of complications,such as massive intraoperative blood loss(IBL)and early allograft dysfunction(EAD).Liver volumetry is performed routinely in living donor LT,but rarely in deceased donor LT(DDLT),which amplifies the adverse effects of DRSM in DDLT.Due to the various shortcomings of traditional manual liver volumetry and formula methods,a feasible model based on intelligent/interactive qualitative and quantitative analysis-three-dimensional(IQQA-3D)for estimating the degree of DRSM is needed.AIM To identify benefits of IQQA-3D liver volumetry in DDLT and establish an estimation model to guide perioperative management.METHODS We retrospectively determined the accuracy of IQQA-3D liver volumetry for standard total liver volume(TLV)(sTLV)and established an estimation TLV(eTLV)index(eTLVi)model.Receiver operating characteristic(ROC)curves were drawn to detect the optimal cut-off values for predicting massive IBL and EAD in DDLT using donor sTLV to recipient sTLV(called sTLVi).The factors influencing the occurrence of massive IBL and EAD were explored through logistic regression analysis.Finally,the eTLVi model was compared with the sTLVi model through the ROC curve for verification.RESULTS A total of 133 patients were included in the analysis.The Changzheng formula was accurate for calculating donor sTLV(P=0.083)but not for recipient sTLV(P=0.036).Recipient eTLV calculated using IQQA-3D highly matched with recipient sTLV(P=0.221).Alcoholic liver disease,gastrointestinal bleeding,and sTLVi>1.24 were independent risk factors for massive IBL,and drug-induced liver failure was an independent protective factor for massive IBL.Male donor-female recipient combination,model for end-stage liver disease score,sTLVi≤0.85,and sTLVi≥1.32 were independent risk factors for EAD,and viral hepatitis was an independent protective factor for EAD.The overall survival of patients in the 0.85<sTLVi<1.32 group was better compared to the sTLVi≤0.85 group and sTLVi≥1.32 group(P<0.001).There was no statistically significant difference in the area under the curve of the sTLVi model and IQQA-3D eTLVi model in the detection of massive IBL and EAD(all P>0.05).CONCLUSION IQQA-3D eTLVi model has high accuracy in predicting massive IBL and EAD in DDLT.We should follow the guidance of the IQQA-3D eTLVi model in perioperative management.

Designing interactive glazing through an engineering psychology approach:Six augmented reality scenarios that envision future car human-machine interface

Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.

Deep Learning for EMG-based Human-Machine Interaction:A Review

Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.

A Robotic Teleoperation System for Precise Robotic Manipulation by Human-Machine Interaction

Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,a robotic teleoperation system for precise robotic manipulation is established.The data glove and the 7-degrees of freedom(DOFs)force feedback controller are used for the remote control interaction.The control system and the monitor system are designed for the remote precise manipulation.The monitor system contains an image acquisition system and a human-machine interaction module,and aims to simulate and detect the robot running state.Besides,a visual object tracking algorithm is developed to estimate the states of the dynamic system from noisy observations.The established robotic teleoperation systemis applied to a series of experiments,and high-precision results are obtained,showing the effectiveness of the physical system.

A Study on Modular Fixture Design with Intelligent Selection of Elements and Interactive Assembly

ＡＳｔｕｄｙｏｎＭｏｄｕｌａｒＦｉｘｔｕｒｅＤｅｓｉｇｎｗｉｔｈＩｎｔｅｌｌｉｇｅｎｔＳｅｌｅｃｔｉｏｎｏｆＥｌｅｍｅｎｔｓａｎｄＩｎｔｅｒａｃｔｉｖｅＡｓｓｅｍｂｌｙＬＩＵＷｅｎｊｉａｎ；ＨＵＡＮＧＹｏｎｇｑｉａｎｇ；ＣＨＡＮＧＷｅｉ（刘文剑），（...

Skin‑Inspired Ultra‑Tough Supramolecular Multifunctional Hydrogel Electronic Skin for Human–Machine Interaction

Multifunctional supramolecular ultra-tough bionic e-skin with unique durability for human–machine interaction in complex scenarios still remains challenging.Herein,we develop a skininspired ultra-tough e-skin with tunable mechanical properties by a physical cross-linking salting-freezing-thawing method.The gelling agent(β-Glycerophosphate sodium:Gp)induces the aggregation and binding of PVA molecular chains and thereby toughens them(stress up to 5.79 MPa,toughness up to 13.96 MJ m^(−3)).Notably,due to molecular self-assembly,hydrogels can be fully recycled and reprocessed by direct heating(100°C for a few seconds),and the tensile strength can still be maintained at about 100%after six recoveries.The hydrogel integrates transparency(>60%),super toughness(up to 13.96 MJ m^(−3),bearing 1500 times of its own tensile weight),good antibacterial properties(E.coli and S.aureus),UV protection(Filtration:80%–90%),high electrical conductivity(4.72 S m^(−1)),anti-swelling and recyclability.The hydrogel can not only monitor daily physiological activities,but also be used for complex activities underwater and message encryption/decryption.We also used it to create a complete finger joint rehabilitation system with an interactive interface that dynamically presents the user’s health status.Our multifunctional electronic skin will have a profound impact on the future of new rehabilitation medical,human–machine interaction,VR/AR and the metaverse fields.

A Task-Oriented Hybrid Cloud Architecture with Deep Cognition Mechanism for Intelligent Space

Intelligent Space(IS)is widely regarded as a promising paradigm for improving quality of life through using service task processing.As the field matures,various state-of-the-art IS architectures have been proposed.Most of the IS architectures designed for service robots face the problems of fixedfunction modules and low scalability when performing service tasks.To this end,we propose a hybrid cloud service robot architecture based on a Service-Oriented Architecture(SOA).Specifically,we first use the distributed deployment of functional modules to solve the problem of high computing resource occupancy.Then,the Socket communication interface layer is designed to improve the calling efficiency of the function module.Next,the private cloud service knowledge base and the dataset for the home environment are used to improve the robustness and success rate of the robot when performing tasks.Finally,we design and deploy an interactive system based on Browser/Server(B/S)architecture,which aims to display the status of the robot in real-time as well as to expand and call the robot service.This system is integrated into the private cloud framework,which provides a feasible solution for improving the quality of life.Besides,it also fully reveals how to actively discover and provide the robot service mechanism of service tasks in the right way.The results of extensive experiments show that our cloud system provides sufficient prior knowledge that can assist the robot in completing service tasks.It is an efficient way to transmit data and reduce the computational burden on the robot.By using our cloud detection module,the robot system can save approximately 25% of the averageCPUusage and reduce the average detection time by 0.1 s compared to the locally deployed system,demonstrating the reliability and practicality of our proposed architecture.

Exploiting Human Pose and Scene Information for Interaction Detection

Identifying human actions and interactions finds its use in manyareas, such as security, surveillance, assisted living, patient monitoring, rehabilitation,sports, and e-learning. This wide range of applications has attractedmany researchers to this field. Inspired by the existing recognition systems,this paper proposes a new and efficient human-object interaction recognition(HOIR) model which is based on modeling human pose and scene featureinformation. There are different aspects involved in an interaction, includingthe humans, the objects, the various body parts of the human, and the backgroundscene. Themain objectives of this research include critically examiningthe importance of all these elements in determining the interaction, estimatinghuman pose through image foresting transform (IFT), and detecting the performedinteractions based on an optimizedmulti-feature vector. The proposedmethodology has six main phases. The first phase involves preprocessing theimages. During preprocessing stages, the videos are converted into imageframes. Then their contrast is adjusted, and noise is removed. In the secondphase, the human-object pair is detected and extracted from each image frame.The third phase involves the identification of key body parts of the detectedhumans using IFT. The fourth phase relates to three different kinds of featureextraction techniques. Then these features are combined and optimized duringthe fifth phase. The optimized vector is used to classify the interactions in thelast phase. TheMSRDaily Activity 3D dataset has been used to test this modeland to prove its efficiency. The proposed system obtains an average accuracyof 91.7% on this dataset.

Flexible and multifunctional triboelectric nanogenerator based on liquid metal/polyvinyl alcohol hydrogel for energy harvesting and self-powered wearable human-machine interaction

Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriously hinder its development.Herein,we report a robust route to a liquid metal(LM)/polyvinyl alcohol(PVA)hydrogel-based TENG(LP-TENG).Owing to the intrinsically liquid feature of conductive LM within the flexible PVA hydrogel,the as-prepared LP-TENG exhibited comprehensiye advantages of adaptability,biocompatibility,outstanding electrical performance,superior stability,recyclability and diverse applications,which were unattainable by traditional systems.Concretely,the LP-TENG delivered appealing open circuit voltage of 250 V,short circuit current of 4μA and transferred charge of 120 nC with high stability,outperforming most advanced TENG systems.The LP-TENG was successfully employed for versatile applications with multifunctionality,including human motion detection,handwriting recognition,energy collection,message transmission and human-machine interaction.This work presents significant prospects for crafting advanced materials and devices in the fields of wearable electronics,flexible skin and smart robots.

Human-Machine Shared Lateral Control Strategy for Intelligent Vehicles Based on Human Driver Risk Perception Reliability

Intelligent vehicle(Ⅳ)technology has developed rapidly in recent years.However,achieving fully unmanned driving still presents numerous challenges,which means that human drivers will continue to play a vital role in vehicle operation for the foreseeable future.Human-machine shared driving,involving cooperation between a human driver and an automated driving system(AVS),has been widely regarded as a necessary stage for the development of IVs.Focusing onⅣdriving safety,this study proposed a human-machine shared lateral control strategy(HSLCS)based on the reliability of driver risk perception.The HSLCS starts by identifying the effective areas of driver risk perception based on eye movements.It establishes an anisotropic driving risk field,which serves as the foundation for the AVS to assess risk levels.Building upon the cumulative and diminishing effects of risk perception,the proposed approach leverages the driver's risk perception effective area and converts the risk field into a representation aligned with the driver's perspective.Subsequently,it quantifies the reliability of the driver's risk perception by using area-matching rules.Finally,based on the driver’s risk perception reliability and dif-ferences in lateral driving operation between the human driver and the AVS,the dynamic distribution of driving authority is achieved through a fuzzy rule-based system,and the human-machine shared lateral control is completed by using model predictive control.The HSLCS was tested across various scenarios on a driver-in-the-loop test platform.The results show that the HSLCS can realize the synergy and complementarity of human and machine intelligence,effectively ensuring the safety ofⅣoperation.

Artificial intelligence for disease diagnostics still has a long way to go

Artificial intelligence(AI)can sometimes resolve difficulties that other advanced technologies and humans cannot.In medical diagnostics,AI has the advantage of processing figure recognition,especially for images with similar characteristics that are difficult to distinguish with the naked eye.However,the mechanisms of this advanced technique should be well-addressed to elucidate clinical issues.In this letter,regarding an original study presented by Takayama et al,we suggest that the authors should effectively illustrate the mechanism and detailed procedure that artificial intelligence techniques processing the acquired images,including the recognition of non-obvious difference between the normal parts and pathological ones,which were impossible to be distinguished by naked eyes,such as the basic constitutional elements of pixels and grayscale,special molecules or even some metal ions which involved into the diseases occurrence.

Interaction and the Genesis of Experience: A Phenomenological Contribution for Meaningful Embodied Artificial Intelligence

In this article I will address the issue of the meaning of Embodied Artificial Intelligence(EAI)as it is configured today.My starting point is the refined interactive perspective on the semantics of EAI,as was recently suggested by Froese and colleagues.This perspective rests on the assumption that the concept of human bodily subjectivity must be extended to include meaning-making processes,which are enabled by advanced AI systems that may be incorporated in the human biological body.After having clarified the technical background,I will introduce the genetic component of the phenomenological method as a suitable tool to face the aforementioned issue.Towards this end,I will place the genetic method in the context of the so-called New Human-Machine Interaction(New HMI).I will further outline a genetic phenomenology of visual embodiment,suggesting a futuristic application based on the thesis of the“technological supplementation of phenomenological methodology”through the synthetic method.The case at stake is that of patients with a severe clinical picture characterised by the loss of corneal function,who in the near future could be treated with synthetic corneal prosthetic implants produced by a 3D bio-printing process by using an advanced EAI technique.I will conclude this article with a brief review of the main problems that still remain open.

Research on the Multi-Interactive Intelligent Teaching Model of College English in the Information Technology Environment

The multi-interactive teaching mode based on the information technology is a new teaching mode, which promotes students' autonomous learning and research-oriented learning through the online and offline effective interaction in and out of class, fully embodying the principle of the learning-orientation. Based on this, this paper focuses on the connotation and the theoretical basis o f the multi-interactive teaching model, as well as its implementation practices and characteristics, with a view o f providing help to improve the quality of the college English teaching.

Research and Application of AI-Based Interactive Exhibits in Wuhan Museum of Science and Technology

This article aims to explore the development and application of AI-based interactive exhibits in Wuhan Museum of Science and Technology.By utilizing computer vision,natural language processing,and machine learning technologies,an innovative exhibit development and application system is proposed.This system employs deep learning algorithms and data analysis methods to achieve real-time perception of visitor behavior and adaptive interaction.The development process involves designing user interfaces and interaction methods to effectively enhance visitor engagement and learning outcomes.Through evaluation and comparison in practical applications,the potential of this system in enhancing exhibit interaction,increasing visitor engagement,improving educational effectiveness,and expanding avenues for scientific knowledge dissemination are validated.

Framework and Key Technologies of Human-machine Hybrid-augmented Intelligence System for Large-scale Power Grid Dispatching and Control

With integration of large-scale renewable energy,new controllable devices,and required reinforcement of power grids,modern power systems have typical characteristics such as uncertainty,vulnerability and openness,which makes operation and control of power grids face severe security challenges.Application of artificial intelligence(AI)technologies represented by machine learning in power grid regulation is limited by reliability,interpretability and generalization ability of complex modeling.Mode of hybrid-augmented intelligence(HAI)based on human-machine collaboration(HMC)is a pivotal direction for future development of AI technology in this field.Based on characteristics of applications in power grid regulation,this paper discusses system architecture and key technologies of human-machine hybrid-augmented intelligence(HHI)system for large-scale power grid dispatching and control(PGDC).First,theory and application scenarios of HHI are introduced and analyzed;then physical and functional architectures of HHI system and human-machine collaborative regulation process are proposed.Key technologies are discussed to achieve a thorough integration of human/machine intelligence.Finally,state-of-theart and future development of HHI in power grid regulation are summarized,aiming to efficiently improve the intelligent level of power grid regulation in a human-machine interactive and collaborative way.

Magnetic Array Assisted Triboelectric Nanogenerator Sensor for Real‑Time Gesture Interaction

In human-machine interaction,robotic hands are useful in many scenarios.To operate robotic hands via gestures instead of handles will greatly improve the convenience and intuition of human-machine interaction.Here,we present a magnetic array assisted sliding triboelectric sensor for achieving a real-time gesture interaction between a human hand and robotic hand.With a finger’s traction movement of flexion or extension,the sensor can induce positive/negative pulse signals.Through counting the pulses in unit time,the degree,speed,and direction of finger motion can be judged in realtime.The magnetic array plays an important role in generating the quantifiable pulses.The designed two parts of magnetic array can transform sliding motion into contact-separation and constrain the sliding pathway,respectively,thus improve the durability,low speed signal amplitude,and stability of the system.This direct quantization approach and optimization of wearable gesture sensor provide a new strategy for achieving a natural,intuitive,and real-time human-robotic interaction.

Human Interaction Dynamics for Its Use in Mobile Robotics:Impedance Control for Leader-follower Formation

A complete characterization of the behavior in human-robot interactions(HRI) includes both: the behavioral dynamics and the control laws that characterize how the behavior is regulated with the perception data. In this way, this work proposes a leader-follower coordinate control based on an impedance control that allows to establish a dynamic relation between social forces and motion error. For this, a scheme is presented to identify the impedance based on fictitious social forces, which are described by distance-based potential fields.As part of the validation procedure, we present an experimental comparison to select the better of two different fictitious force structures. The criteria are determined by two qualities: least impedance errors during the validation procedure and least parameter variance during the recursive estimation procedure.Finally, with the best fictitious force and its identified impedance,an impedance control is designed for a mobile robot Pioneer 3AT,which is programmed to follow a human in a structured scenario.According to results, and under the hypothesis that moving like humans will be acceptable by humans, it is believed that the proposed control improves the social acceptance of the robot for this kind of interaction.

A Survey of Human-centered Intelligent Robots:Issues and Challenges

Intelligent techniques foster the dissemination of new discoveries and novel technologies that advance the ability of robots to assist and support humans. The human-centered intelligent robot has become an important research field that spans all of the robot capabilities including navigation, intelligent control, pattern recognition and human-robot interaction. This paper focuses on the recent achievements and presents a survey of existing works on human-centered robots. Furthermore, we provide a comprehensive survey of the recent development of the human-centered intelligent robot and discuss the issues and challenges in the field.