Risk identification and safety assessment of human-computer interaction in integrated avionics based on STAMP

To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.

Identification and distribution of 13003 landslides in the northwest margin of Qinghai-Tibet Plateau based on human-computer interaction remote sensing interpretation

The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remains insufficiently explored concerning landslide occurrence and dispersion.With the planning and construction of the Xinjiang-Tibet Railway,a comprehensive investigation into disastrous landslides in this area is essential for effective disaster preparedness and mitigation strategies.By using the human-computer interaction interpretation approach,the authors established a landslide database encompassing 13003 landslides,collectively spanning an area of 3351.24 km^(2)(36°N-40°N,73°E-78°E).The database incorporates diverse topographical and environmental parameters,including regional elevation,slope angle,slope aspect,distance to faults,distance to roads,distance to rivers,annual precipitation,and stratum.The statistical characteristics of number and area of landslides,landslide number density(LND),and landslide area percentage(LAP)are analyzed.The authors found that a predominant concentration of landslide origins within high slope angle regions,with the highest incidence observed in intervals characterised by average slopes of 20°to 30°,maximum slope angle above 80°,along with orientations towards the north(N),northeast(NE),and southwest(SW).Additionally,elevations above 4.5 km,distance to rivers below 1 km,rainfall between 20-30 mm and 30-40 mm emerge as particularly susceptible to landslide development.The study area’s geological composition primarily comprises Mesozoic and Upper Paleozoic outcrops.Both fault and human engineering activities have different degrees of influence on landslide development.Furthermore,the significance of the landslide database,the relationship between landslide distribution and environmental factors,and the geometric and morphological characteristics of landslides are discussed.The landslide H/L ratios in the study area are mainly concentrated between 0.4 and 0.64.It means the landslides mobility in the region is relatively low,and the authors speculate that landslides in this region more possibly triggered by earthquakes or located in meizoseismal area.

Reform of Human-Computer Interaction Course based on Mobile Application Interaction Design

With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-Computer Interaction(HCI)course and teaching material is out of date,it cannot meet the needs of mobile application interaction design and enterprises for students.Therefore,we need a new generation HCI course based on intelligent mobile devices to study the relationship between users and systems.The HCI course not only teaches students HCI theory and model,but also needs to cultivate students’interaction-oriented design practical ability.This paper proposes a set of HCI teaching material design and teaching methods for improving HCI class quality on mobile application interaction design,so as to make students more suitable for the employment requirements of enterprises.

Design and Implementation of the Image Interactive System Based on Human-Computer Interaction

Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide users more experience. In the article, a new way of detecting moving things is given on the basis of development of the image processing technique. The system architecture decides that the communication should be used between two different applications. After considered, named pipe is selected from many ways of communication to make sure that video is keeping in step with the movement from the analysis of the people moving. According to a large amount of data and principal knowledge, thinking of the need of actual project, a detailed system design and realization is finished. The system consists of three important modules: detecting of the people's movement, information transition between applications and video showing in step with people's movement. The article introduces the idea of each module and technique.

Dynamic constraint and objective generation approach for real-time train rescheduling model under human-computer interaction

Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates constraints and objectives generated through human-computer interaction.This approach ensures that the model is aligned with practical requirements and daily operational tasks while facilitating iterative train rescheduling.The dispatcher’s empirical knowledge is integrated into the train rescheduling process using a human-computer interaction framework.We introduce six interfaces to dynamically construct constraints and objectives that capture human intentions.By summarizing rescheduling rules,we devise a rule-based conflict detection-resolution heuristic algorithm to effectively solve the formulated model.A series of numerical experiments are presented,demonstrating strong performance across the entire system.Furthermore,theflexibility of rescheduling is enhanced through secondary analysis-driven solutions derived from the outcomes of humancomputer interactions in the previous step.This proposed interaction method complements existing literature on rescheduling methods involving human-computer interactions.It serves as a tool to aid dispatchers in identifying more feasible solutions in accordance with their empirical rescheduling strategies.

Advances in applying somatosensory interaction technology in geriatric care:A bibliometric analysis

Objectives:Somatosensory Interaction Technology(SIT)is used in various aspects of geriatric care.We aimed to conduct a bibliometric analysis to summarize relevant publications and visualize publication characteristics,current hotspots,and development trends,thereby inspiring subsequent researches.Methods:We searched theWeb of Science Core Collection database for publications on the application of SIT in geriatric care.Bibliometric visualization and clustering analysis were performed using VOSviewer V1.6.18 Software,while keywords burst detection analysis was conducted with CiteSpace 6.1.R6 Software.Results:After screening,a total of 1,019 publications were included.The number of publications on SIT in geriatric care is gradually increasing,exhibiting a rapid growth rate.The United States,Canada,and Australia led in terms of publication volume.Keyword clustering analysis identified major research hotspots:crisis warning,somatic abilities,rehabilitation training and psychosocial support.Initial studies primarily explored themes such as recovery,movement,systems,and later shifted towards gait analysis,muscle strength,parameters,and home-based care.More recently,research themes have evolved to dementia,machine learning,and gamification.Conclusions:SIT is innovative for promoting active aging,advancing intelligent healthcare,and elevating the daily quality of life for older adults in clinical and domestic settings.Applications of SIT can be categorized into early warning systems for crises,detailed analyses of physical conditions,rehabilitation enhancement,and support for psychosocial health.Research trends have transitioned from whole-body recognition to precise feedback,from a focus on physical health to mental health,and from technical feasibility to user-friendliness.Future research should focus on developing accessible and user-friendly devices,fostering interdisciplinary collaborations for innovation,expanding research to address both the physical and mental health needs of diverse older adults,and integrating emerging technologies to enhance data precision and accelerate the development of intelligent platforms.

Research on Visualization and Interactive Design of Plant Configuration Virtual Reality in the Context of Digitalization

This study aims to explore the application of digital technology in landscape design,focusing on the research of virtual reality visualization and interactive design in the process of plant configuration.Through an in-depth analysis of digital technology,the study outlines its important role in landscape design,especially in the application of plant configuration.The current application status of virtual reality technology in landscape design is discussed,as well as how interactive design can enhance user experience and participation.Furthermore,the achievements and challenges of digital technology in landscape design are summarized.Finally,it proposes future research directions and suggestions,aiming to provide new ideas and methods for practice and research in the field of landscape design and promote the further application and development of digital technology in landscape design.

Reasons for Calling Doctor： Visualizing Callers＇ Multi-unit Turns and Filming Television Call-ins as Institutional Interaction

This study describes discursive and visual features of telephone openings to a live broadcast television call-in program based on the analysis of the ＂multi-unit reason-for-the-call turn＂ （Couper-Kuhlen, 2001）. The data were based on video-recordings of the call-in program broadcast daily on Hakka channel in Taiwan, in which callers call to seek advice on health problems. The discourse analysis shows that callers＇ ＂multi-unit reason-for-the-call turns＂ can be classified into three forms including request, epistemic frame and descriptions of symptoms, and telling of lifestyle. The visual analysis demonstrates that the visual shots of ＂multi-unit reason-for-the-call turns＂ orient viewers to the studio scene in which the invited guest, usually the medical doctor, can be seen listening to callers＇ upcoming questions. Based on the analyses and an interview with the camera director of this television program, the discussion sheds light on how television production practices use callers＇ multi-unit turns as a resource for switching to the studio shot, which helps to build an image of the expert and his/her role and function in the advice-seeking program. In this sense, filming and television production practices rely on linguistic resources and the visualization of callers＇ multi-unit turns has meanings in the organization of studio interaction as ＂institutional interaction＂ （Drew ＆ Heritage, 1992）, being shaped by interactants＇ identities, roles, and tasks relevant for the specific institutional needs or purposes.

Research on the Development Trend of Art Design Patterns under the Perspectives of Interaction Design and Visual Reconstruction

In the paper, we conduct research on the development trend of art design patterns under the perspectives of interaction design and visual reconstruction. With the increasing of people’s living standard, people on the industrial product requirements are constantly increasing, industrial products have gradually become to meet people’s life comfortable, functional, aesthetic and cultural history of the pursuit of all kinds of needs and the carrier of many connotations it is because of these changes in art design. In this paper, we integrate the Bauhaus’ idea to construct the new idea of constructing the interaction design and visual reconstruction. To note here that includes both the facts to the reality of the fact that also includes the artistic truth, or “virtual reality experience such as writer”, sequence of works of art, etc., and the former is an artist biography, the object of art history. With these basis and references, we propose the new idea on the issues. The result is satisfactory.

Three-dimensional visualization interactive system for digital twin workshop

To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of the 3D visualization interactive system for digital twin workshops is proposed.As the traditional 5D digital twin model ignores the importance of human-computer interaction,a new dimension of the user terminal was added.A hierarchical real-time data-driven mapping model for the workshop production process is then proposed.Moreover,a real-time data acquisition method for the industrial Internet of things is proposed based on OPC UA(object linking and embedding for process control unified architecture).Based on the 6D model of the system,the process of creating a 3D visualization virtual environment based on virtual reality is introduced,in addition to a data-driven process based on the data management cloud platform.Finally,the 6D model of the system was confirmed using the blade rotor test workshop as the object,and a 3D visualization interactive system is developed.The results show that the system is more transparent,real-time,data-driven and more efficient,as well as promotes the coordination and integration of human-physical-virtual,which has practical significance for developing digital twin workshops.

Study on the characteristics of interaction flowfields induced by supersonic jet on a revolution body

The paper focuses on the triple jets interaction with a hypersonic external flow on a revolution body. The experimental model is a ogive-cylinder body with three supersonic nozzles, which are aligned along the flow direction. The freestream Mach numbers are 5 and 6. The spatial and surface flow characteristics are illustrated by the schlieren photographs and the typical pressure distribution. The results show that there are multi-wave system, separation, reattachment, multi-peak pressure, high-pressure and low-pressure zone boundaries obvious distinction in tri-jets interference flowfield. The present paper also analyzes how do the pressure ratio, the angle of attack, and Mach number effect on tri-jets interaction characteristics.

Virtual brain surgery simulation system based on haptic interaction

To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. Different soft tissues are modeled by changing the width, number of pieces, thickness, and length of a single plate spring. In this paper, the structural design, calcula- tion of soft tissue deformation and real-time feedback operations of our system are also introduced. To evaluate the feasibility of the system and validate the model, an experimental system of haptic in- teraction, in which users can use virtual hands to pull virtual brain tissues, is built using PHANTOM OMNI devices. Experimental results show that the proposed system is stable, accurate and promising for modeling instantaneous soft tissue deformation.

Web-based interactive visualization of 3D video mosaics using X3D standard

We present a method of 3D image mosaicing for real 3D representation of roadside buildings, and implement a Web-based interactive visualization environment for the 3D video mosaics created by 3D image mosaicing. The 3D image mo- saicing technique developed in our previous work is a very powerful method for creating textured 3D-GIS data without excessive data processing like the laser or stereo system. For the Web-based open access to the 3D video mosaics, we build an interactive visualization environment using X3D, the emerging standard of Web 3D. We conduct the data preprocessing for 3D video mosaics and the X3D modeling for textured 3D data. The data preprocessing includes the conversion of each frame of 3D video mosaics into concatenated image files that can be hyperlinked on the Web. The X3D modeling handles the representation of concatenated images using necessary X3D nodes. By employing X3D as the data format for 3D image mosaics, the real 3D representation of roadside buildings is extended to the Web and mobile service systems.

Graph-based method for human-object interactions detection

Human-object interaction(HOIs)detection is a new branch of visual relationship detection,which plays an important role in the field of image understanding.Because of the complexity and diversity of image content,the detection of HOIs is still an onerous challenge.Unlike most of the current works for HOIs detection which only rely on the pairwise information of a human and an object,we propose a graph-based HOIs detection method that models context and global structure information.Firstly,to better utilize the relations between humans and objects,the detected humans and objects are regarded as nodes to construct a fully connected undirected graph,and the graph is pruned to obtain an HOI graph that only preserving the edges connecting human and object nodes.Then,in order to obtain more robust features of human and object nodes,two different attention-based feature extraction networks are proposed,which model global and local contexts respectively.Finally,the graph attention network is introduced to pass messages between different nodes in the HOI graph iteratively,and detect the potential HOIs.Experiments on V-COCO and HICO-DET datasets verify the effectiveness of the proposed method,and show that it is superior to many existing methods.

Multi-View Multi-Modal Head-Gaze Estimation for Advanced Indoor User Interaction

Gaze estimation is one of the most promising technologies for supporting indoor monitoring and interaction systems.However,previous gaze estimation techniques generally work only in a controlled laboratory environment because they require a number of high-resolution eye images.This makes them unsuitable for welfare and healthcare facilities with the following challenging characteristics:1)users’continuous movements,2)various lighting conditions,and 3)a limited amount of available data.To address these issues,we introduce a multi-view multi-modal head-gaze estimation system that translates the user’s head orientation into the gaze direction.The proposed system captures the user using multiple cameras with depth and infrared modalities to train more robust gaze estimators under the aforementioned conditions.To this end,we implemented a deep learning pipeline that can handle different types and combinations of data.The proposed system was evaluated using the data collected from 10 volunteer participants to analyze how the use of single/multiple cameras and modalities affect the performance of head-gaze estimators.Through various experiments,we found that 1)an infrared-modality provides more useful features than a depth-modality,2)multi-view multi-modal approaches provide better accuracy than singleview single-modal approaches,and 3)the proposed estimators achieve a high inference efficiency that can be used in real-time applications.

Empathic Responses of Behavioral-Synchronization in Human-Agent Interaction

Artificial entities,such as virtual agents,have become more pervasive.Their long-term presence among humans requires the virtual agent’s ability to express appropriate emotions to elicit the necessary empathy from the users.Affective empathy involves behavioral mimicry,a synchronized co-movement between dyadic pairs.However,the characteristics of such synchrony between humans and virtual agents remain unclear in empathic interactions.Our study evaluates the participant’s behavioral synchronization when a virtual agent exhibits an emotional expression congruent with the emotional context through facial expressions,behavioral gestures,and voice.Participants viewed an emotion-eliciting video stimulus(negative or positive)with a virtual agent.The participants then conversed with the virtual agent about the video,such as how the participant felt about the content.The virtual agent expressed emotions congruent with the video or neutral emotion during the dialog.The participants’facial expressions,such as the facial expressive intensity and facial muscle movement,were measured during the dialog using a camera.The results showed the participants’significant behavioral synchronization(i.e.,cosine similarity≥.05)in both the negative and positive emotion conditions,evident in the participant’s facial mimicry with the virtual agent.Additionally,the participants’facial expressions,both movement and intensity,were significantly stronger in the emotional virtual agent than in the neutral virtual agent.In particular,we found that the facial muscle intensity of AU45(Blink)is an effective index to assess the participant’s synchronization that differs by the individual’s empathic capability(low,mid,high).Based on the results,we suggest an appraisal criterion to provide empirical conditions to validate empathic interaction based on the facial expression measures.

Design of space-centered interaction using invisible and intangible spatial inputs

In this paper,we investigate methodologies to improve direct-touch interaction on invisible and intangible spatial input.We firstly discuss about the motive of looking for a new input method for whole body interaction and how it can be meaningful.We also describe the role that can play spatial interaction to improve the freedom of interaction for a user.We propose a method of spatial centered interaction using invisible and intangible spatial inputs.However,given their lack of tactile feedback and visual representation,direct touch interaction on such input can be confused.In order to make a step toward understanding causes and solutions for such phenomena,we made 2 user experiments.In the first one,we test 5 setups of helper that provide information of the location of the input by constraining the dimension it is located at.The results show that using marker on the ground and a relationship with the height of the user’s body improve significantly the locative task.In the second experiment,we create a dancing game using invisible and intangible spatial inputs and we stress the results obtained in the first experiment within this cognitively demanding context.Results show that the same setup of helper is still providing very good results in that context.

Connecting Language with Perception and Action for Human-robot Interaction

To build robots that engage in intuitive communication with people by natural language, we are developing a new knowledge representation called conceptual network model. The conceptual network connects natural language concepts with visual perception including color perception, shape perception, size perception, and spatial perception. In the implementation of spatial perception, we present a computational model based on spatial template theory to interpret qualitative spatial expressions. Based on the conceptual network model, our mobile robot can understand user's instructions and recognize the object referred to by the user and perform appropriate action. Experimental results show our approach promising.

Interactive Visualization System of Taylor Vortex Flow Using Stokes' Stream Function

Taylor vortex flow between two concentric rotating cylinders with finite axial length includes various patterns of laminar and turbulent flows, and its behavior has attracted great interests. When mode bifurcation occurs, quantitative parameters such as the volume-averaged energy change rapidly. It is important to visualize the behaviors of vortices. In this study, a three-dimensional visualization system with respect to time is devised. This system can change the viewpoint of flow visualization, and we can observe the track of a vortex from any point. The volume-averaged energy is projected to the track of the center of a vortex. The proposed system can help to investigate the relationship between the mode bifurcation process and the volume-averaged energy.

A Robotic Teleoperation System for Precise Robotic Manipulation by Human-Machine Interaction

Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,a robotic teleoperation system for precise robotic manipulation is established.The data glove and the 7-degrees of freedom(DOFs)force feedback controller are used for the remote control interaction.The control system and the monitor system are designed for the remote precise manipulation.The monitor system contains an image acquisition system and a human-machine interaction module,and aims to simulate and detect the robot running state.Besides,a visual object tracking algorithm is developed to estimate the states of the dynamic system from noisy observations.The established robotic teleoperation systemis applied to a series of experiments,and high-precision results are obtained,showing the effectiveness of the physical system.