Risk identification and safety assessment of human-computer interaction in integrated avionics based on STAMP

To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.

Identification and distribution of 13003 landslides in the northwest margin of Qinghai-Tibet Plateau based on human-computer interaction remote sensing interpretation

The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remains insufficiently explored concerning landslide occurrence and dispersion.With the planning and construction of the Xinjiang-Tibet Railway,a comprehensive investigation into disastrous landslides in this area is essential for effective disaster preparedness and mitigation strategies.By using the human-computer interaction interpretation approach,the authors established a landslide database encompassing 13003 landslides,collectively spanning an area of 3351.24 km^(2)(36°N-40°N,73°E-78°E).The database incorporates diverse topographical and environmental parameters,including regional elevation,slope angle,slope aspect,distance to faults,distance to roads,distance to rivers,annual precipitation,and stratum.The statistical characteristics of number and area of landslides,landslide number density(LND),and landslide area percentage(LAP)are analyzed.The authors found that a predominant concentration of landslide origins within high slope angle regions,with the highest incidence observed in intervals characterised by average slopes of 20°to 30°,maximum slope angle above 80°,along with orientations towards the north(N),northeast(NE),and southwest(SW).Additionally,elevations above 4.5 km,distance to rivers below 1 km,rainfall between 20-30 mm and 30-40 mm emerge as particularly susceptible to landslide development.The study area’s geological composition primarily comprises Mesozoic and Upper Paleozoic outcrops.Both fault and human engineering activities have different degrees of influence on landslide development.Furthermore,the significance of the landslide database,the relationship between landslide distribution and environmental factors,and the geometric and morphological characteristics of landslides are discussed.The landslide H/L ratios in the study area are mainly concentrated between 0.4 and 0.64.It means the landslides mobility in the region is relatively low,and the authors speculate that landslides in this region more possibly triggered by earthquakes or located in meizoseismal area.

Reform of Human-Computer Interaction Course based on Mobile Application Interaction Design

With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-Computer Interaction(HCI)course and teaching material is out of date,it cannot meet the needs of mobile application interaction design and enterprises for students.Therefore,we need a new generation HCI course based on intelligent mobile devices to study the relationship between users and systems.The HCI course not only teaches students HCI theory and model,but also needs to cultivate students’interaction-oriented design practical ability.This paper proposes a set of HCI teaching material design and teaching methods for improving HCI class quality on mobile application interaction design,so as to make students more suitable for the employment requirements of enterprises.

Design and Implementation of the Image Interactive System Based on Human-Computer Interaction

Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide users more experience. In the article, a new way of detecting moving things is given on the basis of development of the image processing technique. The system architecture decides that the communication should be used between two different applications. After considered, named pipe is selected from many ways of communication to make sure that video is keeping in step with the movement from the analysis of the people moving. According to a large amount of data and principal knowledge, thinking of the need of actual project, a detailed system design and realization is finished. The system consists of three important modules: detecting of the people's movement, information transition between applications and video showing in step with people's movement. The article introduces the idea of each module and technique.

Dynamic constraint and objective generation approach for real-time train rescheduling model under human-computer interaction

Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates constraints and objectives generated through human-computer interaction.This approach ensures that the model is aligned with practical requirements and daily operational tasks while facilitating iterative train rescheduling.The dispatcher’s empirical knowledge is integrated into the train rescheduling process using a human-computer interaction framework.We introduce six interfaces to dynamically construct constraints and objectives that capture human intentions.By summarizing rescheduling rules,we devise a rule-based conflict detection-resolution heuristic algorithm to effectively solve the formulated model.A series of numerical experiments are presented,demonstrating strong performance across the entire system.Furthermore,theflexibility of rescheduling is enhanced through secondary analysis-driven solutions derived from the outcomes of humancomputer interactions in the previous step.This proposed interaction method complements existing literature on rescheduling methods involving human-computer interactions.It serves as a tool to aid dispatchers in identifying more feasible solutions in accordance with their empirical rescheduling strategies.

A SEMI-ANALYTICAL AND SEMI-NUMERICAL METHOD FOR SOLVING 2-D SOUND-STRUCTURE INTERACTION PROBLEMS

Based on the transfer matrix method and the virtual source simulation technique, this paper proposes a novel semi-analytical and semi-numerical method for solving 2-D sound- structure interaction problems under a harmonic excitation.Within any integration segment, as long as its length is small enough,along the circumferential curvilinear coordinate,the non- homogeneous matrix differential equation of an elastic ring of complex geometrical shape can be rewritten in terms of the homogeneous one by the method of extended homogeneous capacity proposed in this paper.For the exterior fluid domain,the multi-circular virtual source simulation technique is adopted.The source density distributed on each virtual circular curve may be ex- panded as the Fourier's series.Combining with the inverse fast Fourier transformation,a higher accuracy and efficiency method for solving 2-D exterior Helmholtz's problems is presented in this paper.In the aspect of solution to the coupling equations,the state vectors of elastic ring induced by the given harmonic excitation and generalized forces of coefficients of the Fourier series can be obtained respectively by using a high precision integration scheme combined with the method of extended homogeneous capacity put forward in this paper.According to the superposition princi- ple and compatibility conditions at the interface between the elastic ring and fluid,the algebraic equation of system can be directly constructed by using the least square approximation.Examples of acoustic radiation from two typical fluid-loaded elastic rings under a harmonic concentrated force are presented.Numerical results show that the method proposed is more efficient than the mixed FE-BE method in common use.

An Efficient Tide-Surge Interaction Model for the Coast of Bangladesh

The numerical method of lines(MOLs)in coordination with the classical fourth-order Runge Kutta(RK(4,4))method is used to solve shallow water equations(SWEs)for foreseeing water levels owing to the nonlinear interaction of tide and surge accompanying with a storm along the coast of Bangladesh.The SWEs are developed by extending the body forces with tide generating forces(TGFs).Spatial variables of the SWEs along with the boundary conditions are approximated by means of finite difference technique on an Arakawa C-grid to attain a system of ordinary differential equations(ODEs)of initial valued in time,which are being solved with the aid of the RK(4,4)method.Nested grid technique is adopted to solve coastal complexities closely with least computational cost.A stable tidal solution in the region of our choice is produced by applying the tidal forcing with the major tidal constituent M2(lunar semi-diurnal)along the southern open-sea boundary of the outer scheme.Numerical experimentations are carried out to simulate water levels generated by the cyclonic storm AILA along the coast of Bangladesh.The model simulated results are found to be in a reasonable agreement with the limited available reported data and observations.

A 3D Geological Model Constrained by Gravity and Magnetic Inversion and its Exploration Implications for the World-class Zhuxi Tungsten Deposit, South China

The Zhuxi tungsten deposit in Jiangxi Province,South China,contains a total W reserve of about 2.86 Mt at an average grade of 0.54 wt%WO3,representing the largest W deposit in the world.Numerous studies on the metallogeny of the deposit have included its timing,the ore-controlling structures and sedimentary host rocks and their implications for mineral exploration.However,the deep nappe structural style of Taqian-Fuchun metallogenic belt that hosts the W deposit,and the spatial shape and scale of deeply concealed intrusions and their sedimentary host rocks are still poorly defined,which seriously restricts the discovery of new deposits at depth and in surrounding areas of the W deposit.Modern 3 D geological modeling is an important tool for the exploration of concealed orebodies,especially in brownfield environments.There are obvious density contrast and weak magnetic contrast in the ore-controlling strata and granite at the periphery of the deposit,which lays a physical foundation for solving the 3 D spatial problems of the ore-controlling geological body in the deep part of the study area through gravity and magnetic modeling.Gravity data(1:50000)and aeromagnetic data(1:50000)from the latest geophysical surveys of 2016-2018 have been used,firstly,to carry out a potential field separation to obtain residual anomalies for gravity and magnetic interactive inversion.Then,on the basis of the analysis of the relationship between physical properties and lithology,under the constraints of surface geology and borehole data,human-computer interactive gravity and magnetic inversion for 18 cross-sections were completed.Finally,the 3 D geological model of the Zhuxi tungsten deposit and its periphery have been established through these 18 sections,and the spatial shape of the intrusions and strata with a depth of 5 km underground were obtained,initially realizing―transparency‖for ore-controlling bodies.According the analysis of the geophysical,geochemical,and geological characteristics of the Zhuxi tungsten deposit,we discern three principles for prospecting and prediction in the research area,and propose five new exploration targets in its periphery.

Virtual brain surgery simulation system based on haptic interaction

To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. Different soft tissues are modeled by changing the width, number of pieces, thickness, and length of a single plate spring. In this paper, the structural design, calcula- tion of soft tissue deformation and real-time feedback operations of our system are also introduced. To evaluate the feasibility of the system and validate the model, an experimental system of haptic in- teraction, in which users can use virtual hands to pull virtual brain tissues, is built using PHANTOM OMNI devices. Experimental results show that the proposed system is stable, accurate and promising for modeling instantaneous soft tissue deformation.

Real-time forward modeling and inversion of logging-while-drilling electromagnetic measurements in horizontal wells

Based on the pseudo-analytical equation of electromagnetic log for layered formation,an optimal boundary match method is proposed to adaptively truncate the encountered formation structures.An efficient integral method is put forward to significantly accelerate the convergence of Sommerfeld integral.By asymptotically approximating and subtracting the first reflection/transmission waves from the scattered field,the new Sommerfeld integral method has addressed difficulties encountered by the traditional digital filtering method,such as low computational precision and limited operating range,and realized the acceleration of the computation speed of logging-while-drilling electromagnetic measurements(LWD EM).By making use of the priori information from the offset/pilot wells and interactively adjusting the formation model,the optimum initial guesses of the inversion model is determined in order to predict the nearby formation boundaries.The gradient optimization algorithm is developed and an interactive inversion system for the LWD EM data from the horizontal wells is established.The inverted results of field data demonstrated that the real-time interactive inversion method is capable of providing the accurate boundaries of layers around the wellbore from the LWD EM,and it will benefit the wellbore trajectory optimization and reservoir interpretation.

Multi-View Multi-Modal Head-Gaze Estimation for Advanced Indoor User Interaction

Gaze estimation is one of the most promising technologies for supporting indoor monitoring and interaction systems.However,previous gaze estimation techniques generally work only in a controlled laboratory environment because they require a number of high-resolution eye images.This makes them unsuitable for welfare and healthcare facilities with the following challenging characteristics:1)users’continuous movements,2)various lighting conditions,and 3)a limited amount of available data.To address these issues,we introduce a multi-view multi-modal head-gaze estimation system that translates the user’s head orientation into the gaze direction.The proposed system captures the user using multiple cameras with depth and infrared modalities to train more robust gaze estimators under the aforementioned conditions.To this end,we implemented a deep learning pipeline that can handle different types and combinations of data.The proposed system was evaluated using the data collected from 10 volunteer participants to analyze how the use of single/multiple cameras and modalities affect the performance of head-gaze estimators.Through various experiments,we found that 1)an infrared-modality provides more useful features than a depth-modality,2)multi-view multi-modal approaches provide better accuracy than singleview single-modal approaches,and 3)the proposed estimators achieve a high inference efficiency that can be used in real-time applications.

Empathic Responses of Behavioral-Synchronization in Human-Agent Interaction

Artificial entities,such as virtual agents,have become more pervasive.Their long-term presence among humans requires the virtual agent’s ability to express appropriate emotions to elicit the necessary empathy from the users.Affective empathy involves behavioral mimicry,a synchronized co-movement between dyadic pairs.However,the characteristics of such synchrony between humans and virtual agents remain unclear in empathic interactions.Our study evaluates the participant’s behavioral synchronization when a virtual agent exhibits an emotional expression congruent with the emotional context through facial expressions,behavioral gestures,and voice.Participants viewed an emotion-eliciting video stimulus(negative or positive)with a virtual agent.The participants then conversed with the virtual agent about the video,such as how the participant felt about the content.The virtual agent expressed emotions congruent with the video or neutral emotion during the dialog.The participants’facial expressions,such as the facial expressive intensity and facial muscle movement,were measured during the dialog using a camera.The results showed the participants’significant behavioral synchronization(i.e.,cosine similarity≥.05)in both the negative and positive emotion conditions,evident in the participant’s facial mimicry with the virtual agent.Additionally,the participants’facial expressions,both movement and intensity,were significantly stronger in the emotional virtual agent than in the neutral virtual agent.In particular,we found that the facial muscle intensity of AU45(Blink)is an effective index to assess the participant’s synchronization that differs by the individual’s empathic capability(low,mid,high).Based on the results,we suggest an appraisal criterion to provide empirical conditions to validate empathic interaction based on the facial expression measures.

Design of space-centered interaction using invisible and intangible spatial inputs

In this paper,we investigate methodologies to improve direct-touch interaction on invisible and intangible spatial input.We firstly discuss about the motive of looking for a new input method for whole body interaction and how it can be meaningful.We also describe the role that can play spatial interaction to improve the freedom of interaction for a user.We propose a method of spatial centered interaction using invisible and intangible spatial inputs.However,given their lack of tactile feedback and visual representation,direct touch interaction on such input can be confused.In order to make a step toward understanding causes and solutions for such phenomena,we made 2 user experiments.In the first one,we test 5 setups of helper that provide information of the location of the input by constraining the dimension it is located at.The results show that using marker on the ground and a relationship with the height of the user’s body improve significantly the locative task.In the second experiment,we create a dancing game using invisible and intangible spatial inputs and we stress the results obtained in the first experiment within this cognitively demanding context.Results show that the same setup of helper is still providing very good results in that context.

Research on the interaction design of somatosensory games——With the original game ＂Dream＂ in the center

The emergence of the somatosensory interactive technology has changed the ways of the interaction between the users and the computers, so that people can control the computers more freely. This paper focuses on the interactive design of the somatosensory games, and combines the Kinect interactive devices with the popular Unity 3D game engines, and analyzes and designs the realization principles of the somatosensory games, the somatosensory games and the digital somatosensory interactive display. Through the design and production of the original game ＂Dream＂, the author discusses the design methods of the game interactive experience while abandoning the traditional human-comouter interactive mode.

Using Social Interaction to Invert the Professional Competencies of Future Architects

The article analyzes the results of a sociological study of the role of public and interdisciplinary communications for formation and inversion of architect’s competences.The study was carried out in 2021-2022 among students of architecture departments in Russia.About 3,000 students of the Moscow Architectural Institute(State Academy)and the Orel State University took part in the study.As a result of processing the data of the written questionnaire with correlation relationships,the potential of“external”educational communications was identified for acquisition of new professional knowledge and competencies in architecture;popularization of socially important ideas in architecture and spatial development;raising a sense of pride and respect for urban historical and cultural heritage;enhancing the prestige of the architectural profession and the status of architectural education;understanding social expectations of architectural activities and factors limiting implementation of projects;identifying factors influencing formation of strategies for the development of architectural education.Four stages of formation and inversion of professional competences in the educational process were singled out:1st-2nd years of training-an“orientation period”;3rd-4th years-the level of Bachelor of Science in Architecture,at which the groundwork of the professional thinking basics is laid-a stage of mastering the basic system-design skills;5th year(diploma thesis)-a stage of entry into creative practice;training at the level of Master of Science in Architecture-scientific-design practice in architecture.Issues concerning underrating the importance of future architects’involvement in joint activities with community and engineering professions representatives to realize the goals of sustainable development were identified;late awareness of the value of participation in volunteer programs.

Woven fabric triboelectric nanogenerators for human-computer interaction and physical health monitoring

Triboelectric nanogenerator(TENG)converts mechanical energy into valuable electrical energy,offering a solution for future energy needs.As an indispensable part of TENG,textile TENG(T-TENG)has incredible advantages in harvesting biomechanical energy and physiological signal monitoring.However,the application of T-TENG is restricted,partly because the fabric structure parameter and structure on T-TENG performance have not been fully exploited.This study comprehensively investigates the effect of weaving structure on fabric TENGs(F-TENGs)for direct-weaving yarn TENGs and post-coating fabric TENGs.For direct-weaving F-TENGs,a single-yarn TENG(Y-TENG)with a core-sheath structure is fabricated using conductive yarn as the core layer yarn and polytetrafluoroethylene(PTFE)filaments as the sheath yarn.Twelve fabrics with five different sets of parameters were designed and investigated.For post-coating F-TENGs,fabrics with weaving structures of plain,twill,satin,and reinforced twill were fabricated and coated with conductive silver paint.Overall,the twill F-TENGs have the best electrical outputs,followed by the satin F-TENGs and plain weave F-TENGs.Besides,the increase of the Y-TENG gap spacing was demonstrated to improve the electrical output performance.Moreover,T-TENGs are demonstrated for human-computer interaction and self-powered real-time monitoring.This systematic work provides guidance for the future T-TENG’s design.

Mixed Reality-based Interactive Technology for Aircraft Cabin Assembly

Due to the narrowness of space and the complexity of structure, the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process. To solve the problem, at the beginning of aircraft design, the different stages of the lifecycle of aircraft must be thought about, which include the trial manufacture, assembly, maintenance, recycling and destruction of the product. Recently, thanks to the development of the virtual reality and augmented reality, some low-cost and fast solutions are found for the product assembly. This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly, which can enhance the efficiency of the assemblage in a virtual environment in terms of vision, information and operation. In the mixed reality-based assembly environment, the physical scene can be obtained by a camera and then generated by a computer. The virtual parts, the features of visual assembly, the navigation information, the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene. The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment. Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts, and to avoid the complex calculation of constraint＇s match. Finally, a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.

Calculation of circulation in the South China Sea during summer of 2000 by the modified inverse method

On the basis of hydrographic data obtained in August 2000 cruise, the circulation in the South China Sea (SCS) is computed by the modified inverse method in combination with SSH data from TOPEX/ERS-2 analysis. For study of the dynamical mechanism, which causes the pattern of summer circulation in the SCS, the diagnostic model (Yuan et al. 1982. Acta Oceanologica Sinica,4(1):1-11; Yuan and Su. 1992. Numerical Computation of Physical Oceanography.474-542) is used to simulate numerically the summer circulation in the SCS. The following results have been obtained. (1) The central and southwestern SCSs are dominated mainly by anticy-clonic circulation systems. They are mainly as follows. 1) There is strong anticyclonic eddy southeast of Vietnam (W1). Its horizontal scale is about 300 km, and it extends vertically from the surface to the about 1 000 m level. 2) There are a warm eddy W2 southeast of Zhongsha Islands and the anticyclonic circulation system W3 west off the Luzon Island. 3) There is a stronger cyclonic eddy C1 between the anticyclonic eddies W1 and W2.4) A strong northward coastal jet is present near the coast of Vietnam, and separates from the coast of Vietnam at about 12° N to the northeast.(2)The northern SCS is dominated mainly by a cyclonic circulation system. There is a cyclonic circulation system near and north of Section N2. (3) The southeastern SCS is dominated mainly by the cyclonic circulation system. (4) Comparing the results of circulation in the SCS during the summer of 2000 with those during the summer of 1998, it is found that they agree qualitatively, but there is the some difference between them in quantity.This shows that the circulation in the SCS has obviously seasonal feature. (5) The dynamical mechanism which products the basic pattern of summer circulation is because the following two reasons: 1) the joint effect of the baroclinity and relief (JEBAR) is essential dynamical cause; and 2) it is next important dynamical cause that the interaction between the wind stress and bottom topography under the southerly monsoon. (6) Comparing the hydrographic structure and distribution of stream functions with the SSH data from TOPEX/ERS-2 analysis in the SCS during August of 2000, they agree qualitatively.

Three-dimensional visualization interactive system for digital twin workshop

To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of the 3D visualization interactive system for digital twin workshops is proposed.As the traditional 5D digital twin model ignores the importance of human-computer interaction,a new dimension of the user terminal was added.A hierarchical real-time data-driven mapping model for the workshop production process is then proposed.Moreover,a real-time data acquisition method for the industrial Internet of things is proposed based on OPC UA(object linking and embedding for process control unified architecture).Based on the 6D model of the system,the process of creating a 3D visualization virtual environment based on virtual reality is introduced,in addition to a data-driven process based on the data management cloud platform.Finally,the 6D model of the system was confirmed using the blade rotor test workshop as the object,and a 3D visualization interactive system is developed.The results show that the system is more transparent,real-time,data-driven and more efficient,as well as promotes the coordination and integration of human-physical-virtual,which has practical significance for developing digital twin workshops.

Vision-Based Hand Gesture Recognition for Human-Computer Interaction——A Survey

Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.