Risk identification and safety assessment of human-computer interaction in integrated avionics based on STAMP

To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.

RFHUI:an RFID based human-unmanned aerial vehicle interaction system in an indoor environment

In this paper,we present an RFID based human and Unmanned Aerial Vehicle(UAV)Interaction system,termed RFHUI,to provide an intuitive and easy-to-operate method to navigate a UAV in an indoor environment.It relies on the passive Radio-Frequency IDentification(RFID)technology to precisely track the pose of a handheld controller,and then transfer the pose information to navigate the UAV.A prototype of the handheld controller is created by attaching three or more Ultra High Frequency(UHF)RFID tags to a board.A Commercial Off-The-Shelf(COTS)RFID reader with multiple antennas is deployed to collect the observations of the tags.First,the precise positions of all the tags can be obtained by our proposed method,which leverages a Bayesian filter and Channel State Information(CSI)phase measurements collected from the RFID reader.Second,we introduce a Singular Value Decomposition(SVD)based approach to obtain a 6-DoF(Degrees of Freedom)pose of the controller from estimated positions of the tags.Furthermore,the pose of the controller can be precisely tracked in a real-time manner,while the user moves the controller.Finally,control commands will be generated from the controller's pose and sent to the UAV for navigation.The performance of the RFHUI is evaluated by several experiments.The results show that it provides precise poses with 0.045m mean error in position and 2.5∘mean error in orientation for the controller,and enables the controller to precisely and intuitively navigate the UAV in an indoor environment.

Design of space-centered interaction using invisible and intangible spatial inputs

In this paper,we investigate methodologies to improve direct-touch interaction on invisible and intangible spatial input.We firstly discuss about the motive of looking for a new input method for whole body interaction and how it can be meaningful.We also describe the role that can play spatial interaction to improve the freedom of interaction for a user.We propose a method of spatial centered interaction using invisible and intangible spatial inputs.However,given their lack of tactile feedback and visual representation,direct touch interaction on such input can be confused.In order to make a step toward understanding causes and solutions for such phenomena,we made 2 user experiments.In the first one,we test 5 setups of helper that provide information of the location of the input by constraining the dimension it is located at.The results show that using marker on the ground and a relationship with the height of the user’s body improve significantly the locative task.In the second experiment,we create a dancing game using invisible and intangible spatial inputs and we stress the results obtained in the first experiment within this cognitively demanding context.Results show that the same setup of helper is still providing very good results in that context.

一种投影-摄像机交互系统中的全自动快速标定方法

针对目前应用于大尺度投影-摄像机交互系统中的手动标定方法标定点数量少、误差大、耗时长、操作专业程度高等不足,提出了一种准确快速的全自动标定方法。该方法采用机械可切换拍摄波长摄像机采集投影图像上划分的多区域顶点,在交互过程中通过计算投影图像与摄像机图像每个点的线性对应关系计算交互点在投影图像上的实际位置。所提出的方法采用的逐点计算方法自动消除了大尺度光学器件带来的不可修正系统误差,该方法不仅提高了交互系统的精确度、同时减少了系统安装的复杂度,增强了了交互系统的通用性。

科学教育测评中人机交互试题的发展、特征与启示

面对科学教育测评中素养和能力考查的新要求,传统测评工具的短板愈发明显。在信息技术快速发展的背景下,人机交互试题在科学教育测评领域得到广泛应用,成为备受关注的新型测评工具。相较于传统的书面试题,人机交互试题已具有明显的动态特征,表现在设问呈现方式、试题模拟环境和考查过程三个方面。将人机交互试题引入我国科学教育大型考试,不仅能够弥补传统测评工具的短板,更有助于科学教育智慧考试的开发与应用。

基于脉冲电永磁技术的吊具智能控制系统

针对电磁型吊具磁吸盘能耗高、寿命短、自重大、安全系数低、占用空间大,以及永磁型吊具存在自动化程度差、适用范围窄等缺点,研发了一款基于脉冲电永磁技术的吊智具能控制系统。基于PLC开发平台,设计了触底检测功能、自动称重功能、电流检测功能,与脉冲电永磁的磁力控制功能相结合,最终实现了吊具智能控制的效果,实验结果表明该设计既具有电磁型吊具磁力可控、操作方便,又具有永磁型吊具节能、安全环保的特点,具有广阔的发展前景和巨大的经济效益。

一种基于设计模式的GIS HCI复用框架

基于特征数据模型的GIS软件开发是一个重要方向。这就需要建立符合其特征的软件平台,以提高开发效率,减少重复应用。该文从软件框架的角度,利用设计模式分析了特征模型的软件结构,提出了GIS HCI框架,并进行了分析。

YSU-Ⅱ下肢康复机器人智能交互系统的设计与实现

传统人机交互方式如鼠标、键盘、屏幕点触式已广泛应用于康复机器人系统,其存在按键繁多、操作复杂等问题。针对YSU-I坐卧式多关节下肢康复机器人设计了YSU-II智能交互系统。该系统以语音交互为主,用户可通过多控制参数语音指令设置康复任务。此外,为该系统设计了表单输入功能作为辅助输入方式,提高了系统的实用性。本文先给出YSU-II智能交互系统结构和交互指令。然后,分别概括分析相关语音技术和表单识别方法的实现步骤。实验结果表明,YSU-II智能交互系统对语音和表单均有较高的识别率,系统响应时间满足用户的使用需求,用户可通过该系统准确设定康复任务。该系统降低了用户对下肢康复机器人的使用门槛和用户学习时间,满足了与康复机器人智能交互的需求。

VR技术在核电厂HCI设计和评价中的应用研究

虚拟现实(VR)技术作为新一代人机交互技术,为核电厂(NPP)人机交互(HCI)设计和评价提供了一种全新的技术手段。利用VR技术,可以有效解决传统HCI设计和评价中的症结问题。通过分析VR技术特点,结合核电厂HCI设计和评价传统方法中存在的问题,提出了VR在HCI设计和评价应用中的四项功能需求:3D可视化沉浸式设计、人因工程设计验证、虚拟仿真评价、培训教学。重点介绍了虚拟人机交互设计和评价系统研发实施过程,阐述了系统研发的技术路线、平台架构和功能分解,并对该系统的研发成果和应用方向作了简要分析。VR技术在核电厂HCI设计和评价中的应用,可以有效解决传统设计和评价方法中的症结问题,实现HCI设计和评价一体化,提升HCI设计质量和设计效率,提高人因可靠性。

Exploiting User Centered Design Approach and Interactivity in Web Based Software Developing

Human computer interaction (HCI) and software engineering approaches are always taken into the account together in order to make the well-organized software. Interactive design is the significant part of new media which has been proposed to the world for the past decades, and it is a very proficient technique. Interactive maps add more dimensions of information;they become a more and more helpful tools and resources. This research clarifies the idea of how we can smooth the progress of presenting and communicating the essential information using interactive manner. The interactive map of Bangkok underground train and sky train navigation routes map was developed as the case study using user-centered design (UCD) methodology as the fundamental developing processes. The main objective of the work is to develop the friendly and usable web based software that reduce the confusion and help users save times. The software developing processes in this work tend to focus on the users. And also the essential idea of the research is to take the uses and gratification communication theory of the users into account with the intention of providing what user requires by finding the real users’ requirements. This means the user can control software according to their needs and software act or response according to user’s requests. The paper mentions the role of communication theory, human computer interaction, and user-centered design software developing.

从知识劳工到救世主:科幻电影中的程序员想象

程序员既是由以计算机为标志的信息革命所催生的社会角色,又是为上述革命推波助澜的社会群体。他们不仅在现实生活中发挥重大作用,而且成为科幻电影里叱咤风云的主人公。其角色定位存在显著差异(从为谋生计的知识劳工直到力挽狂澜的救世主),这反映了创意阶层的可塑性与流动性。对于相关影片中的程序员想象,可以着眼于信息革命考察其经济定位、政治定位和文化定位,着眼于人机交互考察其认识过程、情感过程与意志过程,着眼于人际交互考察他们与雇主、同行、客户的关系。上述想象不仅丰富了人们对于信息革命历史与现状的认识,而且有助于把握人类社会的未来发展趋势。

A Robust Approach for Detection and Classification of KOA Based on BILSTM Network

A considerable portion of the population now experiences osteoarthritis of the knee,spine,and hip due to lifestyle changes.Therefore,early treatment,recognition and prevention are essential to reduce damage;nevertheless,this time-consuming activity necessitates a variety of tests and in-depth analysis by physicians.To overcome the existing challenges in the early detection of Knee Osteoarthritis(KOA),an effective automated technique,prompt recognition,and correct categorization are required.This work suggests a method based on an improved deep learning algorithm that makes use of data from the knee images after segmentation to detect KOA and its severity using the Kellgren-Lawrence(KL) classification schemes,such as Class-I,Class-II,Class-III,and Class-IV.Utilizing ResNet to segregate knee pictures,we first collected features from these images before using the Bidirectional Long Short-Term Memory(BiLSTM)architecture to classify them.Given that the technique is a pre-trained network and doesn’t require a large training set,the Mendeley VI dataset has been utilized for the training of the proposed model.To evaluate the effectiveness of the suggested model,cross-validation has also been employed using the Osteoarthritis Initiative(OAI)dataset.Furthermore,our suggested technique is more resilient,which overcomes the challenge of imbalanced training data due to the hybrid architecture of our proposed model.The suggested algorithm is a cuttingedge and successful method for documenting the successful application of the timely identification and severity categorization of KOA.The algorithm showed a cross-validation accuracy of 78.57%and a testing accuracy of 84.09%.Numerous tests have been conducted to show that our suggested algorithm is more reliable and capable than the state-of-the-art at identifying and categorizing KOA disease.

A survey of immersive visualization:Focus on perception and interaction

Immersive visualization utilizes virtual reality,mixed reality devices,and other interactive devices to create a novel visual environment that integrates multimodal perception and interaction.This technology has been maturing in recent years and has found broad applications in various fields.Based on the latest research advancements in visualization,this paper summarizes the state-of-theart work in immersive visualization from the perspectives of multimodal perception and interaction in immersive environments,additionally discusses the current hardware foundations of immersive setups.By examining the design patterns and research approaches of previous immersive methods,the paper reveals the design factors for multimodal perception and interaction in current immersive environments.Furthermore,the challenges and development trends of immersive multimodal perception and interaction techniques are discussed,and potential areas of growth in immersive visualization design directions are explored.

一种模型驱动的交互式信息可视化开发方法

设计与实现面向领域应用的交互式信息可视化软件十分困难.缺乏统一的开发方法与支撑工具箱,为非专家用户提供对层次、网络、多维等数据类型的统一支持,对各种可视化技术与交互技术的统一支持,以及对信息可视化任务的统一支持针对此问题,提出了一种模型驱动的交互式信息可视化开发方法Daisy.首先,提出了交互式信息可视化界面模型IIVM(interactive information visualization interface model);然后,提出了基于IIVM的交互式信息可视化开发方法Daisy,讨论了该方法的两个核心技术:IIVM建模与描述文件生成方法、系统自动生成方法.同时。给出了Daisy工具箱,包括Daisy建模工具、Daisy系统自动生成工具以及运行时框架与组件库.最后,给出了该开发方法与工具箱的应用实例.实例表明,该方法能够为交互式信息可视化开发的统一支撑方法问题提供一种有效的解决方案.

普适计算模式下的人机交互

普适计算使得信息空间与人们生活的物理空间相融合,与此相应人机接口也将随之扩展到人们生活工作的整个三维物理空间．因此需要研究物理空间中的人机交互方式．在传统的计算模式下,交互环境的物理因素不影响人机交互．而在普适计算的模式下,用户和环境的物理因素将成为交互的重要因素,这将使人机交互的性质产生一系列的变化,其中包括:人机交互本质上是与信息空间的交互;交互接口扩展到日常生活的用品和环境;动态的人机交互上下文;蕴含人机交互．

一种基于Leap Motion的直观体交互技术

Leap Motion系统可高精度实时检测并跟踪手掌、手指的位置和速度等信息,为大屏幕、远距离体交互提供有效途径。通过观察用户手势远距离操控现实环境中的物体,该文设计易于理解的体交互操作手势;借助对Leap Motion传感器工作区域的远近场划分,建立合理的物理空间和信息空间映射关系;针对利用深度相机的手部姿态解算问题,结合Leap Motion传感器的特点,提出一种结合手掌法向和指尖向量的空间姿态算法;结合大屏幕体交互的任务特点,设计了支持连续数据流的非接触式体交互原型系统;最后通过用户实验对原型系统进行评估。结果表明,和传统的2D体交互比较,该文算法的用户体验和表现更为自然、直观和高效。

基于视觉的互动游戏手势界面工具箱

分析了视觉手势的交互特征,提出了非接触型设备交互模型,基于数据流图方法建立了支持连续信息输入的数据流模型来描述视觉手势信息的处理流程,基于"paint-view-correct"隐喻构建了手势界面开发工具IEToolkit.系统的主要特点包括:使用插件设计思想提供了可扩展的接口,方便开发人员对系统进行扩展;实现了对平台内部多个分类器的统一管理,方便用户对这些分类器进行动态配置;提供了可视化的用户界面,用户能够根据不同的应用灵活地定义高层的手势交互语义;屏蔽了图像处理、机器学习等底层的技术细节,降低了界面开发难度.最后介绍了基于IEToolkit的软件系统开发方法与应用实例.实例表明,该界面工具能够为基于视觉手势的互动游戏的设计开发提供统一的平台和有效的解决方案.

导弹装备虚拟维修训练系统通用平台

针对当前导弹装备虚拟维修训练系统开发只针对单一型号和专用功能、效率低、开放性和通用性差的问题,对基于资源重用性、系统通用性的导弹装备虚拟维修训练通用平台进行研究,阐述通用平台包含的视景仿真、故障机理建模与管理、人机交互、维修任务控制4类模块及2种典型训练模式,探讨通用平台设计中的4项关键技术。介绍通用平台的总体结构设计和基于EONStudio开发的虚拟维修训练原型系统。

气候信息交互显示与分析平台(CIPAS)设计与实现

气候信息交互显示与分析平台(CIPAS)设计为面向气候监测、诊断、预测等基础业务支撑系统。CIPAS设计了面向气候业务应用的集约化基础数据环境,内容涵盖全时间序列的地面常规观测、指数资料、再分析资料以及数值预报产品等,并提供基于要素、层次、时间、范围、种类等查询参数的统一、简单的访问接口(API);CIPAS设计采用多层次分布式架构并形成轻量级客户端,而客户端则采用组件化和插件化设计方法,涵盖数据、图形、分析处理、版面制图、配置管理等核心组件,形成可扩展和组装的基础业务功能模块及二次开发接口,并以工具箱的形式提供各种气候业务分析能力,如EOF,SVD等诊断分析工具。该文重点对CIPAS的建设原则、总体框架、主要功能、运行流程等设计进行详细介绍,并对平台实现所涉及的若干关键技术问题进行深入分析。CIPAS初步具备了气候资料综合检索、多维显示、统计诊断分析产品生成等综合业务功能,其建设成果在国家级和试点省份的试用显示其较好的业务应用能力与发展前景。

新型轮腿式机器人研究

设计与研制了一种新型小尺寸、轻体重、多用途的轮腿式机器人,集中了腿式机器人地形适应性强和轮式机器人机动速度高的优点,可在复杂地形条件下以多种行进步态和运动方式完成特殊的机动任务.开发了上位机人机交互系统和基于ARM的嵌入式运动控制系统,实现了多轴伺服运动控制技术,在控制、反馈各环节之间以及机器人视觉系统中采用了无线数据通信方式,实现了机器人的远程遥控.并辅助以超声波探测器阵列,用多传感器信息融合技术配以实时避障算法和数字图像处理技术实现了机器人的自主运动及探测.仿真分析和原理样机实测表明,该机器人具有良好的越野行驶能力和稳定可靠的探测性能,为进一步研究小型多用途机器人理论和实践奠定了基础.