Eye movements during inspecting pictures of natural scenes for information to verify sentences

As eye tracking can be used to record moment-to-moment changes of eye movements as people inspect pictures of natural scenes and comprehend information, this paper attempts to use eye-movement technology to investigate how the order of presentation and the characteristics of information affect the semantic mismatch effect in the picture-sentence paradigm. A 3（syntax）×2（semantic relation） factorial design is adopted, with syntax and semantic relations as within-participant variables. The experiment finds that the semantic mismatch is most likely to increase cognitive loads as people have to spend more time, including first-pass time, regression path duration, and total fixation duration. Double negation does not significantly increase the processing difficulty of pictures and information. Experimental results show that people can extract the special syntactic strategy from long-term memory to process pictures and sentences with different semantic relations. It enables readers to comprehend double negation as affirmation. These results demonstrate that the constituent comparison model may not be a general model regarding other languages.

Identification of Information-Seeking Behaviors from Air Traffic Controllers′ Eye Movements

Air traffic controllers are the important parts of air traffic management system who are responsible for the safety and efficiency of the system.They make traffic management decisions based on information acquired from various sources.The understanding of their information seeking behaviors is still limited.We aim to identify controllers′ behavior through the examination of the correlations between controllers′eye movements and air traffic.Sixteen air traffic controllers were invited to participate real-time simulation experiments,during which the data of their eye ball movements and air traffic were recorded.Tweny-three air traffic complexity metrics and six eye movements metrics were calculated to examine their relationships.Two correlational methods,Pearson′s correlation and Spearman′s correlation,were tested between every eye-traffic pair of metrics.The results indicate that controllers′two kinds of information-seeking behaviors can be identified from their eye movements:Targets tracking,and confliction recognition.The study on controllers′ eye movements may contribute to the understanding of information-seeking mechanisms leading to the development of more intelligent automations in the future.

Experimental platform for moving double-camera system based on binocular vergence eye movements

A control model of binocular vergence eye movements is presented. The control model can reduce blind areas caused by the double cameras in motion platform. In order to validate the model performance, an experimental platform and its control system based on TMS320LF2407 are designed. The control system has its compacted configuration and high reliability. The simulation and experimental results show that the control system can realize binocular vergence movements. Compared with the conventional moving double cameras system, this new system can considerably reduce blind areas.

Sex differences in eye movements and neural oscillations during mental rotation in virtual reality

Virtual reality(VR)has been a promising tool for developing visuospatial tasks.Among visuospatial tasks,mental rotation tasks are widely used in the assessment of visuospatial ability.Males have a distinct advantage in mental rotation ability compared to females,yet it is generally produced by investigations based on two-dimensional(2D)images on a computer screen.Sex differences in mental rotation tasks with three-dimensional(3D)objects in VR were not fully investigated.It is unclear whether the male's advantages in 2D mental rotation tasks are weakened in 3D tasks.The aim of this study was to provide new insights into the understanding of sex differences in mental rotation tasks presented in VR.Here,we developed a VR mental rotation task(VR-MRT)using 3D objects presented by a head-mounted display(HMD)and used VR-based eye tracking and electroencephalography(EEG)to examine eye movements and neural oscillations for males and females.Our results showed that females preferred a piecemeal strategy compared to males,suggesting a significant sex difference in visual strategy.More importantly,we found no significant sex differences in alpha-band and beta-band oscillations related to rotation processes of VR-MRT.These findings indicated that sex differences in the VR-MRT were mainly attributed to the selection of visual strategy rather than the rotation processes.The study helps to comprehensively understand the dominant factors contributing to the sex differences in the VR-MRT.

A Study of Pharmacist-Patient Communication: Examining Optimal Distance and Angle Using an Eye-Tracking System

This study focuses on seating arrangement and interpersonal distance as important aspects of nonverbal communication and aims to elucidate the optimal distance and angle between pharmacist and patient through an analysis based on the subjective evaluation of the patient and the objective evaluation of eye movements. Seven female simulated patients and one male and one female pharmacist cooperated as patients and pharmacists, respectively. The medication teaching scenes were set up with three pharmacist placements (face-to-face at 50 cm and 70 cm, 90-degree at 70 cm) and three hospital rooms (0-degree, 45-degree, 90-degree). Pupil diameter, blink rate, saccades, and fixation rate of the patient at each of these locations were measured using a Tobii Pro Glass 2. The patient’s subjective evaluation at each placement was also investigated using the conversation scale, which assesses the optimal distance for conversation. The results for the pharmacy setting revealed that pupils were significantly more mydriatic at the 50 cm point than at the other points. The results for the hospital room setting showed the greatest mydriasis at the 0-degree point. The result of the 50 cm point for the pharmacy setting and the 0-degree point for the hospital room setting was similar to that of the subjective evaluation. When the likelihood of saccades occurrence in the hospital room setting was compared, saccades were found to be most likely to occur when medication instructions were given to patients at the 0-degree point. We believe that using pupil diameter for interpersonal distance, and saccades for angle will enable more accurate determinations of the optimal distance and angle between pharmacist and patient. The results of the present study suggest that the 70 cm face-to-face point in the pharmacy and the 45-degree point in the ward may be suitable for medication instruction.

Eye movements characteristics of Chinese dyslexic children in picture searching

Background Reading Chinese, a kind of ideogram, relies more on visual cognition. The visuospatial cognitive deficit of Chinese dyslexia is an interesting topic that has received much attention. The purpose of current research was to explore the visuopatial cognitive characteristics of Chinese dyslexic children by studying their eye movements via a picture searching test. Methods According to the diagnostic criteria defined by ICD-10, twenty-eight dyslexic children （mean age （10.12±1.42） years） were enrolled from the Clinic of Children Behavioral Disorder in the third affiliated hospital of Sun Yat-sen University. And 28 normally reading children （mean age （10.06±1.29） years）, 1：1 matched by age, sex, grade and family condition were chosen from an elementary school in Guangzhou as a control group. Four groups of pictures （cock, accident, canyon, meditate） from Picture Vocabulary Test were chosen as eye movement experiment targets. All the subjects carried out the picture searching task and their eye movement data were recorded by an Eyelink II High-Speed Eye Tracker. The duration time, average fixation duration, average saccade amplitude, fixation counts and saccade counts were compared between the two groups of children. Results The dyslexic children had longer total fixation duration and average fixation duration （F=-7.711, P 〈0.01; F=-4.520, P 〈0.05）, more fixation counts and saccade counts （F=-7.498, P 〈0.01; F=-11.040, P 〈0.01）, and a smaller average saccade amplitude （F=-29.743, P 〈0.01） compared with controls. But their performance in the picture vocabulary test was the same as those of the control group. The eye movement indexes were affected by the difficulty of the pictures and words, all eye movement indexes, except saccade amplitude, had a significant difference within groups （P 〈0.05）. Conclusions Chinese dyslexic children have abnormal eye movements in picture searching, applying slow fixations, more fixations and small and frequent saccades. Their abnormal eye movement mode reflects the poor ability and strategy of visual information processing.

Identification of Eye Movements from Non-frontal Face Images for Eye-controlled Systems

The novel eye-based human-computer interaction(HCI) system aims to provide people, especially, disabled persons,a new way of communication with surroundings. It adopts a series of continual eye movements as input to perform simple control activities. Identification of eye movements is the crucial technology in these eye-based HCI systems. At present, researches on eye movement identification mainly focus on frontal face images. In fact, acquisition of non-frontal face images is more reasonable in real applications. In this paper, we discuss the identification process of eye movements from non-frontal face images. Firstly, the original head-shoulder images of 0?–±60?azimuths are sampled without any auxiliary light source. Secondly, the non-frontal face region is detected by using the Adaboost cascade classifiers. After that, we roughly extract eye windows by the integral projection function.Then, we propose a new method to calculate the x- y coordinates of the pupil center point by searching the minimal intensity value in the eye windows. According to the trajectory of the pupil center points, different eye movements(eye moving left, right, up or down)are successfully identified. A set of experiments is presented.

Adaptive navigation assistance based on eye movement features in virtual reality

Background Navigation assistance is essential for users when roaming virtual reality scenes;however,the traditional navigation method requires users to manually request a map for viewing,which leads to low immersion and poor user experience.Methods To address this issue,we first collected data on who required navigation assistance in a virtual reality environment,including various eye movement features,such as gaze fixation,pupil size,and gaze angle.Subsequently,we used the boosting-based XGBoost algorithm to train a prediction model and finally used it to predict whether users require navigation assistance in a roaming task.Results After evaluating the performance of the model,the accuracy,precision,recall,and F1-score of our model reached approximately 95%.In addition,by applying the model to a virtual reality scene,an adaptive navigation assistance system based on the real-time eye movement data of the user was implemented.Conclusions Compared with traditional navigation assistance methods,our new adaptive navigation assistance method could enable the user to be more immersive and effective while roaming in a virtual reality(VR)environment.

Application of Eye Movement Analysis in Landscape Visual Quality Evaluation

The existing methods of landscape visual quality evaluation is mostly based on people's subjective feelings,and the objectivity and scientificity of evaluation results are insufficient.As an important means of experimental psychology,eye movement technology can show great advantages and potential in landscape visual quality evaluation.On the basis of combing and summarizing the relevant literature,based on the explanation of the technical principle of eye movement analysis,the application field,research content,technical methods and other aspects of eye movement analysis were reviewed.The application prospect of eye movement technology in landscape visual quality evaluation was explored to provide theoretical reference for the in-depth evaluation and research of landscape visual quality evaluation theory.

Eye Movement Modeling Examples as a Teaching Tool for Epidural Block

Introduction: Video examples with task demonstrations by experts, with the expert’s eye movements superimposed on the task, are known as “eye movement modeling examples” (EMME). We performed this study to evaluate if there were improvements in the performance of anesthesia novice trainees when executing the epidural technique after an EMME of epidural block procedure. Methods: We developed an eye movement modeling example (EMME) from eye tracking recordings made by experienced anesthesiologists with more than 20 years of experience. Forty-two PGY3 anesthesia trainees who had never previously performed an epidural block were randomized to receive (study group) or not receive (control group) the EMME video before their institutional training. All the trainees were evaluated every 10 epidural blocks until the end of the rotation period, by an independent, blinded observer using the Global Rating Scale for Epidural Anesthesia (GRS). Results: Trainees who received the EMME training exhibited more respect for the patient’s tissues (P Discussion: This is the first study that has used the EMME for a practical, clinical teaching purpose on real patients and that has used it as an aid in teaching epidural anesthesia. We demonstrated that inexperienced trainees who received the EMME training improved their proficiency at epidural blocks as compared to those who had no EMME training beforehand. Given this result, we welcome further studies to investigate the impact and the role of EMME on clinical teaching in the field of anesthesia.

Effect of Working Experience on Air Traffic Controller Eye Movement

Eye movement is an important indicator of information-seeking behavior and provides insight into cognitive strategies which are vital for decision-making.Various measures based on eye movements have been proposed to capture humans’ability to process information in a complex environment.The effectiveness of these measures has not yet been fully explored in the field of air traffic management.This paper presents a comparative study on eye-movement measures in air traffic controllers with different levels of working experience.Two commonly investigated oculomotor behaviors,fixation and saccades,together with gaze entropy,are examined.By comparing the statistical properties of the relevant metrics,it is shown that working experience has a notable effect on eye-movement patterns.Both fixation and saccades differ between qualified and novice controllers,with the former type of controller employing more efficient searching strategies.These findings are useful in enhancing the quality of controller training and contributing to an understanding of the information-seeking mechanisms humans use when executing complex tasks.

Eye movement prediction by oculomotor plant Kalman filter with brainstem control

Our work addresses one of the core issues related to Human Computer Interaction （HCI） systems that use eye gaze as an input. This issue is the sensor, transmission and other delays that exist in any eye tracker-based system, reducing its performance. A delay effect can be compensated by an accurate prediction of the eye movement trajectories. This paper introduces a mathematical model of the human eye that uses anatomical properties of the Human Visual System to predict eye movement trajectories. The eye mathematical model is transformed into a Kalman filter form to provide continuous eye position signal prediction during all eye movement types. The model presented in this paper uses brainstem control properties employed during transitions between fast （saccade） and slow （fixations, pursuit） eye movements. Results presented in this paper indicate that the proposed eye model in a Kalman filter form improves the accuracy of eye movement prediction and is capable of a real-time performance. In addition to the HCI systems with the direct eye gaze input, the proposed eye model can be immediately applied for a bit-rate/computational reduction in real-time gaze-contingent systems

Eye-movement Patterns of Chinese Children with Developmental Dyslexia during the Stroop Test

Objective To compare the eye-movement patterns of Chinese children with developmental dyslexia（DD children） with those of non-dyslexic children as they perform the Stroop Color and Word Test（SCWT）, and to explore the relationship between their eye-movement patterns and interference effect. Methods An EyeLink II was used to record the eye-movement parameters of 32 DD children and 37 non-dyslexic children as they performed the SCWT. The independent samples t-test and repeated measures were used to analyze behavioral and eye-movement parameters. Results Compared to the control group, Chinese DD children presented lower accuracy（F = 8.488）, slower response time（F = 25.306）, and larger interference effect（t = 2.29）; Chinese DD children also exhibited lower frequency of fixations（F = 6.069）, greater numbers of saccades（F = 7.914） and fixations（F = 5.272）, and shorter mean saccade distance（F = 4.03）. All behavioral and eye-movement parameters differed significantly among the three tasks in the SCWT. There was significant interaction between groups and tasks in accuracy（F = 5.844）, and marginally significant interaction in response time（F = 3.040）. Chinese DD children tended to have lower accuracy and longer response time than the control group in the ＇color-word naming＇ task. Conclusion Compared to non-dyslexic children, Chinese DD children are subject to a stronger interference effect. When performing the SCWT, Chinese DD children exhibit abnormal eye-movement patterns, namely shorter mean saccade distance, lower frequency of fixations, and more fixations and saccades. These abnormal eye movements may be relatively stable oculomotor patterns of DD children performing visual processing, and not influenced by impaired interference effect.

EasyGaze:Hybrid eye tracking approach for handheld mobile devices

Background Eye-tracking technology for mobile devices has made significant progress.However,owing to limited computing capacity and the complexity of context,the conventional image feature-based technology cannot extract features accurately,thus affecting the performance.Methods This study proposes a novel approach by combining appearance-and feature-based eye-tracking methods.Face and eye region detections were conducted to obtain features that were used as inputs to the appearance model to detect the feature points.The feature points were used to generate feature vectors,such as corner center-pupil center,by which the gaze fixation coordinates were calculated.Results To obtain feature vectors with the best performance,we compared different vectors under different image resolution and illumination conditions,and the results indicated that the average gaze fixation accuracy was achieved at a visual angle of 1.93°when the image resolution was 96×48 pixels,with light sources illuminating from the front of the eye.Conclusions Compared with the current methods,our method improved the accuracy of gaze fixation and it was more usable.

How non-rapid eye movement sleep and Alzheimer pathology are linked

Alzheimer's disease(AD)is a multifactorial neurodegenerative disorder characterized by the presence of senile plaques and neurofibrillary tangles.Research attempts to identify characteristic factors that are associated with the presence of the AD pathology on the one hand and that increase the risk of developing AD on the other.Changes in non-rapid eye movement(NREM)sleep may meet both requirements for various reasons.First,NREM-sleep is important for optimal memory function.In addition,studies report that the presence of AD pathology is associated with NREM-sleep changes.Finally,more and more results appear to suggest that sleep problems are not only a symptom of AD but can also increase the risk of AD.Several of these studies suggest that it is primarily a lack of NREM-sleep that is responsible for this increased risk.However,the majority investigated sleep only through subjective reporting,as a result of which NREMsleep could not be analyzed separately.The aim of this literature study is therefore to present the results of the studies that relate the AD pathology and NREM-sleep(registered by electroencephalography).Furthermore,we try to evaluate whether NREM-sleep analysis could be used to support the diagnosis of AD and whether NREM-sleep deficiency could be a causal factor in the development of AD.

Predictive Model of Live Shopping Interest Degree Based on Eye Movement Characteristics and Deep Factorization Machine

In the live broadcast process,eye movement characteristics can reflect people’s attention to the product.However,the existing interest degree predictive model research does not consider the eye movement characteristics.In order to obtain the users’interest in the product more effectively,we will consider the key eye movement indicators.We first collect eye movement characteristics based on the self-developed data processing algorithm fast discriminative model prediction for tracking(FDIMP),and then we add data dimensions to the original data set through information filling.In addition,we apply the deep factorization machine(DeepFM)architecture to simultaneously learn the combination of low-level and high-level features.In order to effectively learn important features and emphasize relatively important features,the multi-head attention mechanism is applied in the interest model.The experimental results on the public data set Criteo show that,compared with the original DeepFM algorithm,the area under curve(AUC)value was improved by up to 9.32%.

Eye-Movement Characteristics of Drivers According to Driving Experience-Relevance to Traffic Sign Legibility

An experiment was conducted to find the variability of driver eye movement according to different driving experience. An eye tracking system was used to study the regularity of driver eye movements, such as fixation duration, variations of fixation points, and the distribution of glance zone. It was found that driving experience had a significant effect on driver eye movement behavior. The percentage of fixation duration to total glance time for inexperienced drivers was 61.5%, while the percentage for experienced drivers was 50.2%. Moreover, the majority of drivers paid attention to the left region of the field of view more frequently than the central and the right regions. This study indicates that it takes inexperienced drivers more time to recognize traffic signs. The findings from this study will assist traffic engineers in designing and installing the traffic signs in an optimal way.

Flexible and self-powered blinking and eyeball movements sensing based on electrospun lead-free piezoelectric nanofibers

Potassium sodium niobate(KNN)-based nanofibers could combine piezoelectric properties with exceptional flexibility and biocompatibility,making them highly promising for flexible sensors in electronic skin and wearable applications.However,the suboptimal piezoelectric performance limits their sensitivity in detecting minute human body motions,such as blinking and eye movements.Herein,Li and Ta-doped KNN nanofibers were fabricated via an electro-spinning process.Co-doping with 6%Li at the A-site and 30%Ta at the B-site induces lattice distortion and an orthorhombic(O)to tetragonal(T)phase transition in the electrospun nanofibers,resulting in a significantly enhanced piezoelectric response,with an average d_(33)*value reaching 110.7 pm/V.The outstanding piezoelectric response gives rise to a remarkable sensitivity(0.3365 V/(N cm^(2)))in a self-powered flexible pressure sensor based on the doped KNN nanofibers,encapsulated in a polydimethylsiloxane matrix.The sensors,when attached to the temple regions,can detect tiny facial motions induced by blinking,enabling the distinction of abnormal blinking patterns associated with mental fatigue and excessive eye use.Additionally,they support real-time,continuous,and unobtrusive eyeball tracking,highlighting their potential as critical components in human-computer interaction and artificial intelligence applications.

Development of Instrument Control System Using Biosignals Created by the Change of Eyes Movement Sequence

A new biosi gn al control system that offers the disables the opportunities to control electric appliances is proposed.The four types of signals created by the eyes movements in four directions(up,down,left,and right),which are taken as four basic signals , are detected at the forehead.Permutation of 2 signals out of them creates 16 d ifferent signals.Permutation of 3 signals out of them creates 64 signals.They al l amounts to 84 control signals.They are thought to be applicable for the operat ion of some instruments.Furthermore,the dynamic biosignals created by the slow e yes movement is speculated to be applicable for the more convenient control of t hem.

Chemogenetic activation of sublaterodorsal tegmental glutamatergic neurons alleviates rapid eye movement sleep behavior disorder symptoms in a chronic rat model of Parkinson disease

Rapid eye movement(REM)sleep behavior disorder(RBD)is a parasomnia that is featured by elevated motor behaviors and dream enactments during REM sleep.Clinical observations show that RBD bears significant relevance with several synucleinopathies such as Lewy body dementia and Parkinson disease(PD),and often develops prior to their diagnosis.Being a potential biomarker of PD,investigating the relationship of RBD symptoms and their emergence in developing PD would provide insight intoits pathogenesis.Here,in a chronic model of PD,rats with daily rotenone treatment exhibited key RBD features,including elevated sleep muscle tone,sleep fragmentation and EEG slowing at different time points.Based on detectedearly alpha synuclein aggregation and neural apoptosis in the sublaterodorsal tegmental nucleus(SLD),an area known to promote REM sleep and maintain sleep muscle atonia,the possible involvement of SLD glutamatergic neurons was interrogated.Via chemogenetic activation of SLD glutamatergic neurons,key RBD symptoms and EEG slowing in REM sleep were alleviated.These results are consistent with a progressive degeneration in REM sleep promoting pathways.Our findings provide a foundation for further studies into RBD and its relationship to neurodegenerative diseases.