In this research, we study the relationship between mental workload and facial temperature of aircraft participants during a simulated takeoff flight. We conducted experiments to comprehend the correlation between wor...In this research, we study the relationship between mental workload and facial temperature of aircraft participants during a simulated takeoff flight. We conducted experiments to comprehend the correlation between work and facial temperature within the flight simulator. The experiment involved a group of 10 participants who played the role of pilots in a simulated A-320 flight. Six different flying scenarios were designed to simulate normal and emergency situations on airplane takeoff that would occur in different levels of mental workload for the participants. The measurements were workload assessment, face temperatures, and heart rate monitoring. Throughout the experiments, we collected a total of 120 instances of takeoffs, together with over 10 hours of time-series data including heart rate, workload, and face thermal images and temperatures. Comparative analysis of EEG data and thermal image types, revealed intriguing findings. The results indicate a notable inverse relationship between workload and facial muscle temperatures, as well as facial landmark points. The results of this study contribute to a deeper understanding of the physiological effects of workload, as well as practical implications for aviation safety and performance.展开更多
We have applied functional near-infrared spectroscopy(fNIRS)to the human forehead to distinguish different levels of mental workload on the basis of hemodynamic changes occurring in the prefrontal cortex.We report dat...We have applied functional near-infrared spectroscopy(fNIRS)to the human forehead to distinguish different levels of mental workload on the basis of hemodynamic changes occurring in the prefrontal cortex.We report data on 3 subjects from a protocol involving 3 mental workload levels based on to working memory tasks.To quantify the potential of fNIRS for mental workload discrimination,we have applied a 3-nearest neighbor classification algorithm based on the amplitude of oxyhemoglobin(HbO2)and deoxyhemoglobin(HbR)concentration changes associated with the working memory tasks.We have found classification success rates in the range of 44%-72%,which are significantly higher than the corresponding chance level(for random data)of 19.1%.This work shows the potential of fNIRS for mental workload classification,especially when more parameters(rather than just the amplitude of concentration changes used here)and more sophisticated classification algorithms(rather than the simple 3-nearest neighbor algorithm used here)are considered and optimized for this application.展开更多
Mental workload is considered to be strongly linked to human performance,and the ability to measure it accurately is key for balancing human health and work.In this study,brain signals were elicited by mental arithmet...Mental workload is considered to be strongly linked to human performance,and the ability to measure it accurately is key for balancing human health and work.In this study,brain signals were elicited by mental arithmetic tasks of varying difficulty to stimulate different levels of mental workload.In addition,a finite impulse response(FIR)filter,independent component analysis(ICA),and multiple artifact rejection algorithms(MARAs)were used to filter event-related potentials(ERPs).Then,the data consisting of ERPs,subjective ratings of mental workload,and task performance,were analyzed through the use of variance and Spearman’s correlation during a simulated computer task.We found that participants responded faster and performed better in the easy task condition,followed by the medium and high-difficulty conditions,which verifies the validity of the ERP filtering.Moreover,larger P2 and P3 waveforms were evoked as the task difficulty increased,and a higher task difficulty elicited a more enhanced N300.Correlation analysis revealed a negative relationship between the amplitude of P3 and the subjective ratings,and a positive relationship between the P3 amplitude and accuracy.The results presented in this paper demonstrate that a combination of FIR,ICA,and MARA methods can filter ERPs in the non-invasive real-time measurement of workload.Additionally,frontocentral P2,N3,and parietal P3 components showed differences between genders.The proposed measurement of mental workload can be useful for real-time identification of mental states and can be applied to human-computer interaction in the future.展开更多
The digital simulation technology is adopted to establish the flight environment and scenario,which realizes the flight display instrument interface and unusual attitude recovery task.The humancomputer interaction(HCI...The digital simulation technology is adopted to establish the flight environment and scenario,which realizes the flight display instrument interface and unusual attitude recovery task.The humancomputer interaction(HCI) experiment is carried out in the flight simulation system,and the behavior performances and physiological parameters are recorded as the evaluation indices of mental workload.Participants are required to perform the unusual attitude recovery tasks and keep monitoring the target flight indicators.Once the unusual attitude occurs,the corresponding operation of steering wheel is expected to be taken immediately to response and eliminate it.The results show that most of behavior performances and physiological parameters are sensitive to mental workload and some of the indices are significantly correlative.展开更多
Physiological measures indexed by fixation frequency and total fixation time,task performance based on n-back accuracy,subjective assessment based on NASA Task Load Index(NASA-TLX) were used to measure the Mental Work...Physiological measures indexed by fixation frequency and total fixation time,task performance based on n-back accuracy,subjective assessment based on NASA Task Load Index(NASA-TLX) were used to measure the Mental Workload(MW) in different levels which were induced by vision-related flight task combined with auditory cognitive load. 16 healthy novice pilots were recruited to complete a monitoring task based on Head-Up Display(HUD) and an auditory n-back task which was used to manipulate the Mental Workload Level(MWL) in flight simulation environment. In our experiment,fixation frequency,average saccade time,blink rate and average pupil diameter were sensitive to MW. What's more,a comprehensive assessment method of pilot mental workload based on various measures was advocated. At last,a Fisher projection function based on the Fisher discrimination method and a three-level discriminate model established by the Bayes discrimination method were built up,the original validation and cross-validation methods of both models were 97. 92% and 95. 83% respectively,which could discriminate various Mental Workload Levels(MWLs) ideally.展开更多
Objectives: To evaluate the perceived mental workload and to identify its individual and professional determinants among Tunisian caregivers in university hospitals. Methods: A cross-sectional study was carried out in...Objectives: To evaluate the perceived mental workload and to identify its individual and professional determinants among Tunisian caregivers in university hospitals. Methods: A cross-sectional study was carried out in two university hospitals of the center of Tunisia, which employ 1179 paramedics providing care activities. The survey was conducted within a representative sample, of 301 caregivers assigned to 28 medical and surgical services, randomly drawn, after being paired according to age, gender and work schedule. It included structured inquiry (socio-professional characteristics, occupational perceived workload) and validated questionnaires (Job Content Questionnaire of Karasek, SF12, WAI). Results: Mental workload was perceived as “moderate” by 145 caregivers (48.49%) and as “heavy” by 119 caregivers (40.61% of them). Among the sample, 209 paramedics endured at least once the fixed night work schedules along their respective careers, with an average of 5.63 ± 7.54 years. According to the WAI index, 39.59% of subjects considered their capacity of work as low. Moreover, job strain was noted in 19.79%. Indeed, work latitude was unsatisfactory among 41% of caregiver, 60.1% of them mentioned the absence of colleagues’ support. A feeling of job insecurity was reported by 73.72% of subjects. Multi-varied analytic study concluded that heavier perceived mental work load was correlated to individual determinants particularly age >45 years (p -3), overweight or obesity (p = 0.02), more than three depending children (p -3), lower degree obtained (p -3), working grade as nurse assistant (P = 0.001), lower quality of physical life (0.010) and expressed willingness to retire early (p = 0.003). Conclusion: The heavy perception of mental workload associated to care activities, is one of the reasons of premature departure among nurses from professional activity. Preventive actions on professional determinants of perceived workload can reduce this phenomenon.展开更多
With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out ...With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out under flight simulation task conditions using the performance evaluation, subjective evaluation and physiological measurement methods. The experimental results show that with an increased mental workload, the detection accuracy of flight operation significantly reduced and the reaction time was significantly prolonged; the standard deviation of R-R intervals(SDNN) significantly decreased, while the mean heart rate exhibited little change; the score of NASA_TLX scale significantly increased. On this basis, the indexes sensitive to mental workload were screened, and an integrated model for the discrimination and prediction of mental workload of aircraft cockpit display interface was established based on the Bayesian Fisher discrimination and classification method. The original validation and cross-validation methods were employed to test the accuracy of the results of discrimination and prediction of the integrated model, and the average prediction accuracies determined by these two methods are both higher than 85%. Meanwhile, the integrated model shows a higher accuracy in discrimination and prediction of mental workload compared with single indexes. The model proposed in this paper exhibits a satisfactory coincidence with the measured data and could accurately reflect the variation characteristics of the mental workload of aircraft cockpit display interface, thus providing a basis for the ergonomic evaluation and optimization design of the aircraft cockpit display interface in the future.展开更多
Mental fatigue is a complex state that results from prolonged cognitive activity. Symptoms of mental fatigue can include change in mood, motivation, and temporary deterioration of various cognitive functions involved ...Mental fatigue is a complex state that results from prolonged cognitive activity. Symptoms of mental fatigue can include change in mood, motivation, and temporary deterioration of various cognitive functions involved in goal-directed behavior. Extensive research has been done to develop methods for recognizing physiological and psychophysiological signs of mental fatigue. This has allowed the development of many AI-based models to classify different levels of fatigue, using data extracted from eye-tracking device, EEG, or ECG. In this paper, we present an experimental protocol which aims to both generate/measure mental fatigue and provide effective strategies for recuperation via VR sessions paired with EEG and eye tracking devices. This paper first provides a comprehensive state-of-the-art of mental fatigue predictive factors, measurement methods, and recuperation strategies. Then the paper presents an experimental protocol resulting from the state-of-the-art to 1) generate and measure mental fatigue and 2) evaluate the effectiveness of virtual therapy for fatigue recuperation, using a virtual reality (VR) simulated environment. In our work, we successfully generated mental fatigue through completion of cognitive tasks in a virtual simulated environment. Participants showed significant decline in pupil diameter and theta/alpha score during the various cognitive tasks. We trained an RBF SVM classifier from Electroencephalogram (EEG) data classifying mental fatigue with 95% accuracy on the test set. Finally, our results show that the time allocated for virtual therapy did not improve pupil diameter in post-relaxation period. Further research on the impact of relaxation therapy on relaxation therapy should allocate time closer to the standard recovery time of 60 min.展开更多
Purpose–The presentation of in-vehicle warnings information at risky driving scenarios is aimed to improve the collision avoidance ability of drivers.Existing studies have found that driver’s collision avoidance per...Purpose–The presentation of in-vehicle warnings information at risky driving scenarios is aimed to improve the collision avoidance ability of drivers.Existing studies have found that driver’s collision avoidance performance is affected by both warning information and driver’s workload.However,whether moderation and mediation effects exist among warning information,driver’s cognition,behavior and risky avoidance performance is unclear.Design/methodology/approach–This purpose of this study is to examine whether the warning information type modifies the relationship between the forward collision risk and collision avoidance behavior.A driving simulator experiment was conducted with waring and command information.Findings–Results of 30 participants indicated that command information improves collision avoidance behavior more than notification warning under the forward collision risky driving scenario.The primary reason for this is that collision avoidance behavior can be negatively affected by the forward collision risk.At the same time,command information can weaken this negative effect.Moreover,improved collision avoidance behavior can be achieved through increasing drivers’mental workload.Practical implications–The proposed model provides a comprehensive understanding of the factors influencing collision avoidance behavior,thus contributing to improved in-vehicle information system design.Originality/value–The significant moderation effects evoke the fact that information types and mental workloads are critical in improving drivers’collision avoidance ability.Through further calibration with larger sample size,the proposed structural model can be used to predict the effect of invehicle warnings in different risky driving scenarios.展开更多
文摘In this research, we study the relationship between mental workload and facial temperature of aircraft participants during a simulated takeoff flight. We conducted experiments to comprehend the correlation between work and facial temperature within the flight simulator. The experiment involved a group of 10 participants who played the role of pilots in a simulated A-320 flight. Six different flying scenarios were designed to simulate normal and emergency situations on airplane takeoff that would occur in different levels of mental workload for the participants. The measurements were workload assessment, face temperatures, and heart rate monitoring. Throughout the experiments, we collected a total of 120 instances of takeoffs, together with over 10 hours of time-series data including heart rate, workload, and face thermal images and temperatures. Comparative analysis of EEG data and thermal image types, revealed intriguing findings. The results indicate a notable inverse relationship between workload and facial muscle temperatures, as well as facial landmark points. The results of this study contribute to a deeper understanding of the physiological effects of workload, as well as practical implications for aviation safety and performance.
基金supported by NSF Award IIS-0713506,and NIH Grant DA021817。
文摘We have applied functional near-infrared spectroscopy(fNIRS)to the human forehead to distinguish different levels of mental workload on the basis of hemodynamic changes occurring in the prefrontal cortex.We report data on 3 subjects from a protocol involving 3 mental workload levels based on to working memory tasks.To quantify the potential of fNIRS for mental workload discrimination,we have applied a 3-nearest neighbor classification algorithm based on the amplitude of oxyhemoglobin(HbO2)and deoxyhemoglobin(HbR)concentration changes associated with the working memory tasks.We have found classification success rates in the range of 44%-72%,which are significantly higher than the corresponding chance level(for random data)of 19.1%.This work shows the potential of fNIRS for mental workload classification,especially when more parameters(rather than just the amplitude of concentration changes used here)and more sophisticated classification algorithms(rather than the simple 3-nearest neighbor algorithm used here)are considered and optimized for this application.
基金supported by the National Natural Science Foundation of China(Nos.71801002,71701003)the Humanities and Social Science Fund of the Ministry of Education of China(No.18YJC630023)+1 种基金the Natural Science Foundation of Anhui Province(No.1808085QG228)the Postdoctoral Program of Liaoning Province.
文摘Mental workload is considered to be strongly linked to human performance,and the ability to measure it accurately is key for balancing human health and work.In this study,brain signals were elicited by mental arithmetic tasks of varying difficulty to stimulate different levels of mental workload.In addition,a finite impulse response(FIR)filter,independent component analysis(ICA),and multiple artifact rejection algorithms(MARAs)were used to filter event-related potentials(ERPs).Then,the data consisting of ERPs,subjective ratings of mental workload,and task performance,were analyzed through the use of variance and Spearman’s correlation during a simulated computer task.We found that participants responded faster and performed better in the easy task condition,followed by the medium and high-difficulty conditions,which verifies the validity of the ERP filtering.Moreover,larger P2 and P3 waveforms were evoked as the task difficulty increased,and a higher task difficulty elicited a more enhanced N300.Correlation analysis revealed a negative relationship between the amplitude of P3 and the subjective ratings,and a positive relationship between the P3 amplitude and accuracy.The results presented in this paper demonstrate that a combination of FIR,ICA,and MARA methods can filter ERPs in the non-invasive real-time measurement of workload.Additionally,frontocentral P2,N3,and parietal P3 components showed differences between genders.The proposed measurement of mental workload can be useful for real-time identification of mental states and can be applied to human-computer interaction in the future.
基金National Basic Research Program of China(No.2010CB734104)Foundation of Graduate Technology Innovation and Practice of Beihang University,China(No.YCSJ-01-201305)
文摘The digital simulation technology is adopted to establish the flight environment and scenario,which realizes the flight display instrument interface and unusual attitude recovery task.The humancomputer interaction(HCI) experiment is carried out in the flight simulation system,and the behavior performances and physiological parameters are recorded as the evaluation indices of mental workload.Participants are required to perform the unusual attitude recovery tasks and keep monitoring the target flight indicators.Once the unusual attitude occurs,the corresponding operation of steering wheel is expected to be taken immediately to response and eliminate it.The results show that most of behavior performances and physiological parameters are sensitive to mental workload and some of the indices are significantly correlative.
基金Sponsored by the Tianjin Key Laboratory of Civil Aircraft Airworthiness and Maintenance in CAUC(Grant No.M J-J-2012-07)
文摘Physiological measures indexed by fixation frequency and total fixation time,task performance based on n-back accuracy,subjective assessment based on NASA Task Load Index(NASA-TLX) were used to measure the Mental Workload(MW) in different levels which were induced by vision-related flight task combined with auditory cognitive load. 16 healthy novice pilots were recruited to complete a monitoring task based on Head-Up Display(HUD) and an auditory n-back task which was used to manipulate the Mental Workload Level(MWL) in flight simulation environment. In our experiment,fixation frequency,average saccade time,blink rate and average pupil diameter were sensitive to MW. What's more,a comprehensive assessment method of pilot mental workload based on various measures was advocated. At last,a Fisher projection function based on the Fisher discrimination method and a three-level discriminate model established by the Bayes discrimination method were built up,the original validation and cross-validation methods of both models were 97. 92% and 95. 83% respectively,which could discriminate various Mental Workload Levels(MWLs) ideally.
文摘Objectives: To evaluate the perceived mental workload and to identify its individual and professional determinants among Tunisian caregivers in university hospitals. Methods: A cross-sectional study was carried out in two university hospitals of the center of Tunisia, which employ 1179 paramedics providing care activities. The survey was conducted within a representative sample, of 301 caregivers assigned to 28 medical and surgical services, randomly drawn, after being paired according to age, gender and work schedule. It included structured inquiry (socio-professional characteristics, occupational perceived workload) and validated questionnaires (Job Content Questionnaire of Karasek, SF12, WAI). Results: Mental workload was perceived as “moderate” by 145 caregivers (48.49%) and as “heavy” by 119 caregivers (40.61% of them). Among the sample, 209 paramedics endured at least once the fixed night work schedules along their respective careers, with an average of 5.63 ± 7.54 years. According to the WAI index, 39.59% of subjects considered their capacity of work as low. Moreover, job strain was noted in 19.79%. Indeed, work latitude was unsatisfactory among 41% of caregiver, 60.1% of them mentioned the absence of colleagues’ support. A feeling of job insecurity was reported by 73.72% of subjects. Multi-varied analytic study concluded that heavier perceived mental work load was correlated to individual determinants particularly age >45 years (p -3), overweight or obesity (p = 0.02), more than three depending children (p -3), lower degree obtained (p -3), working grade as nurse assistant (P = 0.001), lower quality of physical life (0.010) and expressed willingness to retire early (p = 0.003). Conclusion: The heavy perception of mental workload associated to care activities, is one of the reasons of premature departure among nurses from professional activity. Preventive actions on professional determinants of perceived workload can reduce this phenomenon.
基金supported by the National Basic Research Program of China (No. 2010CB734104)
文摘With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out under flight simulation task conditions using the performance evaluation, subjective evaluation and physiological measurement methods. The experimental results show that with an increased mental workload, the detection accuracy of flight operation significantly reduced and the reaction time was significantly prolonged; the standard deviation of R-R intervals(SDNN) significantly decreased, while the mean heart rate exhibited little change; the score of NASA_TLX scale significantly increased. On this basis, the indexes sensitive to mental workload were screened, and an integrated model for the discrimination and prediction of mental workload of aircraft cockpit display interface was established based on the Bayesian Fisher discrimination and classification method. The original validation and cross-validation methods were employed to test the accuracy of the results of discrimination and prediction of the integrated model, and the average prediction accuracies determined by these two methods are both higher than 85%. Meanwhile, the integrated model shows a higher accuracy in discrimination and prediction of mental workload compared with single indexes. The model proposed in this paper exhibits a satisfactory coincidence with the measured data and could accurately reflect the variation characteristics of the mental workload of aircraft cockpit display interface, thus providing a basis for the ergonomic evaluation and optimization design of the aircraft cockpit display interface in the future.
文摘Mental fatigue is a complex state that results from prolonged cognitive activity. Symptoms of mental fatigue can include change in mood, motivation, and temporary deterioration of various cognitive functions involved in goal-directed behavior. Extensive research has been done to develop methods for recognizing physiological and psychophysiological signs of mental fatigue. This has allowed the development of many AI-based models to classify different levels of fatigue, using data extracted from eye-tracking device, EEG, or ECG. In this paper, we present an experimental protocol which aims to both generate/measure mental fatigue and provide effective strategies for recuperation via VR sessions paired with EEG and eye tracking devices. This paper first provides a comprehensive state-of-the-art of mental fatigue predictive factors, measurement methods, and recuperation strategies. Then the paper presents an experimental protocol resulting from the state-of-the-art to 1) generate and measure mental fatigue and 2) evaluate the effectiveness of virtual therapy for fatigue recuperation, using a virtual reality (VR) simulated environment. In our work, we successfully generated mental fatigue through completion of cognitive tasks in a virtual simulated environment. Participants showed significant decline in pupil diameter and theta/alpha score during the various cognitive tasks. We trained an RBF SVM classifier from Electroencephalogram (EEG) data classifying mental fatigue with 95% accuracy on the test set. Finally, our results show that the time allocated for virtual therapy did not improve pupil diameter in post-relaxation period. Further research on the impact of relaxation therapy on relaxation therapy should allocate time closer to the standard recovery time of 60 min.
基金sponsored by the Chinese National Science Foundation(61803283)the“Chen Guang”project supported by ShanghaiMunicipal Education Commission and Shanghai Education Development Foundation(18CG17)the Shanghai Municipal Science and Technology Major Project(No.2021SHZDZX0100)and the Fundamental Research Funds for the Central Universities.
文摘Purpose–The presentation of in-vehicle warnings information at risky driving scenarios is aimed to improve the collision avoidance ability of drivers.Existing studies have found that driver’s collision avoidance performance is affected by both warning information and driver’s workload.However,whether moderation and mediation effects exist among warning information,driver’s cognition,behavior and risky avoidance performance is unclear.Design/methodology/approach–This purpose of this study is to examine whether the warning information type modifies the relationship between the forward collision risk and collision avoidance behavior.A driving simulator experiment was conducted with waring and command information.Findings–Results of 30 participants indicated that command information improves collision avoidance behavior more than notification warning under the forward collision risky driving scenario.The primary reason for this is that collision avoidance behavior can be negatively affected by the forward collision risk.At the same time,command information can weaken this negative effect.Moreover,improved collision avoidance behavior can be achieved through increasing drivers’mental workload.Practical implications–The proposed model provides a comprehensive understanding of the factors influencing collision avoidance behavior,thus contributing to improved in-vehicle information system design.Originality/value–The significant moderation effects evoke the fact that information types and mental workloads are critical in improving drivers’collision avoidance ability.Through further calibration with larger sample size,the proposed structural model can be used to predict the effect of invehicle warnings in different risky driving scenarios.