In this study,the effect of presentation rates on pupil dilation is investigated for target recognition in the Rapid Serial Visual Presentation(RSVP)paradigm.In this experiment,the RSVP paradigm with five different pr...In this study,the effect of presentation rates on pupil dilation is investigated for target recognition in the Rapid Serial Visual Presentation(RSVP)paradigm.In this experiment,the RSVP paradigm with five different presentation rates,including 50,80,100,150,and 200 ms,is designed.The pupillometry data of 15 subjects are collected and analyzed.The pupillometry results reveal that the peak and average amplitudes for pupil size and velocity at the 80-ms presentation rate are considerably higher than those at other presentation rates.The average amplitude of pupil acceleration at the 80-ms presentation rate is significantly higher than those at the other presentation rates.The latencies under 50-and 80-ms presentation rates are considerably lower than those of 100-,150-,and 200-ms presentation rates.Additionally,no considerable differences are observed in the peak,average amplitude,and latency of pupil size,pupil velocity,and acceleration under 100-,150-,and 200-ms presentation rates.These results reveal that with the increase in the presentation rate,pupil dilation first increases,then decreases,and later reaches saturation.The 80-ms presentation rate results in the largest point of pupil dilation.No correlation is observed between pupil dilation and recognition accuracy under the five presentation rates.展开更多
The rapid serial visual presentation(RSVP)paradigm has garnered considerable attention in brain–computer interface(BCI)systems.Studies have focused on using cross-subject electroencephalogram data to train cross-subj...The rapid serial visual presentation(RSVP)paradigm has garnered considerable attention in brain–computer interface(BCI)systems.Studies have focused on using cross-subject electroencephalogram data to train cross-subject RSVP detection models.In this study,we performed a comparative analysis of the top 5 deep learning algorithms used by various teams in the event-related potential competition of the BCI Controlled Robot Contest in World Robot Contest 2022.We evaluated these algorithms on the final data set and compared their performance in cross-subject RSVP detection.The results revealed that deep learning models can achieve excellent results with appropriate training methods when applied to cross-subject detection tasks.We discussed the limitations of existing deep learning algorithms in cross-subject RSVP detection and highlighted potential research directions.展开更多
As a new type of brain-computer interface(BCI),the rapid serial visual presentation(RSVP)paradigm has attracted significant attention.The mechanism of RSVP is detecting the P300 component corresponding to the target i...As a new type of brain-computer interface(BCI),the rapid serial visual presentation(RSVP)paradigm has attracted significant attention.The mechanism of RSVP is detecting the P300 component corresponding to the target image to realize fast and correct recognition.This paper proposed an improved EEGNet model to achieve good performance in offline and online data.Specifically,the data were filtered by xDAWN to enhance the signal-to-noise ratio of the electroencephalogram(EEG)signals.The focal loss function was used instead of the cross-entropy loss function to solve the classification problems of unbalanced samples.Additionally,the subject-specific data were fed to the improved EEGNet model to obtain a subject-specific model.We applied the proposed model at the BCI Controlled Robot Contest in World Robot Contest 2021 and won the second place.The average recall rate of the four participants reached 51.56%in triple classification.In the offline data benchmark dataset(64 subjects-RSVP tasks),the average recall rates of groups A and B reached 76.07%and 78.11%,respectively.We provided an alternative method to identify targets based on the RSVP paradigm.展开更多
Recently,rapid serial visual presentation(RSVP),as a new event-related potential(ERP)paradigm,has become one of the most popular forms in electroencephalogram signal processing technologies.Several improvement approac...Recently,rapid serial visual presentation(RSVP),as a new event-related potential(ERP)paradigm,has become one of the most popular forms in electroencephalogram signal processing technologies.Several improvement approaches have been proposed to improve the performance of RSVP analysis.In brain-computer interface systems based on RSVP,the family of approaches that do not depend on training specific parameters is essential.The participating teams proposed several effective training-free frameworks of algorithms in the ERP competition of the BCI Controlled Robot Contest in World Robot Contest 2021.This paper discusses the effectiveness of various approaches in improving the performance of the system without requiring training and suggests how to apply these approaches in a practical system.First,appropriate preprocessing techniques will greatly improve the results.Then,the non-deep learning algorithm may be more stable than the deep learning approach.Furthermore,ensemble learning can make the model more stable and robust.展开更多
In the fatigue state,the neural response characteristics of the brain might be different from those in the normal state.Brain functional connectivity analysis is an effective tool for distinguishing between different ...In the fatigue state,the neural response characteristics of the brain might be different from those in the normal state.Brain functional connectivity analysis is an effective tool for distinguishing between different brain states.For example,comparative studies on the brain functional connectivity have the potential to reveal the functional differences in different mental states.The purpose of this study was to explore the relationship between human mental states and brain control abilities by analyzing the effect of fatigue on the brain response connectivity.In particular,the phasescrambling method was used to generate images with two noise levels,while the N-back working memory task was used to induce the fatigue state in subjects.The paradigm of rapid serial visual presentation(RSVP)was used to present visual stimuli.The analysis of brain connections in the normal and fatigue states was conducted using the open-source e Connectome toolbox.The results demonstrated that the control areas of neural responses were mainly distributed in the parietal region in both the normal and fatigue states.Compared to the normal state,the brain connectivity power in the parietal region was significantly weakened under the fatigue state,which indicates that the control ability of the brain is reduced in the fatigue state.展开更多
基金supported by the National Natural Science Foundation of China(Nos.61601028 and 61431007)the National Key Research and Development Program of China(No.YFB1002505)+3 种基金the Key Research and Development Program of Guangdong Province(No.2018B030339001)the Beijing Science and Technology Program(No.Z201100004420015)the National Natural Science Foundation of China(No.U2241208)the Fundamental Research Funds for the Central Universities of China(No.FRF-TP-20-017A1).
文摘In this study,the effect of presentation rates on pupil dilation is investigated for target recognition in the Rapid Serial Visual Presentation(RSVP)paradigm.In this experiment,the RSVP paradigm with five different presentation rates,including 50,80,100,150,and 200 ms,is designed.The pupillometry data of 15 subjects are collected and analyzed.The pupillometry results reveal that the peak and average amplitudes for pupil size and velocity at the 80-ms presentation rate are considerably higher than those at other presentation rates.The average amplitude of pupil acceleration at the 80-ms presentation rate is significantly higher than those at the other presentation rates.The latencies under 50-and 80-ms presentation rates are considerably lower than those of 100-,150-,and 200-ms presentation rates.Additionally,no considerable differences are observed in the peak,average amplitude,and latency of pupil size,pupil velocity,and acceleration under 100-,150-,and 200-ms presentation rates.These results reveal that with the increase in the presentation rate,pupil dilation first increases,then decreases,and later reaches saturation.The 80-ms presentation rate results in the largest point of pupil dilation.No correlation is observed between pupil dilation and recognition accuracy under the five presentation rates.
基金the Special Projects in Key Fields Supported by the Technology Development Project of Guangdong Province(Grant No.2020ZDZX3018)the Special Fund for Science and Technology of Guangdong Province(Grant No.2020182)the Wuyi University and Hong Kong&Macao joint Research Project(Grant No.2019WGALH16)。
文摘The rapid serial visual presentation(RSVP)paradigm has garnered considerable attention in brain–computer interface(BCI)systems.Studies have focused on using cross-subject electroencephalogram data to train cross-subject RSVP detection models.In this study,we performed a comparative analysis of the top 5 deep learning algorithms used by various teams in the event-related potential competition of the BCI Controlled Robot Contest in World Robot Contest 2022.We evaluated these algorithms on the final data set and compared their performance in cross-subject RSVP detection.The results revealed that deep learning models can achieve excellent results with appropriate training methods when applied to cross-subject detection tasks.We discussed the limitations of existing deep learning algorithms in cross-subject RSVP detection and highlighted potential research directions.
基金This work is granted by the Special Projects in Key Fields Supported by the Technology Development Project of Guangdong Province(Grant No.2020ZDZX3018)the Special Fund for Science and Technology of Guangdong Province(Grant No.2020182)+2 种基金the Wuyi University and Hong Kong&Macao Joint Research Project(Grant No.2019WGALH16)the Guangdong Basic and Applied Basic Research Foundation(Grant No.2020A1515111154)the Characteristic Innovation Projects of Ordinary Universities in Guangdong Province(Grant No.2021KTSCX136).
文摘As a new type of brain-computer interface(BCI),the rapid serial visual presentation(RSVP)paradigm has attracted significant attention.The mechanism of RSVP is detecting the P300 component corresponding to the target image to realize fast and correct recognition.This paper proposed an improved EEGNet model to achieve good performance in offline and online data.Specifically,the data were filtered by xDAWN to enhance the signal-to-noise ratio of the electroencephalogram(EEG)signals.The focal loss function was used instead of the cross-entropy loss function to solve the classification problems of unbalanced samples.Additionally,the subject-specific data were fed to the improved EEGNet model to obtain a subject-specific model.We applied the proposed model at the BCI Controlled Robot Contest in World Robot Contest 2021 and won the second place.The average recall rate of the four participants reached 51.56%in triple classification.In the offline data benchmark dataset(64 subjects-RSVP tasks),the average recall rates of groups A and B reached 76.07%and 78.11%,respectively.We provided an alternative method to identify targets based on the RSVP paradigm.
基金This research was supported by the National Key Research and Development Program of China(Grant No.2021ZD0201303)the Technology Innovation Project of Hubei Province of China(Grant No.2019AEA171)the Hubei Province Funds for Distinguished Young Scholars(Grant No.2020CFA050).
文摘Recently,rapid serial visual presentation(RSVP),as a new event-related potential(ERP)paradigm,has become one of the most popular forms in electroencephalogram signal processing technologies.Several improvement approaches have been proposed to improve the performance of RSVP analysis.In brain-computer interface systems based on RSVP,the family of approaches that do not depend on training specific parameters is essential.The participating teams proposed several effective training-free frameworks of algorithms in the ERP competition of the BCI Controlled Robot Contest in World Robot Contest 2021.This paper discusses the effectiveness of various approaches in improving the performance of the system without requiring training and suggests how to apply these approaches in a practical system.First,appropriate preprocessing techniques will greatly improve the results.Then,the non-deep learning algorithm may be more stable than the deep learning approach.Furthermore,ensemble learning can make the model more stable and robust.
基金supported by the Key R&D Program of Guangdong Province,China(No.2018B030339001)National Key R&D Program of China(No.2017YFB1002505)National Natural Science Foundation of China(No.61431007)
文摘In the fatigue state,the neural response characteristics of the brain might be different from those in the normal state.Brain functional connectivity analysis is an effective tool for distinguishing between different brain states.For example,comparative studies on the brain functional connectivity have the potential to reveal the functional differences in different mental states.The purpose of this study was to explore the relationship between human mental states and brain control abilities by analyzing the effect of fatigue on the brain response connectivity.In particular,the phasescrambling method was used to generate images with two noise levels,while the N-back working memory task was used to induce the fatigue state in subjects.The paradigm of rapid serial visual presentation(RSVP)was used to present visual stimuli.The analysis of brain connections in the normal and fatigue states was conducted using the open-source e Connectome toolbox.The results demonstrated that the control areas of neural responses were mainly distributed in the parietal region in both the normal and fatigue states.Compared to the normal state,the brain connectivity power in the parietal region was significantly weakened under the fatigue state,which indicates that the control ability of the brain is reduced in the fatigue state.