To improve the recognition performance of video human actions,an approach that models the video actions in a hierarchical way is proposed. This hierarchical model summarizes the action contents with different spatio-t...To improve the recognition performance of video human actions,an approach that models the video actions in a hierarchical way is proposed. This hierarchical model summarizes the action contents with different spatio-temporal domains according to the properties of human body movement.First,the temporal gradient combined with the constraint of coherent motion pattern is utilized to extract stable and dense motion features that are viewed as point features,then the mean-shift clustering algorithm with the adaptive scale kernel is used to label these features.After pooling the features with the same label to generate part-based representation,the visual word responses within one large scale volume are collected as video object representation.On the benchmark KTH（Kungliga Tekniska H？gskolan）and UCF （University of Central Florida）-sports action datasets,the experimental results show that the proposed method enhances the representative and discriminative power of action features, and improves recognition rates.Compared with other related literature,the proposed method obtains superior performance.展开更多
Classifying single-trial electroencephalogram(EEG)based motor imagery(MI)tasks is extensively used to control brain-computer interface(BCI)applications,as a communication bridge between humans and computers.However,th...Classifying single-trial electroencephalogram(EEG)based motor imagery(MI)tasks is extensively used to control brain-computer interface(BCI)applications,as a communication bridge between humans and computers.However,the low signal-to-noise ratio and individual differences of EEG can affect the classification results negatively.In this paper,we propose an improved common spatial pattern(B-CSP)method to extract features for alleviating these adverse effects.First,for different subjects,the method of Bhattacharyya distance is used to select the optimal frequency band of each electrode including strong event-related desynchronization(ERD)and event-related synchronization(ERS)patterns;then the signals of the optimal frequency band are decomposed into spatial patterns,and the features that can describe the maximum differences of two classes of MI are extracted from the EEG data.The proposed method is applied to the public data set and experimental data set to extract features which are input into a back propagation neural network(BPNN)classifier to classify single-trial MI EEG.Another two conventional feature extraction methods,original common spatial pattern(CSP)and autoregressive(AR),are used for comparison.An improved classification performance for both data sets(public data set:91.25%±1.77%for left hand vs.foot and84.50%±5.42%for left hand vs.right hand;experimental data set:90.43%±4.26%for left hand vs.foot)verifies the advantages of the B-CSP method over conventional methods.The results demonstrate that our proposed B-CSP method can classify EEG-based MI tasks effectively,and this study provides practical and theoretical approaches to BCI applications.展开更多
基金The National Natural Science Foundation of China(No.60971098,61201345)
文摘To improve the recognition performance of video human actions,an approach that models the video actions in a hierarchical way is proposed. This hierarchical model summarizes the action contents with different spatio-temporal domains according to the properties of human body movement.First,the temporal gradient combined with the constraint of coherent motion pattern is utilized to extract stable and dense motion features that are viewed as point features,then the mean-shift clustering algorithm with the adaptive scale kernel is used to label these features.After pooling the features with the same label to generate part-based representation,the visual word responses within one large scale volume are collected as video object representation.On the benchmark KTH（Kungliga Tekniska H？gskolan）and UCF （University of Central Florida）-sports action datasets,the experimental results show that the proposed method enhances the representative and discriminative power of action features, and improves recognition rates.Compared with other related literature,the proposed method obtains superior performance.
基金Project supported by the National Natural Science Foundation of China(Nos.61702454 and 61772468)the MOE Project of Humanities and Social Sciences,China(No.17YJC870018)+1 种基金the Fundamental Research Funds for the Provincial Universities of Zhejiang Province,China(No.GB201901006)the Philosophy and Social Science Planning Fund Project of Zhejiang Province,China(No.20NDQN260YB)
文摘Classifying single-trial electroencephalogram(EEG)based motor imagery(MI)tasks is extensively used to control brain-computer interface(BCI)applications,as a communication bridge between humans and computers.However,the low signal-to-noise ratio and individual differences of EEG can affect the classification results negatively.In this paper,we propose an improved common spatial pattern(B-CSP)method to extract features for alleviating these adverse effects.First,for different subjects,the method of Bhattacharyya distance is used to select the optimal frequency band of each electrode including strong event-related desynchronization(ERD)and event-related synchronization(ERS)patterns;then the signals of the optimal frequency band are decomposed into spatial patterns,and the features that can describe the maximum differences of two classes of MI are extracted from the EEG data.The proposed method is applied to the public data set and experimental data set to extract features which are input into a back propagation neural network(BPNN)classifier to classify single-trial MI EEG.Another two conventional feature extraction methods,original common spatial pattern(CSP)and autoregressive(AR),are used for comparison.An improved classification performance for both data sets(public data set:91.25%±1.77%for left hand vs.foot and84.50%±5.42%for left hand vs.right hand;experimental data set:90.43%±4.26%for left hand vs.foot)verifies the advantages of the B-CSP method over conventional methods.The results demonstrate that our proposed B-CSP method can classify EEG-based MI tasks effectively,and this study provides practical and theoretical approaches to BCI applications.
