期刊文献+

基于统计检验的核函数度量方法研究 被引量:2

Statistical Testing Based Research on Kernel Evaluation Measures
下载PDF
导出
摘要 将统计检验方法应用于核函数度量。以核函数、规范化核函数、中心化核函数和核距离作为样本在特征空间中的几何关系度量,使用t检验和F检验等7种统计检验方法检验特征空间中同类样本间几何关系度量值与异类样本间几何关系度量值的分布差异,以此反映特征空间中同类样本间内聚性与异类样本间分离性间的差异。在11个UCI数据集上进行的核函数选择实验表明,基于统计检验的核度量方法达到或超过了核校准与特征空间核度量标准等方法的效果,适用于核函数度量;并且发现两类数据分布差异主要体现在了方差差异上。此外,对核函数的处理(规范化或中心化)会改变特征空间,使得度量结果失真。 This paper explored the research on evaluating kernel function by using statistical testing.By employing kernel,normalized kernel,centered kernel and kernel distance as geometric measure among samples in feature space,and applying 7statistical testing methods such as t-test and f-test,this paper evaluated the distributional difference between the geometric measures among samples from same classes and the geometric measure among samples from different classes.The experimental results of kernel selection on 11 UCI datasets show that the kernel evaluation measures based on statistical testing reach or exceed the performance of KTA and FSM,etc.And we found that the two types of data distribution differences are mainly reflected in the variance difference.Moreover,the formatting of kernel function such as normalization or centering can change the feature space,and make the evaluation distorted.
出处 《计算机科学》 CSCD 北大核心 2015年第4期199-205,共7页 Computer Science
基金 国家"十二五"科技支撑计划项目(2012BAH14F00)资助
关键词 核函数 核函数度量 统计检验 Kernel function Kernel evaluation Statistical testing
  • 相关文献

参考文献25

  • 1Schlkopf B,Smola A.Learning with Kernels[M].MIT Press,Cambridge,Massachusetts,2002.
  • 2Lanckriet G R G,Cristianini N,Bartlett P,et al.Learning thekernel matrix with semi-definite programming[J].Journal of Machine Learning Research,2004,5:27-72.
  • 3Chengqun Wang,Jiming Chen,Chonghai Hu,Youxian Sun.Kernel matrix learning with a general regularized risk functional criterion[J].Journal of Systems Engineering and Electronics,2010,21(1):72-80. 被引量:3
  • 4Girolami M,Rogers S.Hierarchic bayesian models for kernellearning[C]∥Proceedings of the 22nd international conference on machine learning.Bonn,Germany,2005:241-248.
  • 5Ong C S,Smola A J,Williamson R C.Learning the kernel with hyperkernels[J].Journal of Machine Learning Research,2005,6:1043-1071.
  • 6Yan Zhi-gang,Yang Yuan-xuan,Ding Yun-jing.An experimen-tal study of the hyper-parameters distribution region and its optimization method for support vector machine with gaussian kernel[J].International Journal of Signal Processing,Image Processing and Pattern Recognition,2013,6(5):437-446.
  • 7Cristianini N,Shawe-Taylor J,Elisseeff A,et al.On kernel-target alignment[J].Advances in Neural Information Processing Systems,2001,14:367-373.
  • 8Baram Y.Learning by kernel polarization[J].Neural Computation,2005,17:1264-1275.
  • 9Wang Ting-hua,Tian Sheng-feng,Huang Hou-kuan,et al.Learning by local kernel polarization[J].Neurocomputing,2009,72:3077-3084.
  • 10Nguyen C H,Ho Tu-bao.An efficient kernel matrix evaluation measure[J].Pattern Recognition,2008,41:3366-3372.

二级参考文献28

  • 1B.Scholkopf,A.Smola.Learning with kernels:support vector machines,regularization,optimization,and beyond.Cambridge,MA,USA:MIT Press,2001.
  • 2O.Chapelle,V.Vapnik,O.Bousquet,et al.Choosing multiple parameters for support vector machines.Machine Learning,2002,46 (1):131-159.
  • 3D.Meyer,E Leisch,K.Hornik.The support vector machine under test.Neurocomputing,2003,55 (1/2):169-186.
  • 4K.Duan,S.Keerthi,A.Poo.Evaluation of simple performance measures for tuning SVM hyperparameters.Neuroc'omputing,2003,51:41-59.
  • 5S.Lee.S.Cho.Smoothed bagging with kernel bandwidth selectors.Neural Processing Letters,2004,14 (2):157-168.
  • 6G.Lanckriet,N.Cristianini,P.Bartlett,et al.Learning the kernel matrix with semidefinite programming.The Journal of Machine Learning Research,2004,5:27-72.
  • 7J.Shawe-Taylor,N.Cristianini.Kernel methods for pattern analysis.Cambridge University Press,2004.
  • 8F.Bach,G.Lanckriet,Jordan M.Multiple kernel learning,conic duality,and the SMO algorithm.Proc.of the 21th International Conference on Machine Learning,2004.
  • 9J.Platt.Fast training of support vector machines using sequential minimal optimization.Advances in Kernel Methods:Support Vector Learning,1999.
  • 10S.Sonnenburg,G.RAatsch,C.SchAafer,et al.Large scale multiple kernel learning.The Journal of Machine Learning Research,2006,7:1531-1565.

共引文献2

同被引文献5

引证文献2

二级引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部