期刊文献+

r-SVR中参数r与输入噪声间线性反比关系的仿真研究 被引量:3

Experimental Studies on Inversely Linear Dependency between r and the Input Noise in r-support Vector Regression
下载PDF
导出
摘要 为研究r范数-支持向量回归机,r-SVR的鲁棒性,验证r-SVR中参数r与输入噪声方差之间的近似反比线性关系,对r-SVR进行了仿真。推导出了作为仿真的依据的 r-SVR的解的形式和对其进行求解的牛顿迭代公式。仿真结果显示:输入噪声为高斯分布时,r-SVR中参数r与输入噪声方差之间存在近似线性反比关系;这一关系曲线随着信噪比增加而斜率减小、整个曲线下移。这一结果印证和丰富了现前的理论推导结果,为在已知输入高斯噪声方差时合理地选择r提供了更可信的依据。 When the distribution of the input noise is known, the optimal parameter choice for the loss function can help SVR enhance its robustness. R-loss function is a more general form of both quadratic loss function and Laplacian loss function. Therefore, research on the dependency relationship between parameter r in r-loss function and input noise has more general significance. It has been theoretically deduced that inversely linear dependency exists between r and the input noise in r-SVR. In this paper, we intend to validate the linear dependency between r and the input noise through studying its implementation method and simulations. We derive the solution of r-SVR by using the Newton descent method. Our experimental results confirm the previously obtained theoretical conclusion.
出处 《计算机科学》 CSCD 北大核心 2005年第9期205-207,238,共4页 Computer Science
基金 国家自然科学基金(60225015) 江苏省自然科学基金(BK2003017) 南京大学软件新技术国家重点实验室开放课题 江苏计算机技术重点实验室开放课题的资助
关键词 支持向量机 支持向量回归机 r范数损失函数 计算机仿真 输入噪声 鲁棒性 Support vector machines(SVM), Support vector regression(SVR), R-loss function, Simulations
  • 相关文献

参考文献11

  • 1Cristianini N,Shawe-Taylor J. An Introduction to Support Vector Machines[M]. Cambridge University Press, 2000
  • 2Vapnik V. Statistical Learning Theory[M]. New York: Wiley,1998
  • 3Kwok J T,Tsang I W. Linear dependency between ε and the input noise in ε-support vector regression[J]. IEEE Transaction on Neural Networks, 2003(5)
  • 4Smola A J, Murata N, Scholkopf B, Müller K-R. Asymptotically optimal choice of ε-loss for support vector machines[A]. In:Proc. of the Intl. Conf. on Artificial Neural Networks[C]. 1998
  • 5Smola A J,Scholkopf B. A tutotial on support vector regression. Royal Holloway College, 1998, NeuroCOLT2 Technical Report NC2-TR-1998-030
  • 6Law M H,Kwok J T. Bayesian support vector regression[A]. In:Proc. of the English Intl. Workshop on Artificial Intelligence and Statistics[C]. Florida:Key West, 2001. 239~244
  • 7Gao J B, Gunn S R, Ham's C J. A probabilistic framework for SVM regression and Error Bar Estimation[J]. Machine Learning, 2002,46:71~89
  • 8Cherkassky V, Ma Yunqian. Practical selection of SVM parame ters and noise estimation for SVM regression[J]. Neural Networks, in press, 2003
  • 9阎平凡 张长水.人工神经网络和模拟进化计算[M].北京:清华大学出版社,2001..
  • 10沈永欢.实用数学手册[M].北京:科学出版社,2002..

共引文献14

同被引文献13

  • 1朱嘉钢,王士同,杨静宇.鲁棒r-支持向量回归机中参数r的选择研究[J].控制与决策,2004,19(12):1383-1386. 被引量:12
  • 2Wang Shitong,Zhu Jiagang,Chung F L,et al.Theoretically optimal parameter choices for support vector regression machines Huber- SVR and Norm_r-SVR with noisy input[J].Soft Computing,2005,9 (10) :732-741.
  • 3Kennedy J,Eberhart R.Particle swarm optimization[C]//Proc IEEE International Conference on Neural Networks.Piscataway, NJ, USA, 1995,4:1942-1948.
  • 4Jinbo Bi,Bennett K P. A Geometric Approach to Support Vector Regression[ J]. Neurocomputing. 2003,55:79 108.
  • 5Cheng Soon Ong, Xavier Mary, Stephane Canu, et al. Learning with Non-Positive Kernels [ C ]//Proceedings of the 21 st International Conference on Machine Learning,Banff,Canada,2004.
  • 6Wang Shitong, Zhu Jiagang, Chung F L, et al. Theoretically optimal parameter choices for support vector regression machines Huber-SVR and Norm_r-SVR with noisy input[ J]. Soft Computing. 2005,9(10) :732 - 741.
  • 7操敏,王士同.基于SVR的灵敏度分析及参数阈值选取[J].微计算机信息,2007,23(03X):220-221. 被引量:1
  • 8阎平凡 张长水.人工神经网络和模拟进化计算[M].北京:清华大学出版社,2001..
  • 9Gao J B,Gunn S R,Ham's C J.A probabilistic framework for SVM regression and error bar estimation[J].Machine Learning,2002,46:71-89.
  • 10Kwok J T.The evidence framework applied to support vector machines[J].IEEE Transactions on Neural Networks,2000,11 (5):1162-1173.

引证文献3

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部