期刊文献+

结合Copula理论与贝叶斯决策理论的分类算法 被引量:1

Classification algorithm based on Copula theory and Bayesian decision theory
下载PDF
导出
摘要 传统的贝叶斯决策分类算法易受类条件概率密度函数估计的影响,可能会对分类结果造成干扰。对此本文提出来一种改进的贝叶斯决策分类算法,即Bayesian-Copula判别分类器(BCDC)。该方法无需对类条件概率密度函数的形式进行假设,而是将Copula理论和核密度估计相结合进行函数构建,利用核密度估计平滑特征的概率分布,概率积分变换将特征的累计概率分布转化为均匀分布,Copula函数构建2个类别的边缘累积分布之间的相关性。随后,用极大似然估计方法确定Copula函数的参数,贝叶斯信息准则(BIC)用于选择最合适的Copula函数。通过生物电信号的仿真实验进行模型验证,结果表明相比传统的概率模型,提出的分类算法在分类精度和AUC两个性能指标上表现较好,鲁棒性更强,说明了BCDC模型充分利用Copula理论和核密度估计的优点,提高了估计的准确性和灵活性。 Traditional Bayesian decision classification algorithm is easily affected by the estimation of class-conditional probability densities,a fact that may result in incorrect classification results. Therefore,this paper proposes an improved classification algorithm based on Bayesian decision,i. e.,Bayesian-Copula Discriminant Classifier( BCDC). This method constructs class-conditional probability densities by combining Copula theory and kernel density estimation instead of making assumptions on the form of class-conditional probability densities. Kernel density estimation is used to smooth the probability distribution of each feature. By performing probability integral transform,continuous distribution is converted to random variables having a uniform distribution. Then,Copula functions are used to construct the dependency structure between these probability distributions for two categories. Moreover,the maximum likelihood estimation is applied to determine the parameters of Copula functions,and two wellfitted Copula functions for two categories are selected based on Bayesian information criterion. The BCDC method was validated with experimental datasets of physiological signals. The obtained results showed that the proposed method outperforms other traditional methods in terms of classification accuracy and AUC as well as robustness. Moreover,it takes full advantage of Copula theory and kernel density estimation and improves the accuracy and flexibility of the estimation.
出处 《智能系统学报》 CSCD 北大核心 2016年第1期78-83,共6页 CAAI Transactions on Intelligent Systems
基金 上海市科委科技创新行动计划-生物医药领域产学研医合作资助项目(12DZ1940903)
关键词 机器学习 贝叶斯决策理论 COPULA理论 核密度估计 生物电信号 machine learning Bayesian decision theory Copula theory kernel density estimation physiological signals
  • 相关文献

参考文献1

二级参考文献22

  • 1Zhu X J,Kandola J,Ghahramani Z,Laffert J.Nonparametric transforms of graph kernels for semi-supervised learning.In:Proceedings of the Conference on Advances in Neural Information Processing Systems.Cambridge,USA:MIT Press,2005.1641-1648
  • 2Chapelle O,Weston J,Scholkopf B.Cluster kernels for semisupervised learning.In:Proceedings of the Conference on Advances in Neural Information Processing Systems.Cambridge,USA:MIT Press,2002.585-592
  • 3Kondor R I,Lafferty J D.Diffusion kernels on graphs and other discrete input spaces.In:Proceedings of the 19th International Conference on Machine Learning.San Francisco,USA:Morgan Kaufmann Publishers,2002.315-322
  • 4Zhu X J,Ghahramani Z,Lafferty J D.Semi-supervised learning using Gaussian fields and harmonic functions.In:Proceedings of the 20th International Conference on Machine Learning.Washington D.C.,USA:MIT Press,2003.912-919
  • 5Sindhwani V,Niyogi P,Belkin M.Beyond the point cloud:from transductive to semi-supervised learning.In:Proceedings of the 22nd International Conference on Machine Learning.Bonn,Germany:MIT Press,2005.824-831
  • 6Sindhwani V,Chu W,Keerthi S S.Semi-supervised Gaussian processes classifiers.In:Proceedings of the International Joint Conference on Artificial Intelligence.San Francisco,USA:Morgan Kaufmann Publishers,2007.1059-1064
  • 7Kimeldorf G S,Wahba G.Some results on Tchebycheffian spline functions.Journal of Mathematical Analysis and Applications,1971,33(1):82-95
  • 8Cristianini N,Shawe-Taylor J,Elisseeff A,Kandola J.On kernel-target alignment.In:Proceedings of the Conference on Advances in Neural Information Processing Systems.Cambridge,USA:MIT Press,2002.367-373
  • 9Lanckriet G R G,Cristianini N,Bartlett P,Ghaoui L E,Jordan M I.Learning the kernel matrix with semidefinite programming.The Journal of Machine Learning Research,2004,5:27-72
  • 10Minka T P.A Family of Algorithms for Approximate Bayesian Inference[Ph.D.dissertation],Massachusetts Institute of Technology,USA,2001

共引文献6

同被引文献3

引证文献1

二级引证文献2

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部