期刊文献+

最大规范化依赖性多标记半监督学习方法 被引量:4

Normalized Dependence Maximization Multi-label Semi-supervised Learning Method
下载PDF
导出
摘要 针对现有多标记学习方法大多属于有监督学习方法,而不能有效利用相对便宜且容易获得的大量未标记样本的问题,本文提出了一种新的多标记半监督学习方法,称为最大规范化依赖性多标记半监督学习方法 (Normalized dependence maximization multi-label semi-supervised learning method).该方法将已有标签作为约束条件,利用所有样本,包括已标记和未标记样本,对特征集和标签集的规范化依赖性进行估计,并以该估计值的最大化为目标,最终通过求解带边界的迹比值问题为未标记样本打上标签.与其他经典多标记学习方法在多个真实多标记数据集上的对比实验表明,本文方法可以有效从已标记和未标记样本中学习,尤其是已标记样本相对稀少时,学习效果得到了显著提高. In view of the problems that most of present multi-label learning methods are supervised learning methods and cannot effectively make use of relatively inexpensive and easily obtained large number of unlabeled samples, this paper puts forward a new multi-label semi-supervised learning method, called normalized dependence maximization multi-label semi-supervised learning method(DMMS). The DMMS regards labeled samples as constraint conditions, estimates the normalized dependency of feature and label sets on all samples including labeled and unlabeled samples, and maximizes the estimation by finally addressing a trace ratio optimization problem with constraint conditions for label unlabeled samples. Experiments comparing DMMS with the state-of-the-art multi-label learning approaches on several real-world datasets show that the DMMS can effectively learn from labeled and unlabeled samples, especially when the labeled is relatively rare, the learning performance can be improved greatly.
出处 《自动化学报》 EI CSCD 北大核心 2015年第9期1577-1588,共12页 Acta Automatica Sinica
基金 国家自然科学基金(11261015) 海南省高等学校科学研究项目(Hjkj2012-01)资助~~
关键词 规范化依赖性 多标记学习 半监督学习 迹比值 Normalized dependence multi-label learning semi-supervised learning trace ratio
  • 相关文献

参考文献30

  • 1Tsoumakas G, Ioannis K, Ioannis V. Mining multi-label data. Data Mining and Knowledge Discovery Handbook. Berlin: Springer-Verlag, 2010. 667-685.
  • 2Zhang M L, Zhou Z H. A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering, 2014, 26(8): 1819-1837.
  • 3Read J, Pfahringer B, Holmes G, Frank E. Classifier chains for multi-label classification. Machine Learning, 2011, 85(3): 333-359.
  • 4Tsoumakas G, Katakis I, Vlahavas I. Random k-labelsets for multi-label classification. IEEE Transactions on Knowledge and Data Engineering, 2011, 23(7): 1079-1089.
  • 5Tsoumakas G, Vlahavas I. Random k-labelsets: an ensemble method for multilabel classification. In: Proceedings of the 18th European Conference on Machine Learning. Warsaw, Poland: Springer, 2007. 406-417.
  • 6Zhang M L, Zhou Z H. A k-nearest neighbor based algorithm for multi-label classification. In: Proceedings of the 2005 IEEE International Conference on Granular Computing. New York, USA: IEEE, 2005. 718-721.
  • 7Elisseeff A, Weston J. A kernel method for multi-labelled classification. In: Proceedings of Advances in Neural Information Processing Systems. Cambridge, Massachusetts, USA: MIT Press, 2001. 681-687.
  • 8Zha Z J, Mei T, Wang J D, Wang Z F, Hua X S. Graph-based semi-supervised learning with multiple labels. Journal of Visual Communication and Image Representation, 2009, 20(2): 97-103.
  • 9Chen G, Song Y Q, Wang F, Zhang C S. Semi-supervised multi-label learning by solving a Sylvester equation. In: Proceedings of the 2008 SIAM International Conference on Data Mining. Atlanta, USA: Curran Associates, 2008. 410-419.
  • 10李宇峰,黄圣君,周志华.一种基于正则化的半监督多标记学习方法[J].计算机研究与发展,2012,49(6):1272-1278. 被引量:18

二级参考文献25

  • 1McCallum A. Multi-label text classification with a mixture model trained by EM [C]//Proe of the 14th National Conf on Artificial Intelligence Workshop on Text Learning. Menlo Park: AAAI, 1999:1-7.
  • 2Schapire R E, Singer Y. Boostexter: A boosting-based system for text categorization [J]. Machine Learning, 2000, 39(213): 135-168.
  • 3Elisseeff A, Weston J. A kernel method for multi-labelled classification [C] //Advances in Neural Information Processing Systems 14. Cambridge, MA: MIT Press, 2002: 681-687.
  • 4Boutell M R, Luo Jiebo, Shen Xipeng, et al. Learning multi- label scene classification [J]. Pattern Recognition, 2004, 37 (9) : 1757-1771.
  • 5Liu Yi, Jin Rong, Yang Liu. Semi-supervised multi-label learning by constrained non-negative matrix faetorization [C] //Proc of the 21st National Conf on Artificial Intelligence. Menlo Park: AAAI, 2006:421-426.
  • 6Chen Gang, Song Yangqiu, Wang Fei, et al. Semi- supervised multi-label learning by Solving a Sylvester equation[C]//Proe of SIAM Int Conf on Data Mining. Los Alamitos, CA: IEEE Computer Society, 2008: 410-419.
  • 7Sun Yuyin, Zhang Yin, Zhou Zhihua. Multi-label learning with weak label [C]//Proe of the 24th AAAI Conf on Artificial Intelligence. Menlo Park: AAAI, 2010:593-598.
  • 8Joachims T. Text categorization with support vector machines: Learning with many relevant features [C] //Proc of the 10th European Conf on Machine Learning. Berlin: Springer, 1998:137-142.
  • 9Brinker K, Ftiurnkranz J, Hullermeier E. A unified model for multilabel classification and ranking [C] //Prof of the 17th European Conf on Artificial Intelligence. Amsterdam, Netherlands: IOS, 2006:489-493.
  • 10Brinker K, Hullermeier E. Case-based multilabel ranking [C] //Proc of the 20th Int Joint Conf on Artificial Intelligence. San Francisco: Morgan KaMmann, 2007: 702- 707.

共引文献17

同被引文献46

  • 1刘涛,吴功宜,陈正.一种高效的用于文本聚类的无监督特征选择算法[J].计算机研究与发展,2005,42(3):381-386. 被引量:37
  • 2Zhang Y, Zhou Z H. Multi-label dimensionality reduction via dependence maximization. In:Proceedings of the 23rd AAAI Conference on Artificial Intelligence. Chicago, USA:AAAI Press, 2008. 1503-1505.
  • 3Zhang M L, Zhang K. Multi-label learning by exploiting label dependency. In:Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. Washington, USA:ACM, 2010. 999-1008.
  • 4Hariharan B, Zelnik-Manor L, Vishwanathan S V N, Varma M. Large scale max-margin multi-label classification with priors. In:Proceedings of the 27th International Conference on Machine Learning. Haifa, Israel:Omnipress, 2010. 423-430.
  • 5Elisseeff A, Weston J. A kernel method for multi-labelled classification. In:Proleedings of the 2001 Advances in Neural Information Processing Systems 14. British Columbia, Canada:MIT Press, 2001. 681-687.
  • 6Sun L, Ji S W, Ye J P. Hypergraph spectral learning for multi-label classification. In:Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Las Vegas, USA:ACM, 2008. 668-676.
  • 7Zhang M L, Zhou Z H. A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering, 2014, 26(8):1819-1837.
  • 8Gibaja E, Ventura S. A tutorial on multi-label learning. ACM Computing Surveys, 2015, 47(3):Article No. 52.
  • 9Boutell M R, Luo J B, Shen X P, Brown C M. Learning multi-label scene classification. Pattern Recognition, 2004, 37(9):1757-1771.
  • 10Sun L, Ji S W, Ye J P. Multi-label Dimensionality Reduction. Britain:Chapman and Hall/CRC Press, 2013. 34-49.

引证文献4

二级引证文献29

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部