期刊文献+

联合L1范数和迹范数的数据降维模型及其优化算法

Dimension Reduction Model via Joint L1-trace Norms and Optimization Algorithm
下载PDF
导出
摘要 主成分分析(PCA)是多元分析中广泛应用的降维方法,但是传统的降维模型一般是基于矩阵的秩,然而秩的计算是非凸、不连续的问题且计算复杂。本文针对这一问题,提出联合更具鲁棒性的L1范数和具有凸性的迹范数建立一种联合数据降维模型,针对模型的优化提出基于拉格朗日乘子的优化算法。最后将模型应用于UCI数据集以及Yale人脸数据集和扩展Yale B人脸数据集进行数据处理。数学分析和可视化实验结果都表明模型和优化算法是有效的。 Principal component analysis (PCA) is widely used in multivariate analysis for dimension reduction. Traditional data dimension reduction is generally based on the rank of the matrix, and the rank calculation is non-convex and discrete issues is complex. In order to solve this problem, the paper proposed the model based on a robust formulation using L1 norm together with trace norm. The paper derived an efficient ALM algorithm for nonlinear optimization and applied it in UCI data sets and some image data sets against noises. Both mathematical analysis and visual results show the efficiency and good performance of the proposed method.
出处 《铁道学报》 EI CAS CSCD 北大核心 2013年第5期69-74,共6页 Journal of the China Railway Society
基金 国家科技支撑计划(2012BAH08B00) 湖南省自然科学基金(12JJ3074)
关键词 主成分分析 L1范数 迹范数 数据降维 拉格朗日乘子 principal component analysis L1 norm trace norm dimension reduction augmented lagrange multiplier(ALM)
  • 相关文献

参考文献16

  • 1JOLLIFFE I T. Principal Component Analysis[M]. 2nd ed. New York: Springer, 2002:1-6.
  • 2YU H, YANG J. A Direct LDA Algorithm for High-dimensional Data with Application to Face Recognition[J]. Pattern Recognition, 2001,34 (10) : 2067-2069.
  • 3MARTINEZ A M, KAK A C. PCA Versus LDA[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001,23(2) : 228-233.
  • 4LEE D D,SEUNG H S. Algorithms for Non-negative Matrix Factorization[J]. Advances in Neural Information Processing Systems, 2001,13: 556-562.
  • 5TAO L, CHRIS D. The Relationships Among Various Nonnegative Matrix Factorization Methods for Clustering [C]//Proceedings of the 6th IEEE International Conference on Data Mining (ICDM 2006). New York, IEEE Press, 2006 : 362-371.
  • 6TENENBAUM J B, SILVA V D, LANGFORD J C. A Global Geometric Framework for Nonlinear Mensionality Reduction[J]. Science, 2000,290:2319-2323.
  • 7BERNHARD S, ALEXANDER S, KLAUS R M. Nonlinear Component Analysis as a Kernel Eigenvalue Problem [J]. Neural Computation, 1998,5 (10) : 1299-1319.
  • 8ROWEIS S, SAUL L. Nonlinear Dimensionality Reduction by Locally Linear Embedding[J]. Science, 2000,290: 2323- 2326.
  • 9ZHANG Z, ZHA Z. Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space Alignment [J].SIAM Journal on Scientific Computing , 2005,26 (1) : 313- 338.
  • 10THIRION B, FAUGERAS O. Nonlinear Dimension Reduction of MRI Data: the Laplacian Embedding Approach [C]//Proceedings of IEEE International Symposium on Biomedical Imaging: Nano to Macro. Washington, DC: IEEE Press ,2004: 372-375.

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部