期刊文献+

FAST ALGORITHMS FOR HIGHER-ORDER SINGULAR VALUE DECOMPOSITION FROM INCOMPLETE DATA 被引量:1

FAST ALGORITHMS FOR HIGHER-ORDER SINGULAR VALUE DECOMPOSITION FROM INCOMPLETE DATA
原文传递
导出
摘要 Higher-order singular value decomposition (HOSVD) is an efficient way for data reduction and also eliciting intrinsic structure of multi-dimensional array data. It has been used in many applications, and some of them involve incomplete data. To obtain HOSVD of the data with missing values, one can first impute the missing entries through a certain tensor completion method and then perform HOSVD to the reconstructed data. However, the two-step procedure can be inefficient and does not make reliable decomposition. In this paper, we formulate an incomplete HOSVD problem and combine the two steps into solving a single optimization problem, which simultaneously achieves imputation of missing values and also tensor decomposition. We also present one algorithm for solving the problem based on block coordinate update (BCU). Global convergence of the algorithm is shown under mild assumptions and implies that of the popular higher-order orthogonality iteration (HOOI) method, and thus we, for the first time, give global convergence of HOOI. In addition, we compare the proposed method to state-of-the-art ones for solving incom- plete HOSVD and also low-rank tensor completion problems and demonstrate the superior performance of our method over other compared ones. Furthermore, we apply it to face recognition and MRI image reconstruction to show its practical performance. Higher-order singular value decomposition (HOSVD) is an efficient way for data reduction and also eliciting intrinsic structure of multi-dimensional array data. It has been used in many applications, and some of them involve incomplete data. To obtain HOSVD of the data with missing values, one can first impute the missing entries through a certain tensor completion method and then perform HOSVD to the reconstructed data. However, the two-step procedure can be inefficient and does not make reliable decomposition. In this paper, we formulate an incomplete HOSVD problem and combine the two steps into solving a single optimization problem, which simultaneously achieves imputation of missing values and also tensor decomposition. We also present one algorithm for solving the problem based on block coordinate update (BCU). Global convergence of the algorithm is shown under mild assumptions and implies that of the popular higher-order orthogonality iteration (HOOI) method, and thus we, for the first time, give global convergence of HOOI. In addition, we compare the proposed method to state-of-the-art ones for solving incom- plete HOSVD and also low-rank tensor completion problems and demonstrate the superior performance of our method over other compared ones. Furthermore, we apply it to face recognition and MRI image reconstruction to show its practical performance.
作者 Yangyang Xu
出处 《Journal of Computational Mathematics》 SCIE CSCD 2017年第4期397-422,共26页 计算数学(英文)
关键词 multilinear data analysis higher-order singular value decomposition (HOSVD) low-rank tensor completion non-convex optimization higher-order orthogonality iteration(HOOI) global convergence. multilinear data analysis, higher-order singular value decomposition (HOSVD),low-rank tensor completion, non-convex optimization, higher-order orthogonality iteration(HOOI), global convergence.
分类号 O [理学]
  • 相关文献

参考文献1

二级参考文献34

  • 1Berry M W,Browne M,Langville A N,Pauca V P Plemmons R J. Algorithms andapplications for approximate nonnegative matrix factorization[J].Computational Statistics and Data Analysis,2007,(01):155-173.
  • 2Bertsekas D P,Tsitsiklis J N. Parallel and Distributed Computation: Numerical Methods[M].Upper Saddle River:Prentice-Hall,Inc,1989.
  • 3Biswas P,Lian T C,Wang T C,Ye Y. Semidefinite programming based algorithms for sensor network (l)ocalization[J].ACM Transactions on Sensor Networks,2006,(02):188-220.
  • 4Cai J F,Candes E J,Shen Z. A singular value thresholding algorithm for matrix completion export[J].SIAM Journal on Optimization,2010.1956-1982.
  • 5Candès E J,Li X,Ma Y,Wright J. Robust principal component analysis[J].Journal of the ACM,2011,(03):11.
  • 6Candès E J,Recht B. Exact matrix completion via convex optimization[J].Foundations of Computational Mathematics,2009,(06):717-772.doi:10.1007/s10208-009-9045-5.
  • 7Candès E J,Tao T. The power of convex relaxation:Near-optimal matrix completion[J].IEEE Transactions on Information theory,2010,(05):2053-2080.
  • 8Cichocki A,Morup M,Smaragdis P,Wang W,Zdunek R. Advances in Nonnegative Matrix and Tensor Factorization[A].New York:Hindawi Publishing Corporation,2008.
  • 9Cichocki A,Zdunek R,Phan A H,Amari S. Nonnegative Matrix and Tensor Factorizations—Applications to Exploratory Multiway Data Analysis and Blind Source Separation[M].Hoboken:John Wiley & Sons,Ltd,2009.
  • 10Fazel M. Matrix Rank Minimization with Applications[D].Stanford University,2002.

共引文献22

同被引文献10

引证文献1

二级引证文献4

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部