本文研究一类低秩矩阵优化问题,其中惩罚项为目标矩阵奇异值的l_(p)(0<p<1)正则函数.基于半阈值函数在稀疏/低秩恢复问题中的良好性能,本文提出奇异值半阈值(singular value half thresholding,SVHT)算法来求解l_(p)正则矩阵优化...本文研究一类低秩矩阵优化问题,其中惩罚项为目标矩阵奇异值的l_(p)(0<p<1)正则函数.基于半阈值函数在稀疏/低秩恢复问题中的良好性能,本文提出奇异值半阈值(singular value half thresholding,SVHT)算法来求解l_(p)正则矩阵优化问题.SVHT算法的主要迭代利用了子问题的闭式解,但与现有算法不同,其本质上是对目标函数在当前点进行局部1/2近似,而不是局部线性或局部二次近似.通过构造目标函数的Lipschitz和非Lipschitz近似函数,本文证明了SVHT算法生成序列的任意聚点都是问题的一阶稳定点.在数值实验中,利用模拟数据和实际图像数据的低秩矩阵补全问题对SVHT算法进行测试.大量的数值结果表明,SVHT算法对低秩矩阵优化问题在速度、精度和鲁棒性等方面都表现优异.展开更多
Regularized minimization problems with nonconvex, nonsmooth, even non-Lipschitz penalty functions have attracted much attention in recent years, owing to their wide applications in statistics, control,system identific...Regularized minimization problems with nonconvex, nonsmooth, even non-Lipschitz penalty functions have attracted much attention in recent years, owing to their wide applications in statistics, control,system identification and machine learning. In this paper, the non-Lipschitz ?_p(0 < p < 1) regularized matrix minimization problem is studied. A global necessary optimality condition for this non-Lipschitz optimization problem is firstly obtained, specifically, the global optimal solutions for the problem are fixed points of the so-called p-thresholding operator which is matrix-valued and set-valued. Then a fixed point iterative scheme for the non-Lipschitz model is proposed, and the convergence analysis is also addressed in detail. Moreover,some acceleration techniques are adopted to improve the performance of this algorithm. The effectiveness of the proposed p-thresholding fixed point continuation(p-FPC) algorithm is demonstrated by numerical experiments on randomly generated and real matrix completion problems.展开更多
文摘本文研究一类低秩矩阵优化问题,其中惩罚项为目标矩阵奇异值的l_(p)(0<p<1)正则函数.基于半阈值函数在稀疏/低秩恢复问题中的良好性能,本文提出奇异值半阈值(singular value half thresholding,SVHT)算法来求解l_(p)正则矩阵优化问题.SVHT算法的主要迭代利用了子问题的闭式解,但与现有算法不同,其本质上是对目标函数在当前点进行局部1/2近似,而不是局部线性或局部二次近似.通过构造目标函数的Lipschitz和非Lipschitz近似函数,本文证明了SVHT算法生成序列的任意聚点都是问题的一阶稳定点.在数值实验中,利用模拟数据和实际图像数据的低秩矩阵补全问题对SVHT算法进行测试.大量的数值结果表明,SVHT算法对低秩矩阵优化问题在速度、精度和鲁棒性等方面都表现优异.
基金supported by National Natural Science Foundation of China(Grant Nos.11401124 and 71271021)the Scientific Research Projects for the Introduced Talents of Guizhou University(Grant No.201343)the Key Program of National Natural Science Foundation of China(Grant No.11431002)
文摘Regularized minimization problems with nonconvex, nonsmooth, even non-Lipschitz penalty functions have attracted much attention in recent years, owing to their wide applications in statistics, control,system identification and machine learning. In this paper, the non-Lipschitz ?_p(0 < p < 1) regularized matrix minimization problem is studied. A global necessary optimality condition for this non-Lipschitz optimization problem is firstly obtained, specifically, the global optimal solutions for the problem are fixed points of the so-called p-thresholding operator which is matrix-valued and set-valued. Then a fixed point iterative scheme for the non-Lipschitz model is proposed, and the convergence analysis is also addressed in detail. Moreover,some acceleration techniques are adopted to improve the performance of this algorithm. The effectiveness of the proposed p-thresholding fixed point continuation(p-FPC) algorithm is demonstrated by numerical experiments on randomly generated and real matrix completion problems.
