TY - JOUR
T1 - Low-Rank Approximation via Generalized Reweighted Iterative Nuclear and Frobenius Norms
AU - Huang, Yan
AU - Liao, Guisheng
AU - Xiang, Yijian
AU - Zhang, Lei
AU - Li, Jie
AU - Nehorai, Arye
N1 - Funding Information:
Manuscript received March 19, 2019; revised August 18, 2019 and October 4, 2019; accepted October 16, 2019. Date of publication October 30, 2019; date of current version January 10, 2020. This work was supported in part by the National Natural Science Foundation of China under Grant 61901112, Grant 61771372, Grant 61801297, and Grant 61701106, in part by the Natural Science Foundation of Jiangsu Province under Grant BK20190330 and GrantBK20170698, and in part by the Shenzhen University under Grant 2019119. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Hitoshi Kiya. (Corresponding authors: Yan Huang; Lei Zhang.) Y. Huang is with the State Key Laboratory of Millimeter Waves, School of Information Science and Engineering, Southeast University, Nanjing 210096, China, and also with the Purple Mountain Laboratory, Nanjing 211100, China (e-mail:yellowstone0636@hotmail.com).
Publisher Copyright:
© 1992-2012 IEEE.
PY - 2020
Y1 - 2020
N2 - The low-rank approximation problem has recently attracted wide concern due to its excellent performance in real-world applications such as image restoration, traffic monitoring, and face recognition. Compared with the classic nuclear norm, the Schatten- ${p}$ norm is stated to be a closer approximation to restrain the singular values for practical applications in the real world. However, Schatten- ${p}$ norm minimization is a challenging non-convex, non-smooth, and non-Lipschitz problem. In this paper, inspired by the reweighted ell _{1}$ and ell _{2}$ norm for compressive sensing, the generalized iterative reweighted nuclear norm (GIRNN) and the generalized iterative reweighted Frobenius norm (GIRFN) algorithms are proposed to approximate Schatten- ${p}$ norm minimization. By involving the proposed algorithms, the problem becomes more tractable and the closed solutions are derived from the iteratively reweighted subproblems. In addition, we prove that both proposed algorithms converge at a linear rate to a bounded optimum. Numerical experiments for the practical matrix completion (MC), robust principal component analysis (RPCA), and image decomposition problems are illustrated to validate the superior performance of both algorithms over some common state-of-the-art methods.
AB - The low-rank approximation problem has recently attracted wide concern due to its excellent performance in real-world applications such as image restoration, traffic monitoring, and face recognition. Compared with the classic nuclear norm, the Schatten- ${p}$ norm is stated to be a closer approximation to restrain the singular values for practical applications in the real world. However, Schatten- ${p}$ norm minimization is a challenging non-convex, non-smooth, and non-Lipschitz problem. In this paper, inspired by the reweighted ell _{1}$ and ell _{2}$ norm for compressive sensing, the generalized iterative reweighted nuclear norm (GIRNN) and the generalized iterative reweighted Frobenius norm (GIRFN) algorithms are proposed to approximate Schatten- ${p}$ norm minimization. By involving the proposed algorithms, the problem becomes more tractable and the closed solutions are derived from the iteratively reweighted subproblems. In addition, we prove that both proposed algorithms converge at a linear rate to a bounded optimum. Numerical experiments for the practical matrix completion (MC), robust principal component analysis (RPCA), and image decomposition problems are illustrated to validate the superior performance of both algorithms over some common state-of-the-art methods.
KW - generalized iterative reweighted Frobenius norm (GIRFN)
KW - generalized iterative reweighted nuclear norm (GIRNN)
KW - image decomposition
KW - Low-rank approximation problem
KW - matrix completion (MC)
KW - robust principal component analysis (RPCA)
UR - http://www.scopus.com/inward/record.url?scp=85078276390&partnerID=8YFLogxK
U2 - 10.1109/TIP.2019.2949383
DO - 10.1109/TIP.2019.2949383
M3 - Article
AN - SCOPUS:85078276390
SN - 1057-7149
VL - 29
SP - 2244
EP - 2257
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
M1 - 8887531
ER -