an overview of low-rank matrix recovery from incomplete observations

Contents

This paper reviews the techniques for recovering low-rank matrix from a small number of observations. In detail, the authors demonstrated the theories and algorithems for low-rank recovery, matrix completion, nonlinear observation models and some models that can be lifted to low-rank recovery.

1 Low-Rank Matrix Recovery

We are going to recover a low-rank matrix $X_0 in R^{M times N}$ from incomplete linear measurements $y in R^{L}$. The model can be expressed as follows:
$$
min rank(X) ~~ s.t. ~~y=mathcal{A}(X),
$$
where $mathcal{A} : R^{Mtimes N} to R^{L}$ is a linear measurements.

After convex relaxation, the problem becomes
$$
min ||X||_{*} ~~ s.t. ~~y=mathcal{A}(X),
$$

For Gaussian $mathcal{A}$ , the analysis is elegent and clean. There are mainly two kind of approaches solving the problem.

1.1 Uniform technique

Based on the matrix_RIP assumption, this technique combines $epsilon$-net argument and union bound, and finally gives a bound for successful recovery. In this technique, the optimum is not fixed, that is, the result holds for all original $X_0in R^{M times N}$.

1.2 Nonuniform technique

This approach gives a tighted bound by using convex geometry and Gaussian widths. However, It shoud be mentioned that the optimum $X_0$ is fixed, because the tangent cone is determined by $X_0$.

2 Matrix Completion

Matrix completion is a problem of recovering a low-rank matrix from a few number of its entries. This problem can be expressed as the above low-rank recovery problem. But the operater is bounded orthogonal rather than Gaussian.

The popular method to solve matrix completion is dual certificate.

3 Lifting

In this paper, lifting is a way to recast a system of quadratic equations/Phas Retrieval/Blind Deconvolution to a system of low-rank recovery.

3.1 Phase Retrieval

For this problem, we only know some magnitudes of linear measurements $y_l = |leftlangle {v_0, a_l} rightrangle | ,l=1,ldots,L$. After squaring the observations, we get
$$
y_l^2 = |leftlangle {v_0, a_l} rightrangle |^2=leftlangle {v_0 v_0^T,a_l a_l^T} rightrangle=leftlangle {X_0,A_l} rightrangle,
$$

where $X_0=v_0 v_0^T$ and $A_l=a_l a_l^T$ are rank one matrices. So this problem can be solved as
$$
min ||X||_{*} ~~ s.t. ~~ leftlangle{X,A_l}rightrangle = y_l^2, l=1,ldots,L.
$$

3.2 Blind Deconvolution

The obeservation model is $y=h*s$. By Fourior transform, this problem can also be recasted to low-rank recovery.

Refenrence

1.M. A. Davenport and J. Romberg, “An overview of low-rank matrix recovery from incomplete observations,” IEEE Journal of Selected Topics in Signal Processing, vol. 10, no. 4, pp. 608–622, 2016.