TY - JOUR
T1 - Performance analysis for sparse support recovery
AU - Tang, Gongguo
AU - Nehorai, Arye
N1 - Funding Information:
Manuscript received June 05, 2009; revised November 04, 2009. Current version published March 10, 2010. This work was supported by the Department of Defense under the Air Force Office of Scientific Research MURI Grant FA9550-05-1-0443, and ONR Grant N000140810849. The material in this paper was presented in part at the 47th Annual Allerton Conference on Communication, Control, Monticello, IL, September 2009.
PY - 2010/3
Y1 - 2010/3
N2 - The performance of estimating the common support for jointly sparse signals based on their projections onto lower-dimensional space is analyzed. Support recovery is formulated as a multiple-hypothesis testing problem. Both upper and lower bounds on the probability of error are derived for general measurement matrices, by using the Chernoff bound and Fano's inequality, respectively. The upper bound shows that the performance is determined by a quantity measuring the measurement matrix incoherence, while the lower bound reveals the importance of the total measurement gain. The lower bound is applied to derive the minimal number of samples needed for accurate direction-of-arrival (DOA) estimation for a sparse representation based algorithm. When applied to Gaussian measurement ensembles, these bounds give necessary and sufficient conditions for a vanishing probability of error for majority realizations of the measurement matrix. Our results offer surprising insights into sparse signal recovery. For example, as far as support recovery is concerned, the well-known bound in Compressive Sensing with the Gaussian measurement matrix is generally not sufficient unless the noise level is low. Our study provides an alternative performance measure, one that is natural and important in practice, for signal recovery in Compressive Sensing and other application areas exploiting signal sparsity.
AB - The performance of estimating the common support for jointly sparse signals based on their projections onto lower-dimensional space is analyzed. Support recovery is formulated as a multiple-hypothesis testing problem. Both upper and lower bounds on the probability of error are derived for general measurement matrices, by using the Chernoff bound and Fano's inequality, respectively. The upper bound shows that the performance is determined by a quantity measuring the measurement matrix incoherence, while the lower bound reveals the importance of the total measurement gain. The lower bound is applied to derive the minimal number of samples needed for accurate direction-of-arrival (DOA) estimation for a sparse representation based algorithm. When applied to Gaussian measurement ensembles, these bounds give necessary and sufficient conditions for a vanishing probability of error for majority realizations of the measurement matrix. Our results offer surprising insights into sparse signal recovery. For example, as far as support recovery is concerned, the well-known bound in Compressive Sensing with the Gaussian measurement matrix is generally not sufficient unless the noise level is low. Our study provides an alternative performance measure, one that is natural and important in practice, for signal recovery in Compressive Sensing and other application areas exploiting signal sparsity.
KW - Chernoff bound
KW - Compressive sensing
KW - Fanos inequality
KW - Jointly sparse signals
KW - Multiple hypothesis testing
KW - Probability of error
KW - Support recovery
UR - http://www.scopus.com/inward/record.url?scp=77949499138&partnerID=8YFLogxK
U2 - 10.1109/TIT.2009.2039039
DO - 10.1109/TIT.2009.2039039
M3 - Article
AN - SCOPUS:77949499138
SN - 0018-9448
VL - 56
SP - 1383
EP - 1399
JO - IEEE Transactions on Information Theory
JF - IEEE Transactions on Information Theory
IS - 3
M1 - 5429137
ER -