Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Limits on Support Recovery With Probabilistic Models: An Information-Theoretic Framework
 
research article

Limits on Support Recovery With Probabilistic Models: An Information-Theoretic Framework

Scarlett, Jonathan  
•
Cevher, Volkan  orcid-logo
2017
IEEE Transactions on Information Theory

The support recovery problem consists of determining a sparse subset of a set of variables that is relevant in generating a set of observations, and arises in a diverse range of settings, such as compressive sensing, subset selection in regression, and group testing. In this paper, we take a unified approach to support recovery problems, considering general probabilistic models relating a sparse data vector to an observation vector. We study the information-theoretic limits of both exact and partial support recovery, taking a novel approach motivated by thresholding techniques in channel coding. We provide general achievability and converse bounds characterizing the trade-off between the error probability and number of measurements, and we specialize these to the linear, 1-bit, and group testing models. In several cases, our bounds not only provide matching scaling laws in the necessary and sufficient number of measurements, but also sharp thresholds with matching constant factors. Our approach has several advantages over previous approaches. For the achievability part, we obtain sharp thresholds under broader scalings of the sparsity level and other parameters (e.g., signal-to-noise ratio) compared with several previous works, and for the converse part, we not only provide conditions under which the error probability fails to vanish, but also conditions under which it tends to one.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1109/TIT.2016.2606605
Author(s)
Scarlett, Jonathan  
Cevher, Volkan  orcid-logo
Date Issued

2017

Publisher

Institute of Electrical and Electronics Engineers

Published in
IEEE Transactions on Information Theory
Volume

63

Issue

1

Start page

593

End page

620

Subjects

support recovery

•

sparsity pattern recovery

•

compressed sensing

•

group testing

•

information-spectrum techniques

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LIONS  
Available on Infoscience
January 19, 2015
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/110400
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés