Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Phase Diagram of Compressed Sensing with <i>l</i><sub>0</sub>-norm Regularization
 
research article

Phase Diagram of Compressed Sensing with l0-norm Regularization

Barbier, Damien  
•
Lucibello, Carlo
•
Saglietti, Luca
Show more
June 1, 2025
Journal Of Statistical Mechanics-theory And Experiment

Noiseless compressive sensing is a two-step setting that allows for undersampling a sparse signal and then reconstructing it without loss of information. The LASSO algorithm, based on l(1) regularization, provides an efficient and robust way to address this problem, but it fails in the regime of very high compression rate. Here we present two algorithms, based on l(0)-norm regularization, that outperform LASSO in terms of compression rate in the Gaussian design setting for measurement matrix. These algorithms are based on the approximate survey propagation, an algorithmic family within the approximate message Passing class. In the large system limit, they can be rigorously tracked through state evolution equations, and it is possible to exactly predict the range compression rates for which perfect signal reconstruction is possible. We also provide a statistical physics analysis of the l(0)-norm noiseless compressive sensing model. We show the existence of both a replica symmetric state and a one-step replica symmmetry broken (1RSB) state for sufficiently low l(0)-norm regularization. The recovery limits of our algorithms are linked to the behavior of the 1RSB solution.

  • Details
  • Metrics
Type
research article
DOI
10.1088/1742-5468/adca21
Web of Science ID

WOS:001509814700001

Author(s)
Barbier, Damien  

École Polytechnique Fédérale de Lausanne

Lucibello, Carlo

Bocconi University

Saglietti, Luca

Bocconi University

Krzakala, Florent  

École Polytechnique Fédérale de Lausanne

Zdeborova, Lenka  

École Polytechnique Fédérale de Lausanne

Date Issued

2025-06-01

Publisher

IOP Publishing Ltd

Published in
Journal Of Statistical Mechanics-theory And Experiment
Volume

2025

Issue

6

Article Number

063402

Subjects

message-passing algorithms

•

spin glasses

•

statistical inference

•

communication

•

supply and information networks

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
EDPY-ENS  
IDEPHICS1  
SPOC1  
FunderFunding(s)Grant NumberGrant URL

European Research Council (ERC)

Swiss National Science Foundation grant SNFS OperaGOST

European Union - Next Generation EU

CUP J53D23001330001

Available on Infoscience
June 27, 2025
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/251669
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés