Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Compressed sensing with ℓ 0-norm: statistical physics analysis & algorithms for signal recovery
 
conference paper

Compressed sensing with ℓ 0-norm: statistical physics analysis & algorithms for signal recovery

Barbier, D.  
•
Lucibello, C.
•
Saglietti, L.
Show more
January 1, 2023
2023 Ieee Information Theory Workshop, Itw
IEEE Information Theory Workshop (ITW)

Noiseless compressive sensing is a protocol that enables undersampling and later recovery of a signal without loss of information. This compression is possible because the signal is usually sufficiently sparse in a given basis. Currently, the algorithm offering the best tradeoff between compression rate, robustness, and speed for compressive sensing is the LASSO (l(1)-norm bias) algorithm. However, many studies have pointed out the possibility that the implementation of l(p)-norms biases, with p smaller than one, could give better performance while sacrificing convexity. In this work, we focus specifically on the extreme case of the l(0)-based reconstruction, a task that is complicated by the discontinuity of the loss. In the first part of the paper, we describe via statistical physics methods, and in particular the replica method, how the solutions to this optimization problem are arranged in a clustered structure. We observe two distinct regimes: one at low compression rate where the signal can be recovered exactly, and one at high compression rate where the signal cannot be recovered accurately. In the second part, we present two message-passing algorithms based on our first results for the l(0)-norm optimization problem. The proposed algorithms are able to recover the signal at compression rates higher than the ones achieved by LASSO while being computationally efficient.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/ITW55543.2023.10161684
Web of Science ID

WOS:001031733100058

Author(s)
Barbier, D.  
Lucibello, C.
Saglietti, L.
Krzakala, F.  
Zdeborova, L.  
Date Issued

2023-01-01

Publisher

IEEE

Publisher place

New York

Published in
2023 Ieee Information Theory Workshop, Itw
ISBN of the book

979-8-3503-0149-6

Series title/Series vol.

Information Theory Workshop

Start page

323

End page

328

Subjects

Computer Science, Information Systems

•

Computer Science, Theory & Methods

•

Mathematics, Applied

•

Computer Science

•

Mathematics

•

compressive sensing

•

optimization

•

statistical physics

•

message passing algorithm

•

map estimation

•

reconstruction

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
IDEPHICS2  
Event nameEvent placeEvent date
IEEE Information Theory Workshop (ITW)

Saint-Malo, FRANCE

Apr 23-28, 2023

Available on Infoscience
August 28, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/200133
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés