Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Adaptive Path Interpolation Method for Sparse Systems: Application to a Censored Block Model
 
research article

Adaptive Path Interpolation Method for Sparse Systems: Application to a Censored Block Model

Barbier, Jean  
•
Chan, Chun Lam  
•
Macris, Nicolas  
April 1, 2021
Ieee Transactions On Information Theory

Recently, a new adaptive path interpolation method has been developed as a simple and versatile scheme to calculate exactly the asymptotic mutual information of Bayesian inference problems defined on dense factor graphs. These include random linear and generalized estimation, sparse superposition codes, and low-rank matrix / tensor estimation. For all these systems, the adaptive interpolation method directly proves that the replica-symmetric prediction is exact, in a simple and unified manner. When the underlying factor graph of the inference problem is sparse the replica prediction is considerably more complicated, and rigorous results are often lacking or obtained by rather complicated methods. In this work we show how to extend the adaptive path interpolation method to sparse systems. We concentrate on a censored block model, where hidden variables are measured through a binary erasure channel, for which we fully prove the replica prediction.

  • Details
  • Metrics
Type
research article
DOI
10.1109/TIT.2021.3052524
Web of Science ID

WOS:000631200600005

Author(s)
Barbier, Jean  
•
Chan, Chun Lam  
•
Macris, Nicolas  
Date Issued

2021-04-01

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

Published in
Ieee Transactions On Information Theory
Volume

67

Issue

4

Start page

2093

End page

2114

Subjects

Computer Science, Information Systems

•

Engineering, Electrical & Electronic

•

Computer Science

•

Engineering

•

interpolation

•

entropy

•

adaptation models

•

biological system modeling

•

estimation

•

bayes methods

•

adaptive systems

•

bayesian inference

•

cavity method

•

censored block models

•

community detection

•

graphical models

•

mutual information

•

statistical physics

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LTHC  
Available on Infoscience
April 10, 2021
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/177118
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés