Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Approaching the Rate-Distortion Limit With Spatial Coupling, Belief Propagation, and Decimation
 
research article

Approaching the Rate-Distortion Limit With Spatial Coupling, Belief Propagation, and Decimation

Aref, Vahid  
•
Macris, Nicolas  
•
Vuffray, Marc  
2015
IEEE TRANSACTIONS ON INFORMATION THEORY

We investigate an encoding scheme for lossy compression of a binary symmetric source based on simple spatially coupled low-density generator-matrix codes. The degree of the check nodes is regular and the one of code-bits is Poisson distributed with an average depending on the compression rate. The performance of a low complexity belief propagation guided decimation algorithm is excellent. The algorithmic rate-distortion curve approaches the optimal curve of the ensemble as the width of the coupling window grows. Moreover, as the check degree grows both curves approach the ultimate Shannon rate-distortion limit. The belief propagation guided decimation encoder is based on the posterior measure of a binary symmetric test-channel. This measure can be interpreted as a random Gibbs measure at a temperature directly related to the noise level of the test-channel. We investigate the links between the algorithmic performance of the belief propagation guided decimation encoder and the phase diagram of this Gibbs measure. The phase diagram is investigated thanks to the cavity method of spin glass theory which predicts a number of phase transition thresholds. In particular, the dynamical and condensation phase transition temperatures (equivalently test-channel noise thresholds) are computed. We observe that: 1) the dynamical temperature of the spatially coupled construction saturates toward the condensation temperature and 2) for large degrees the condensation temperature approaches the temperature (i.e., noise level) related to the information theoretic Shannon test-channel noise parameter of rate-distortion theory. This provides heuristic insight into the excellent performance of the belief propagation guided decimation algorithm. This paper contains an introduction to the cavity method.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1109/TIT.2015.2434842
Web of Science ID

WOS:000356301600019

ArXiv ID

1307.5210

Author(s)
Aref, Vahid  
Macris, Nicolas  
Vuffray, Marc  
Date Issued

2015

Publisher

Institute of Electrical and Electronics Engineers

Published in
IEEE TRANSACTIONS ON INFORMATION THEORY
Volume

61

Issue

7

Start page

3954

End page

3979

Subjects

rate-distortion bound

•

low-density generator matrix codes

•

belief propagation

•

decimation

•

spatial coupling

•

threshold saturation

•

spin glass

•

cavity method

•

density evolution

•

dynamical and condensation phase transitions

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LTHC  
Available on Infoscience
August 26, 2015
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/117370
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés