Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Polarization of the Renyi Information Dimension With Applications to Compressed Sensing
 
conference paper

Polarization of the Renyi Information Dimension With Applications to Compressed Sensing

Haghighatshoar, Saeid  
•
Abbe, Emmanuel
2017
Ieee Transactions On Information Theory
IEEE International Symposium on Information Theory (ISIT)

In this paper, we show that the Hadamard matrix acts as an extractor over the reals of the Renyi Information Dimension (RID), in an analogous way to how it acts as an extractor of the discrete entropy over finite fields. More precisely, we prove that the RID of an i.i.d. sequence of mixture random variables polarizes to the extremal values of 0 and 1 (corresponding to discrete and continuous distributions) when transformed by a Hadamard matrix. Furthermore, we prove that the polarization pattern of the RID admits a closed form expression and follows exactly the Binary Erasure Channel (BEC) polarization pattern in the discrete setting. We discuss the applications of the RID polarization to Compressed Sensing of i.i.d. sources. In particular, we use the RID polarization to construct a family of deterministic +/- 1-valued sensing matrices for Compressed Sensing. We run numerical simulations to compare the performance of the resulting matrices with that of the random Gaussian and the random Hadamard matrices. The results indicate that the proposed matrices aftbrd competitive performances, while being explicitly constructed.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/Tit.2017.2746103
Web of Science ID

WOS:000413318900003

Author(s)
Haghighatshoar, Saeid  
Abbe, Emmanuel
Date Issued

2017

Publisher

Ieee-Inst Electrical Electronics Engineers Inc

Publisher place

Piscataway

Published in
Ieee Transactions On Information Theory
Total of pages

11

Volume

63

Issue

11

Start page

6858

End page

6868

Subjects

Renyi Information Dimension

•

polarization theory

•

Compressed Sensing

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
IINFCOM  
Event nameEvent placeEvent date
IEEE International Symposium on Information Theory (ISIT)

Istanbul, TURKEY

JUL 07-12, 2013

Available on Infoscience
November 8, 2017
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/141924
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés